[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:10:34.887280 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:44729
I20260709 13:10:34.888944 28922 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:10:34.890086 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:34.908598 28931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:34.908595 28929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:34.909776 28922 server_base.cc:1061] running on GCE node
W20260709 13:10:34.909205 28928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.133152 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.133500 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.133731 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602636133707 us; error 0 us; skew 500 ppm
I20260709 13:10:36.134616 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.140625 28922 webserver.cc:533] Webserver started at http://127.28.62.190:44695/ using document root <none> and password file <none>
I20260709 13:10:36.141660 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.141923 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:36.142388 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:36.148501 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "fbc2a1e452cb4f5cb96aacb829d36fed"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.156668 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:36.162425 28937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.163900 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:10:36.164333 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "fbc2a1e452cb4f5cb96aacb829d36fed"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.164718 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:36.234125 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:36.235809 28922 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:10:36.236340 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:36.314445 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:44729
I20260709 13:10:36.314525 28988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:44729 every 8 connection(s)
I20260709 13:10:36.323009 28989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.345783 28989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: Bootstrap starting.
I20260709 13:10:36.352108 28989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.354176 28989 log.cc:826] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: Log is configured to *not* fsync() on all Append() calls
I20260709 13:10:36.359202 28989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: No bootstrap required, opened a new log
I20260709 13:10:36.380110 28989 raft_consensus.cc:359] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER }
I20260709 13:10:36.380676 28989 raft_consensus.cc:385] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.380990 28989 raft_consensus.cc:740] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc2a1e452cb4f5cb96aacb829d36fed, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.382179 28989 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER }
I20260709 13:10:36.382699 28989 raft_consensus.cc:399] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:36.383004 28989 raft_consensus.cc:493] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:36.383375 28989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.387758 28989 raft_consensus.cc:515] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER }
I20260709 13:10:36.388713 28989 leader_election.cc:304] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbc2a1e452cb4f5cb96aacb829d36fed; no voters: 
I20260709 13:10:36.390579 28989 leader_election.cc:290] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:36.390933 28992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.393280 28992 raft_consensus.cc:697] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 1 LEADER]: Becoming Leader. State: Replica: fbc2a1e452cb4f5cb96aacb829d36fed, State: Running, Role: LEADER
I20260709 13:10:36.394380 28992 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER }
I20260709 13:10:36.395431 28989 sys_catalog.cc:565] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:36.407837 28993 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc2a1e452cb4f5cb96aacb829d36fed. Latest consensus state: current_term: 1 leader_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER } }
I20260709 13:10:36.407963 28994 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc2a1e452cb4f5cb96aacb829d36fed" member_type: VOTER } }
I20260709 13:10:36.408676 28993 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:36.408680 28994 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:36.412398 29002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:36.423024 29002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:36.425551 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:36.440755 29002 catalog_manager.cc:1383] Generated new cluster ID: 601df0d15f394465a574e567e1ffa720
I20260709 13:10:36.441114 29002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:36.473927 29002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:36.475750 29002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:36.490835 29002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: Generated new TSK 0
I20260709 13:10:36.491961 29002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:36.557682 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:36.567595 29011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.569240 29012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.573141 29014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.574028 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:36.574898 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.575103 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.575326 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602636575291 us; error 0 us; skew 500 ppm
I20260709 13:10:36.576032 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.581073 28922 webserver.cc:533] Webserver started at http://127.28.62.129:38729/ using document root <none> and password file <none>
I20260709 13:10:36.581758 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.582007 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:36.582348 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:36.583619 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "f44afc36ea0f4101a020906f71cda57e"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.590286 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:10:36.595502 29019 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.596487 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:36.596870 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "f44afc36ea0f4101a020906f71cda57e"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.597252 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:36.618467 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:36.620592 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:36.623590 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:36.629522 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:36.629884 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.630198 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:36.630419 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.734849 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:43131
I20260709 13:10:36.734951 29081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:43131 every 8 connection(s)
I20260709 13:10:36.743744 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:36.759634 29087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.760237 29086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.773384 29089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.775895 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:36.777117 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.777474 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.777719 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602636777699 us; error 0 us; skew 500 ppm
I20260709 13:10:36.778602 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.779299 29082 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44729
I20260709 13:10:36.779839 29082 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:36.781260 29082 heartbeater.cc:507] Master 127.28.62.190:44729 requested a full tablet report, sending...
I20260709 13:10:36.788179 28922 webserver.cc:533] Webserver started at http://127.28.62.130:46367/ using document root <none> and password file <none>
I20260709 13:10:36.789132 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.789476 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:36.789732 28954 ts_manager.cc:194] Registered new tserver with Master: f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131)
I20260709 13:10:36.789875 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:36.791704 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "9fe2e7d28def45869be43f6949f29ee6"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.792217 28954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58998
I20260709 13:10:36.799499 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:36.805202 29094 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.806265 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:36.806645 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "9fe2e7d28def45869be43f6949f29ee6"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:36.807073 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:36.839984 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:36.841657 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:36.844550 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:36.848640 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:36.848876 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.849231 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:36.849447 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.957551 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:45381
I20260709 13:10:36.957670 29156 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:45381 every 8 connection(s)
I20260709 13:10:36.967715 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:36.977257 29160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.979882 29161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.983537 29157 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44729
I20260709 13:10:36.984236 29157 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:36.985948 29157 heartbeater.cc:507] Master 127.28.62.190:44729 requested a full tablet report, sending...
I20260709 13:10:36.987377 28922 server_base.cc:1061] running on GCE node
W20260709 13:10:36.988538 29163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.989375 28954 ts_manager.cc:194] Registered new tserver with Master: 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:36.990348 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.990640 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.990870 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602636990849 us; error 0 us; skew 500 ppm
I20260709 13:10:36.991523 28954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59006
I20260709 13:10:36.991820 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.995275 28922 webserver.cc:533] Webserver started at http://127.28.62.131:46019/ using document root <none> and password file <none>
I20260709 13:10:36.995977 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.996173 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:36.996403 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:36.997748 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "d6d02fabca594547ac60cf8461ad98dc"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:37.003224 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:37.007184 29168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.008131 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:37.008508 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "d6d02fabca594547ac60cf8461ad98dc"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-50cs"
I20260709 13:10:37.008852 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.026068 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.027402 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.029076 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.031886 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:37.032119 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.032382 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:37.032573 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.129508 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:38791
I20260709 13:10:37.129681 29230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:38791 every 8 connection(s)
I20260709 13:10:37.145915 29231 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44729
I20260709 13:10:37.146392 29231 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:37.147624 29231 heartbeater.cc:507] Master 127.28.62.190:44729 requested a full tablet report, sending...
I20260709 13:10:37.150686 28954 ts_manager.cc:194] Registered new tserver with Master: d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:37.151041 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016847378s
I20260709 13:10:37.152619 28954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59014
I20260709 13:10:37.207599 28954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59022:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:37.212209 28954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:37.346555 29196 tablet_service.cc:1511] Processing CreateTablet for tablet 252aeb6d471c4edea87d9796e0171199 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.357475 29196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252aeb6d471c4edea87d9796e0171199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.352416 29194 tablet_service.cc:1511] Processing CreateTablet for tablet cc8ec4da225b4a6a86c1b13d91525352 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.354281 29120 tablet_service.cc:1511] Processing CreateTablet for tablet cc8ec4da225b4a6a86c1b13d91525352 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.352234 29193 tablet_service.cc:1511] Processing CreateTablet for tablet 9624681ab67d4ba2b3e65bc6246176e7 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.355430 29195 tablet_service.cc:1511] Processing CreateTablet for tablet 3875a9dd2688402488c598e98305a036 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.356024 29122 tablet_service.cc:1511] Processing CreateTablet for tablet 252aeb6d471c4edea87d9796e0171199 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.366304 29193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9624681ab67d4ba2b3e65bc6246176e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.361907 29121 tablet_service.cc:1511] Processing CreateTablet for tablet 3875a9dd2688402488c598e98305a036 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.363125 29119 tablet_service.cc:1511] Processing CreateTablet for tablet 9624681ab67d4ba2b3e65bc6246176e7 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.364758 29192 tablet_service.cc:1511] Processing CreateTablet for tablet 13e6cd69f75d427382eec0db0b6e080a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.373242 29118 tablet_service.cc:1511] Processing CreateTablet for tablet 13e6cd69f75d427382eec0db0b6e080a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.374188 29195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3875a9dd2688402488c598e98305a036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.377804 29122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252aeb6d471c4edea87d9796e0171199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.378054 29192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e6cd69f75d427382eec0db0b6e080a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.380474 29121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3875a9dd2688402488c598e98305a036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.381817 29118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e6cd69f75d427382eec0db0b6e080a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.382875 29194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8ec4da225b4a6a86c1b13d91525352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.384953 29119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9624681ab67d4ba2b3e65bc6246176e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.386560 29120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8ec4da225b4a6a86c1b13d91525352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.396700 29117 tablet_service.cc:1511] Processing CreateTablet for tablet e3a7cb10a151427bbfd94311781d7757 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.398831 29117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a7cb10a151427bbfd94311781d7757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.408469 29046 tablet_service.cc:1511] Processing CreateTablet for tablet 3875a9dd2688402488c598e98305a036 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.406339 29044 tablet_service.cc:1511] Processing CreateTablet for tablet 9624681ab67d4ba2b3e65bc6246176e7 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.414836 29044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9624681ab67d4ba2b3e65bc6246176e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.421674 29046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3875a9dd2688402488c598e98305a036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.419094 29191 tablet_service.cc:1511] Processing CreateTablet for tablet e3a7cb10a151427bbfd94311781d7757 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.423641 29043 tablet_service.cc:1511] Processing CreateTablet for tablet 13e6cd69f75d427382eec0db0b6e080a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.424400 29045 tablet_service.cc:1511] Processing CreateTablet for tablet cc8ec4da225b4a6a86c1b13d91525352 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.428393 29045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8ec4da225b4a6a86c1b13d91525352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.415200 29047 tablet_service.cc:1511] Processing CreateTablet for tablet 252aeb6d471c4edea87d9796e0171199 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.432672 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252aeb6d471c4edea87d9796e0171199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.440021 29042 tablet_service.cc:1511] Processing CreateTablet for tablet e3a7cb10a151427bbfd94311781d7757 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.441955 29042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a7cb10a151427bbfd94311781d7757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.444056 29191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a7cb10a151427bbfd94311781d7757. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:37.448490 29001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:37.453105 29043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e6cd69f75d427382eec0db0b6e080a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.479305 29041 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2013095314f12b67b76dda0c0ae6c (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.481016 29041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2013095314f12b67b76dda0c0ae6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.549930 29116 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2013095314f12b67b76dda0c0ae6c (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.553296 29116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2013095314f12b67b76dda0c0ae6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.589900 29195 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2013095314f12b67b76dda0c0ae6c (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.592280 29195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2013095314f12b67b76dda0c0ae6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.601511 29249 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:37.619269 29040 tablet_service.cc:1511] Processing CreateTablet for tablet 08452a49ed2947b28090a24dbf62b8a3 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.623584 29040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08452a49ed2947b28090a24dbf62b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.641295 29250 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:37.642030 29191 tablet_service.cc:1511] Processing CreateTablet for tablet 08452a49ed2947b28090a24dbf62b8a3 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.654114 29191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08452a49ed2947b28090a24dbf62b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.654043 29120 tablet_service.cc:1511] Processing CreateTablet for tablet 08452a49ed2947b28090a24dbf62b8a3 (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.658041 29120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08452a49ed2947b28090a24dbf62b8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.658149 29251 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:37.687541 29249 tablet_bootstrap.cc:654] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.697381 29250 tablet_bootstrap.cc:654] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.702488 29117 tablet_service.cc:1511] Processing CreateTablet for tablet 900f808371a040c8827725710de1fb0a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.704269 29117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900f808371a040c8827725710de1fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.702455 29040 tablet_service.cc:1511] Processing CreateTablet for tablet 900f808371a040c8827725710de1fb0a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.707653 29192 tablet_service.cc:1511] Processing CreateTablet for tablet 900f808371a040c8827725710de1fb0a (DEFAULT_TABLE table=test-workload [id=0041322e06ef43de9b4e5dbf718a6c11]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.710016 29251 tablet_bootstrap.cc:654] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.710223 29192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900f808371a040c8827725710de1fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.710467 29040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900f808371a040c8827725710de1fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.733583 29249 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:37.734124 29249 ts_tablet_manager.cc:1403] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.018s
I20260709 13:10:37.734510 29250 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:37.734992 29250 ts_tablet_manager.cc:1403] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.020s
I20260709 13:10:37.736670 29249 raft_consensus.cc:359] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.737353 29249 raft_consensus.cc:385] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.737739 29249 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.738188 29250 raft_consensus.cc:359] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.739001 29250 raft_consensus.cc:385] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.738750 29249 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.739365 29250 raft_consensus.cc:740] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.740240 29250 consensus_queue.cc:260] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.740813 29251 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:37.741451 29251 ts_tablet_manager.cc:1403] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.006s
I20260709 13:10:37.745946 29251 raft_consensus.cc:359] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.746670 29251 raft_consensus.cc:385] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.746973 29251 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.747232 29250 ts_tablet_manager.cc:1434] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.008s
I20260709 13:10:37.748143 29082 heartbeater.cc:499] Master 127.28.62.190:44729 was elected leader, sending a full tablet report...
I20260709 13:10:37.747778 29251 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.759680 29251 ts_tablet_manager.cc:1434] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.010s
I20260709 13:10:37.759632 29157 heartbeater.cc:499] Master 127.28.62.190:44729 was elected leader, sending a full tablet report...
I20260709 13:10:37.761624 29251 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:37.762060 29250 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:37.768859 29250 tablet_bootstrap.cc:654] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.773047 29249 ts_tablet_manager.cc:1434] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.039s	user 0.018s	sys 0.008s
I20260709 13:10:37.773141 29251 tablet_bootstrap.cc:654] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.779872 29231 heartbeater.cc:499] Master 127.28.62.190:44729 was elected leader, sending a full tablet report...
I20260709 13:10:37.780150 29251 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:37.780385 29249 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:37.780628 29251 ts_tablet_manager.cc:1403] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.007s
I20260709 13:10:37.784165 29251 raft_consensus.cc:359] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.784974 29251 raft_consensus.cc:385] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.785502 29251 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.786695 29251 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.787752 29249 tablet_bootstrap.cc:654] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.789752 29251 ts_tablet_manager.cc:1434] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:10:37.790859 29251 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:37.800113 29251 tablet_bootstrap.cc:654] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.813019 29250 tablet_bootstrap.cc:492] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:37.813619 29250 ts_tablet_manager.cc:1403] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.005s
I20260709 13:10:37.816615 29250 raft_consensus.cc:359] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.817211 29255 raft_consensus.cc:493] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.817389 29250 raft_consensus.cc:385] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.817444 29251 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:37.817873 29250 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.818161 29251 ts_tablet_manager.cc:1403] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 13:10:37.817811 29255 raft_consensus.cc:515] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.818809 29250 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.820960 29250 ts_tablet_manager.cc:1434] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:37.821834 29251 raft_consensus.cc:359] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.822690 29251 raft_consensus.cc:385] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.823086 29251 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.824222 29255 leader_election.cc:290] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:37.824227 29251 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.831244 29251 ts_tablet_manager.cc:1434] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:37.833976 29250 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:37.834555 29251 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:37.841917 29250 tablet_bootstrap.cc:654] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.856251 29251 tablet_bootstrap.cc:654] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.857194 29250 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:37.857707 29250 ts_tablet_manager.cc:1403] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.006s
I20260709 13:10:37.861166 29250 raft_consensus.cc:359] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.862074 29250 raft_consensus.cc:385] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.862455 29250 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.863288 29250 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.865583 29257 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.866226 29250 ts_tablet_manager.cc:1434] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:10:37.866133 29257 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.867398 29250 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:37.864471 29249 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:37.873225 29249 ts_tablet_manager.cc:1403] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.042s
I20260709 13:10:37.877167 29257 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
W20260709 13:10:37.886780 29232 tablet.cc:2406] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:37.896515 29250 tablet_bootstrap.cc:654] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.892593 29249 raft_consensus.cc:359] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.900488 29249 raft_consensus.cc:385] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.900956 29249 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.904209 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:37.905112 29132 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:37.901988 29249 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.913034 29169 leader_election.cc:304] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:37.913884 29249 ts_tablet_manager.cc:1434] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:10:37.914613 29255 raft_consensus.cc:2804] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.915398 29255 raft_consensus.cc:493] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.915925 29255 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.918104 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:37.919313 29057 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:37.922418 29249 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:37.928332 29251 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:37.929049 29251 ts_tablet_manager.cc:1403] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.004s
I20260709 13:10:37.926028 29255 raft_consensus.cc:515] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.944371 29255 leader_election.cc:290] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:37.945351 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:37.952811 29057 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.953619 29251 raft_consensus.cc:359] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.954452 29251 raft_consensus.cc:385] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.954797 29251 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.946534 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:37.955822 29132 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.951654 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:37.955722 29251 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.957284 29056 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:37.960238 29250 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:37.960763 29250 ts_tablet_manager.cc:1403] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.029s
I20260709 13:10:37.956130 29249 tablet_bootstrap.cc:654] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.962379 29096 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:37.964150 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:37.967013 29257 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.968007 29257 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.968772 29257 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:37.970530 29097 leader_election.cc:343] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.971594 29250 raft_consensus.cc:359] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.972365 29250 raft_consensus.cc:385] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.972708 29250 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.973547 29250 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:37.976084 29250 ts_tablet_manager.cc:1434] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:37.977748 29250 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:37.976747 29251 ts_tablet_manager.cc:1434] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.014s
I20260709 13:10:37.983883 29251 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:37.993855 29257 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:37.997323 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:37.997151 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:37.998109 29056 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.002755 29132 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.004264 29169 leader_election.cc:304] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:38.005184 29255 raft_consensus.cc:2804] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.006669 29056 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
W20260709 13:10:37.999899 29097 leader_election.cc:343] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:37.998651 29257 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.010124 29057 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.017938 29256 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.013911 29096 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:38.019368 29257 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.019091 29256 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.020002 29257 raft_consensus.cc:697] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:38.018468 29255 raft_consensus.cc:697] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:38.023393 29257 consensus_queue.cc:237] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:38.025249 29251 tablet_bootstrap.cc:654] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.026356 29256 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.028017 29271 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.033249 29271 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.037441 29250 tablet_bootstrap.cc:654] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.027258 29255 consensus_queue.cc:237] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.042245 29271 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.042518 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.043092 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.043866 29206 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
W20260709 13:10:38.044166 29096 leader_election.cc:343] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.046007 29097 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:38.048877 29256 raft_consensus.cc:493] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.048993 29271 raft_consensus.cc:2804] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.049450 29256 raft_consensus.cc:515] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.049465 29271 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.050745 29271 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.051923 29256 leader_election.cc:290] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.053828 29249 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.054368 29249 ts_tablet_manager.cc:1403] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.005s
I20260709 13:10:38.070739 29251 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:38.071337 29251 ts_tablet_manager.cc:1403] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.001s
I20260709 13:10:38.081364 29251 raft_consensus.cc:359] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.082211 29251 raft_consensus.cc:385] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.082571 29251 raft_consensus.cc:740] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.083385 29251 consensus_queue.cc:260] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.086992 29249 raft_consensus.cc:359] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.088097 29249 raft_consensus.cc:385] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.088454 29249 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.089673 29249 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.092087 29249 ts_tablet_manager.cc:1434] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:10:38.093336 29249 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.096573 29279 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.097081 29279 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.097824 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.098840 28954 catalog_manager.cc:5697] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.100867 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
W20260709 13:10:38.101140 29020 leader_election.cc:343] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:38.102407 29096 leader_election.cc:343] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.103322 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.103968 29132 raft_consensus.cc:2468] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 0.
I20260709 13:10:38.104859 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.105537 29206 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:38.105468 29020 leader_election.cc:304] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.106488 29256 raft_consensus.cc:2804] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.106832 29256 raft_consensus.cc:493] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.107164 29256 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.107832 29271 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.109874 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.111306 29097 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:38.113049 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
W20260709 13:10:38.115919 29022 leader_election.cc:343] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.116760 29022 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f44afc36ea0f4101a020906f71cda57e; no voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:38.118201 29257 raft_consensus.cc:2804] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.118938 29257 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.119448 29257 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.099592 29279 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.120503 29251 ts_tablet_manager.cc:1434] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.048s	user 0.001s	sys 0.011s
I20260709 13:10:38.121732 29256 raft_consensus.cc:515] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.122635 29251 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:38.125602 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:38.126211 29132 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.123870 29256 leader_election.cc:290] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.124451 28951 catalog_manager.cc:5697] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.134029 29256 raft_consensus.cc:2749] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.137913 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
W20260709 13:10:38.140841 29096 leader_election.cc:343] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.138406 29132 raft_consensus.cc:2468] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 1.
I20260709 13:10:38.142309 29271 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.143893 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:38.144527 29206 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.144786 29020 leader_election.cc:304] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.145150 29250 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:38.147835 29257 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.149503 29256 raft_consensus.cc:2804] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.154949 29256 raft_consensus.cc:697] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:38.155808 29256 consensus_queue.cc:237] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.154346 29250 ts_tablet_manager.cc:1403] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.177s	user 0.009s	sys 0.016s
I20260709 13:10:38.160848 29250 raft_consensus.cc:359] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.166839 29250 raft_consensus.cc:385] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.169181 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:38.170092 29250 raft_consensus.cc:740] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.170259 29205 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.166934 29257 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.166666 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
W20260709 13:10:38.175294 29096 leader_election.cc:343] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.176036 29250 consensus_queue.cc:260] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.171082 29249 tablet_bootstrap.cc:654] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:38.181703 29022 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:38791, user_credentials={real_user=slave}} blocked reactor thread for 66158.4us
W20260709 13:10:38.184342 29022 leader_election.cc:343] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.184897 29205 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.180963 29206 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.186244 29097 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:38.187891 29097 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:38.188535 29257 raft_consensus.cc:2804] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.188714 29271 raft_consensus.cc:2804] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.189265 29257 raft_consensus.cc:697] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:38.189330 29271 raft_consensus.cc:697] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:38.190594 29257 consensus_queue.cc:237] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.190824 29271 consensus_queue.cc:237] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.192413 29251 tablet_bootstrap.cc:654] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.194260 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
W20260709 13:10:38.198239 29022 leader_election.cc:343] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.221324 29250 ts_tablet_manager.cc:1434] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.010s
I20260709 13:10:38.223440 29250 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:38.227615 29251 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:38.228396 29251 ts_tablet_manager.cc:1403] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.004s
I20260709 13:10:38.232131 29251 raft_consensus.cc:359] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.233057 29251 raft_consensus.cc:385] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.233577 29251 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.233829 28953 catalog_manager.cc:5697] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 0 to 1, leader changed from <none> to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.234517 29251 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.234985 29249 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.237654 29251 ts_tablet_manager.cc:1434] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:10:38.238070 29249 ts_tablet_manager.cc:1403] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.015s
I20260709 13:10:38.238801 29251 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:38.240557 29250 tablet_bootstrap.cc:654] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.241483 29249 raft_consensus.cc:359] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.242316 29249 raft_consensus.cc:385] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.242650 29249 raft_consensus.cc:740] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.243511 29249 consensus_queue.cc:260] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.256693 29249 ts_tablet_manager.cc:1434] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:10:38.259199 29251 tablet_bootstrap.cc:654] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.261732 29249 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.263391 29250 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:38.263906 29250 ts_tablet_manager.cc:1403] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.004s
I20260709 13:10:38.286846 29249 tablet_bootstrap.cc:654] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.286008 28954 catalog_manager.cc:5697] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.291587 28954 catalog_manager.cc:5697] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.284771 29250 raft_consensus.cc:359] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.293471 29250 raft_consensus.cc:385] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.293859 29250 raft_consensus.cc:740] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.294665 29250 consensus_queue.cc:260] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.302387 29251 tablet_bootstrap.cc:492] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:38.302927 29251 ts_tablet_manager.cc:1403] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.036s
I20260709 13:10:38.306097 29251 raft_consensus.cc:359] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.306861 29251 raft_consensus.cc:385] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.307224 29251 raft_consensus.cc:740] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.308048 29249 tablet_bootstrap.cc:492] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.308197 29251 consensus_queue.cc:260] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.308679 29249 ts_tablet_manager.cc:1403] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.012s
I20260709 13:10:38.311316 29251 ts_tablet_manager.cc:1434] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.005s
I20260709 13:10:38.312443 29251 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:38.316035 29249 raft_consensus.cc:359] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:38.316983 29249 raft_consensus.cc:385] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.317459 29249 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.318397 29250 ts_tablet_manager.cc:1434] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:10:38.318537 29249 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:38.319425 29250 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:38.319620 29251 tablet_bootstrap.cc:654] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.321676 29249 ts_tablet_manager.cc:1434] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:10:38.322844 29249 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.327764 29250 tablet_bootstrap.cc:654] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.330641 29249 tablet_bootstrap.cc:654] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.341365 29249 tablet_bootstrap.cc:492] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.341388 29250 tablet_bootstrap.cc:492] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:38.342356 29250 ts_tablet_manager.cc:1403] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:10:38.345777 29250 raft_consensus.cc:359] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.346764 29250 raft_consensus.cc:385] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.347126 29250 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.342355 29249 ts_tablet_manager.cc:1403] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:10:38.347990 29250 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.348695 29251 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:38.350648 29250 ts_tablet_manager.cc:1434] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:38.351234 29251 ts_tablet_manager.cc:1403] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.018s
I20260709 13:10:38.350777 29249 raft_consensus.cc:359] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.352432 29249 raft_consensus.cc:385] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.352792 29249 raft_consensus.cc:740] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.353682 29249 consensus_queue.cc:260] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.351852 29250 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:38.354964 29251 raft_consensus.cc:359] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.356272 29251 raft_consensus.cc:385] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.356590 29251 raft_consensus.cc:740] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.357538 29251 consensus_queue.cc:260] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.359674 29249 ts_tablet_manager.cc:1434] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:10:38.359724 29251 ts_tablet_manager.cc:1434] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:38.361373 29251 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: Bootstrap starting.
I20260709 13:10:38.366137 29250 tablet_bootstrap.cc:654] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.367447 29249 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.368124 29251 tablet_bootstrap.cc:654] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.375293 29249 tablet_bootstrap.cc:654] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.385839 29286 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.386447 29286 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.388355 29249 tablet_bootstrap.cc:492] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.388952 29249 ts_tablet_manager.cc:1403] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 13:10:38.388899 29286 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.390372 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.390648 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.391278 29206 raft_consensus.cc:2393] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f44afc36ea0f4101a020906f71cda57e in current term 1: Already voted for candidate 9fe2e7d28def45869be43f6949f29ee6 in this term.
I20260709 13:10:38.392725 29020 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f44afc36ea0f4101a020906f71cda57e; no voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:38.393683 29286 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.396620 29250 tablet_bootstrap.cc:492] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:38.397121 29250 ts_tablet_manager.cc:1403] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:10:38.400496 29251 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: No bootstrap required, opened a new log
I20260709 13:10:38.400390 29250 raft_consensus.cc:359] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.400986 29251 ts_tablet_manager.cc:1403] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.018s
I20260709 13:10:38.401189 29250 raft_consensus.cc:385] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.401623 29250 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.401301 29249 raft_consensus.cc:359] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.402424 29250 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.403903 29249 raft_consensus.cc:385] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.403729 29251 raft_consensus.cc:359] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.403452 29286 raft_consensus.cc:2749] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.406530 29249 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.406546 29251 raft_consensus.cc:385] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.407207 29251 raft_consensus.cc:740] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.407670 29249 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.408039 29251 consensus_queue.cc:260] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.411011 29249 ts_tablet_manager.cc:1434] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:10:38.405516 29250 ts_tablet_manager.cc:1434] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:38.411911 29251 ts_tablet_manager.cc:1434] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:10:38.413101 29250 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: Bootstrap starting.
I20260709 13:10:38.414773 29249 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.424409 29249 tablet_bootstrap.cc:654] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.429610 29249 tablet_bootstrap.cc:492] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.429571 29250 tablet_bootstrap.cc:654] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.430562 29249 ts_tablet_manager.cc:1403] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:10:38.432582 29249 raft_consensus.cc:359] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.433282 29249 raft_consensus.cc:385] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.433616 29249 raft_consensus.cc:740] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.434310 29249 consensus_queue.cc:260] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.435165 29250 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: No bootstrap required, opened a new log
I20260709 13:10:38.435616 29250 ts_tablet_manager.cc:1403] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:10:38.435956 29249 ts_tablet_manager.cc:1434] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:38.436836 29249 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: Bootstrap starting.
I20260709 13:10:38.438367 29250 raft_consensus.cc:359] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.439059 29250 raft_consensus.cc:385] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.439337 29250 raft_consensus.cc:740] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.440016 29250 consensus_queue.cc:260] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.442551 29249 tablet_bootstrap.cc:654] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.444900 29250 ts_tablet_manager.cc:1434] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:38.452692 29255 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.453203 29255 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.455310 29255 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
W20260709 13:10:38.456882 29001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:38.457499 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.458410 29057 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:38.459905 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.460183 29170 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.460882 29132 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:38.461267 29255 raft_consensus.cc:2804] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.461740 29255 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.462129 29255 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.469774 29255 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.472118 29249 tablet_bootstrap.cc:492] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: No bootstrap required, opened a new log
I20260709 13:10:38.472553 29249 ts_tablet_manager.cc:1403] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.016s
I20260709 13:10:38.473693 29255 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:38.474332 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:38.474895 29132 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.475298 29249 raft_consensus.cc:359] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.475942 29249 raft_consensus.cc:385] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.476190 29249 raft_consensus.cc:740] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.476930 29249 consensus_queue.cc:260] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.478912 29249 ts_tablet_manager.cc:1434] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:38.472999 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:38.481148 29057 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.483506 29132 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.484786 29169 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:38.485811 29255 raft_consensus.cc:2804] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.486532 29255 raft_consensus.cc:697] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:38.487182 29057 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.487448 29255 consensus_queue.cc:237] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.493052 29257 raft_consensus.cc:493] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.493624 29257 raft_consensus.cc:515] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.496892 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.497560 29057 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:38.498278 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.498991 29096 leader_election.cc:304] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.496651 28954 catalog_manager.cc:5697] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.500648 29271 raft_consensus.cc:2804] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.501093 29271 raft_consensus.cc:493] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.502200 29271 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.498991 29206 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:38.504142 29257 leader_election.cc:290] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.508958 29271 raft_consensus.cc:515] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.509871 29273 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.512287 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:38.512885 29057 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.514555 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:38.515196 29206 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.522460 29206 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.523087 29057 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.523891 29097 leader_election.cc:304] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:38.524852 29257 raft_consensus.cc:2804] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.525372 29257 raft_consensus.cc:697] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:38.526439 29257 consensus_queue.cc:237] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.530185 29271 leader_election.cc:290] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.542887 28953 catalog_manager.cc:5697] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.552121 29255 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.559278 29206 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.565312 29257 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.570713 29312 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.571292 29312 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:38.578939 29257 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.581769 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.584131 29312 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:38.586254 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.588235 29169 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc; no voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:38.589587 29255 raft_consensus.cc:2749] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.626673 29205 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.635195 29286 consensus_queue.cc:1048] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.640607 29257 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.659437 29281 raft_consensus.cc:493] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.660018 29281 raft_consensus.cc:515] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.660857 29271 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.662361 29281 leader_election.cc:290] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.664742 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a7cb10a151427bbfd94311781d7757" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.665508 29057 raft_consensus.cc:2468] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:38.653872 29286 consensus_queue.cc:1048] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:10:38.666939 29096 leader_election.cc:304] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.668025 29281 raft_consensus.cc:2804] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.670863 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a7cb10a151427bbfd94311781d7757" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.671587 29281 raft_consensus.cc:493] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.672055 29281 raft_consensus.cc:3060] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.672060 29205 raft_consensus.cc:2468] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 0.
I20260709 13:10:38.681825 29281 raft_consensus.cc:515] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.684402 29281 leader_election.cc:290] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.684870 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a7cb10a151427bbfd94311781d7757" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:38.685063 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a7cb10a151427bbfd94311781d7757" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:38.685593 29057 raft_consensus.cc:3060] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.686328 29205 raft_consensus.cc:3060] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.693421 29286 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.694020 29286 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.694444 29057 raft_consensus.cc:2468] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.696432 29286 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:38.696262 29096 leader_election.cc:304] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.697595 29281 raft_consensus.cc:2804] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.698132 29281 raft_consensus.cc:697] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:38.698343 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.698837 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d02fabca594547ac60cf8461ad98dc" is_pre_election: true
I20260709 13:10:38.699083 29281 consensus_queue.cc:237] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.699697 29206 raft_consensus.cc:2393] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f44afc36ea0f4101a020906f71cda57e in current term 1: Already voted for candidate 9fe2e7d28def45869be43f6949f29ee6 in this term.
I20260709 13:10:38.701153 29022 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f44afc36ea0f4101a020906f71cda57e; no voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:38.702271 29286 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.704468 29205 raft_consensus.cc:2468] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 1.
I20260709 13:10:38.711731 29286 raft_consensus.cc:2749] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.722432 28953 catalog_manager.cc:5697] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.735397 29312 raft_consensus.cc:493] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.735997 29312 raft_consensus.cc:515] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.738360 29312 leader_election.cc:290] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:38.739266 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e" is_pre_election: true
I20260709 13:10:38.740062 29056 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:38.740243 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6" is_pre_election: true
I20260709 13:10:38.740156 29281 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.741072 29131 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 0.
I20260709 13:10:38.741523 29170 leader_election.cc:304] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:38.742486 29312 raft_consensus.cc:2804] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.742890 29312 raft_consensus.cc:493] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.743297 29312 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.753218 29312 raft_consensus.cc:515] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.756930 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:38.757671 29056 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.759605 29257 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.760664 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:38.762295 29131 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.771147 29131 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.773545 29312 leader_election.cc:290] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:38.777767 29169 leader_election.cc:304] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:38.773043 29056 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 1.
I20260709 13:10:38.785240 29312 raft_consensus.cc:2804] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.785995 29312 raft_consensus.cc:697] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:38.787061 29312 consensus_queue.cc:237] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:38.804200 28954 catalog_manager.cc:5697] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 0 to 1, leader changed from <none> to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.880795 29312 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.893430 29312 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.930145 29257 consensus_queue.cc:1048] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.941982 29271 consensus_queue.cc:1048] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.122388 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58046
I20260709 13:10:39.123018 29131 raft_consensus.cc:606] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:39.129298 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58046
I20260709 13:10:39.129905 29131 raft_consensus.cc:606] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:39.138943 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58046
I20260709 13:10:39.139492 29131 raft_consensus.cc:606] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:39.155320 29205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:40196
I20260709 13:10:39.155903 29205 raft_consensus.cc:606] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:39.171502 29056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:33994
I20260709 13:10:39.172068 29056 raft_consensus.cc:606] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:39.180873 29205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:40196
I20260709 13:10:39.181555 29205 raft_consensus.cc:606] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:39.187456 29205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:40196
I20260709 13:10:39.187999 29205 raft_consensus.cc:606] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:39.193949 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "900f808371a040c8827725710de1fb0a"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:58046
I20260709 13:10:39.194545 29131 raft_consensus.cc:606] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Received request to transfer leadership to TS d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:39.198274 29281 consensus_queue.cc:1048] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.209941 29257 consensus_queue.cc:1048] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.233217 29271 raft_consensus.cc:993] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.233752 29271 raft_consensus.cc:1081] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.235728 29056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:39.236312 29056 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.236702 29056 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.242918 29056 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.244675 29056 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.245878 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.245906 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:39.246480 29205 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.246769 29131 raft_consensus.cc:3055] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.247174 29131 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.248212 29131 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.249902 29131 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.251514 29205 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.252745 29022 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.253561 29286 raft_consensus.cc:2804] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.254002 29286 raft_consensus.cc:697] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:39.254719 29286 consensus_queue.cc:237] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.261591 29131 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.262635 28953 catalog_manager.cc:5697] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 1 to 2, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.285544 29255 raft_consensus.cc:993] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.286052 29255 raft_consensus.cc:1081] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.287788 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:10:39.288395 29131 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.289162 29131 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.294862 29131 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.296041 29257 raft_consensus.cc:993] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.296535 29257 raft_consensus.cc:1081] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.297550 29131 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.298453 29057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:39.298659 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.299052 29057 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.299114 29205 raft_consensus.cc:3055] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.299674 29057 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.299738 29205 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:39.300521 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:39.301172 29056 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.300724 29205 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.302208 29205 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.307091 29057 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.308333 29056 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.309072 29205 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.310722 29097 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:39.311121 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:39.311874 29131 raft_consensus.cc:3055] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.311923 29281 raft_consensus.cc:2804] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.312412 29131 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.312567 29281 raft_consensus.cc:697] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.314477 29281 consensus_queue.cc:237] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.317363 29255 raft_consensus.cc:993] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.317864 29255 raft_consensus.cc:1081] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.315606 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.318897 29205 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.319479 29056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33980
I20260709 13:10:39.315560 29131 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.320072 29056 raft_consensus.cc:493] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.320482 29056 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.320432 29131 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.326483 28953 catalog_manager.cc:5697] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 1 to 2, leader changed from d6d02fabca594547ac60cf8461ad98dc (127.28.62.131) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.327330 29056 raft_consensus.cc:515] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.326457 29205 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.329496 29022 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.316169 29057 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.330516 29286 raft_consensus.cc:2804] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.333763 29286 raft_consensus.cc:697] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:39.334641 29286 consensus_queue.cc:237] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.336541 29131 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.338795 29255 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.340137 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:39.340672 29131 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.343600 28951 catalog_manager.cc:5697] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 1 to 2, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.345956 29056 leader_election.cc:290] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.348865 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.349879 29131 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.351046 29020 leader_election.cc:304] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.352151 29286 raft_consensus.cc:2804] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.352638 29286 raft_consensus.cc:697] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:39.350575 29205 raft_consensus.cc:3055] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.353726 29205 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:39.353657 29286 consensus_queue.cc:237] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.354820 29205 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.356243 29205 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.366281 29273 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.368844 29205 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.369841 28953 catalog_manager.cc:5697] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 1 to 2, leader changed from d6d02fabca594547ac60cf8461ad98dc (127.28.62.131) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.376629 29273 raft_consensus.cc:993] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.377122 29273 raft_consensus.cc:1081] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.378901 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:10:39.379508 29131 raft_consensus.cc:493] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.379930 29131 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.386053 29131 raft_consensus.cc:515] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.388871 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.388568 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:39.389521 29205 raft_consensus.cc:3055] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.389619 29057 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.389935 29205 raft_consensus.cc:740] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:39.390807 29205 consensus_queue.cc:260] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.392028 29205 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.394724 29131 leader_election.cc:290] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.397007 29057 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.398277 29096 leader_election.cc:304] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.398952 29205 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.399134 29281 raft_consensus.cc:2804] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.399741 29281 raft_consensus.cc:697] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.400588 29281 consensus_queue.cc:237] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.408303 28951 catalog_manager.cc:5697] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 1 to 2, leader changed from d6d02fabca594547ac60cf8461ad98dc (127.28.62.131) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.482219 29271 raft_consensus.cc:993] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:39.482764 29281 raft_consensus.cc:1081] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Signalling peer d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:39.484371 29205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "900f808371a040c8827725710de1fb0a"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:10:39.484941 29205 raft_consensus.cc:493] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.485324 29205 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.490949 29205 raft_consensus.cc:515] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.494524 29205 leader_election.cc:290] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 2 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:39.495124 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:39.495507 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900f808371a040c8827725710de1fb0a" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:39.495946 29057 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.496309 29131 raft_consensus.cc:3055] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.496685 29131 raft_consensus.cc:740] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.497534 29131 consensus_queue.cc:260] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.498764 29131 raft_consensus.cc:3060] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.501430 29057 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 2.
I20260709 13:10:39.502653 29170 leader_election.cc:304] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.503528 29312 raft_consensus.cc:2804] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.504007 29312 raft_consensus.cc:697] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 2 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:39.504873 29312 consensus_queue.cc:237] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.505404 29131 raft_consensus.cc:2468] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 2.
I20260709 13:10:39.512646 28951 catalog_manager.cc:5697] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 1 to 2, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.545707 29271 raft_consensus.cc:993] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.546267 29281 raft_consensus.cc:1081] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:39.547904 29057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:39.548399 29057 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.548688 29057 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.553707 29057 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:39.556052 29057 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Requested vote from peers d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:39.556708 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:39.556646 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.557572 29131 raft_consensus.cc:3055] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.557698 29205 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.557969 29131 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.558879 29131 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:39.560115 29131 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.563308 29205 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.564507 29022 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:39.565280 29256 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.565843 29256 raft_consensus.cc:697] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:39.566649 29256 consensus_queue.cc:237] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:39.566979 29131 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 2.
I20260709 13:10:39.574625 28951 catalog_manager.cc:5697] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 1 to 2, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.618620 29286 raft_consensus.cc:993] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.619182 29256 raft_consensus.cc:1081] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:39.620724 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:10:39.621330 29131 raft_consensus.cc:493] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.621721 29131 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.628113 29131 raft_consensus.cc:515] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.630141 29131 leader_election.cc:290] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:39.631088 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:39.631294 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e6cd69f75d427382eec0db0b6e080a" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:39.631665 29057 raft_consensus.cc:3055] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.632113 29205 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.632077 29057 raft_consensus.cc:740] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:39.633074 29057 consensus_queue.cc:260] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.634380 29057 raft_consensus.cc:3060] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.639369 29205 raft_consensus.cc:2468] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.640810 29097 leader_election.cc:304] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:39.641777 29281 raft_consensus.cc:2804] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.642210 29057 raft_consensus.cc:2468] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 2.
I20260709 13:10:39.642352 29281 raft_consensus.cc:697] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:39.642519 29205 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.643313 29281 consensus_queue.cc:237] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:39.644275 29256 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.654143 29131 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.658052 29256 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.660246 28953 catalog_manager.cc:5697] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 1 to 2, leader changed from f44afc36ea0f4101a020906f71cda57e (127.28.62.129) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.719285 29131 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.720850 29256 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.730317 29205 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.732148 29337 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.765656 29205 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.767037 29337 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.776397 29131 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.778236 29256 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.806468 29057 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.807857 29257 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.816583 29205 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.818495 29271 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.873518 29205 raft_consensus.cc:1275] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.874795 29271 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.882155 29057 raft_consensus.cc:1275] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.884009 29257 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.036324 29205 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.037657 29256 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.041946 29057 raft_consensus.cc:1275] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.043506 29312 consensus_queue.cc:1048] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.046854 29131 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.048503 29286 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.065339 29131 raft_consensus.cc:1275] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.068950 29345 consensus_queue.cc:1048] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:40.096637 29057 raft_consensus.cc:1275] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.098335 29257 consensus_queue.cc:1048] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.108388 29205 raft_consensus.cc:1275] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.110512 29281 consensus_queue.cc:1048] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:42.225579 28922 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:10:42.226485 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.246804 29057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
mode: GRACEFUL
new_leader_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:34004
I20260709 13:10:42.247504 29057 raft_consensus.cc:606] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Received request to transfer leadership to TS d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:42.259255 29256 raft_consensus.cc:993] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: : Instructing follower d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:42.259835 29350 raft_consensus.cc:1081] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Signalling peer d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:42.262707 29206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:40194
I20260709 13:10:42.262703 29132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:42.263550 29206 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.263553 29132 raft_consensus.cc:606] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Received request to transfer leadership to TS d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:42.264183 29206 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.265537 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:42.266292 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:42.271742 29206 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:42.274775 29206 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:42.275254 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:42.275920 29057 raft_consensus.cc:3055] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.276278 29057 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:42.277225 29351 raft_consensus.cc:993] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:42.277118 29057 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:42.277849 29281 raft_consensus.cc:1081] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Signalling peer d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:42.278426 29057 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.280025 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:42.280740 29132 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.287544 29057 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:42.289014 29170 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:42.290182 29349 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:42.291640 29349 raft_consensus.cc:697] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:42.279944 29206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:10:42.292416 29206 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.292798 29206 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.292665 29349 consensus_queue.cc:237] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:42.291560 29132 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:42.303107 29206 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:42.306540 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:42.307001 29132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:42.307102 29057 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.307611 29132 raft_consensus.cc:3055] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.307935 29132 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:42.308733 29132 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:42.309813 29132 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.306298 29206 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:42.312734 28951 catalog_manager.cc:5697] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 2 to 3, leader changed from f44afc36ea0f4101a020906f71cda57e (127.28.62.129) to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.316887 29132 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:42.318011 29169 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:42.318598 29057 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:42.318857 29349 raft_consensus.cc:2804] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:42.319545 29349 raft_consensus.cc:697] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:42.320570 29349 consensus_queue.cc:237] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:42.330736 28951 catalog_manager.cc:5697] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 2 to 3, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.711759 29132 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.713099 29349 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.723384 29057 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.725138 29364 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:42.813305 29057 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.814673 29364 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.823590 29132 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.825476 29349 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.267413 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:43.278389 29206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:40196
I20260709 13:10:43.278884 29206 raft_consensus.cc:606] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:43.284520 29057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:33994
I20260709 13:10:43.284979 29057 raft_consensus.cc:606] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:43.290002 29057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:33994
I20260709 13:10:43.291114 29057 raft_consensus.cc:606] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:43.293462 29349 raft_consensus.cc:993] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.293905 29349 raft_consensus.cc:1081] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.295571 29132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:10:43.296123 29132 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.296480 29132 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.297319 29056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:33994
I20260709 13:10:43.297943 29056 raft_consensus.cc:606] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:43.303267 29132 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:43.306102 29132 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 4 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:43.306376 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:43.306272 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:43.306993 29057 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.307319 29206 raft_consensus.cc:3055] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:43.307633 29206 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:43.308534 29206 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:43.309952 29206 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.311710 29371 raft_consensus.cc:993] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.312171 29256 raft_consensus.cc:1081] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.312418 29205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
mode: GRACEFUL
new_leader_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:40196
I20260709 13:10:43.312999 29205 raft_consensus.cc:606] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Received request to transfer leadership to TS 9fe2e7d28def45869be43f6949f29ee6
I20260709 13:10:43.313874 29132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:10:43.314438 29132 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.314437 29057 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 4.
I20260709 13:10:43.314949 29132 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.315655 29096 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:43.316493 29351 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:43.316960 29351 raft_consensus.cc:697] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:43.317993 29206 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 4.
I20260709 13:10:43.317759 29351 consensus_queue.cc:237] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:43.322947 29132 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.325259 29132 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:43.325345 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:43.326016 29057 raft_consensus.cc:3055] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:43.326318 29057 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:43.326269 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:43.325829 28953 catalog_manager.cc:5697] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 3 to 4, leader changed from d6d02fabca594547ac60cf8461ad98dc (127.28.62.131) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.326844 29205 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.327099 29057 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.328171 29057 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.332942 29205 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.334311 29097 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:43.334544 29057 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.335124 29370 raft_consensus.cc:2804] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.335656 29370 raft_consensus.cc:697] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:43.336436 29370 consensus_queue.cc:237] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.343899 28953 catalog_manager.cc:5697] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 2 to 3, leader changed from f44afc36ea0f4101a020906f71cda57e (127.28.62.129) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.555763 29256 raft_consensus.cc:993] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.556249 29256 raft_consensus.cc:1081] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.557989 29132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:10:43.558447 29132 raft_consensus.cc:493] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.558699 29132 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.563237 29132 raft_consensus.cc:515] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.564831 29132 leader_election.cc:290] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:43.565924 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:43.566111 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:43.566401 29057 raft_consensus.cc:3055] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:43.566660 29205 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.566732 29057 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:43.567601 29057 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.568460 29057 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.571571 29205 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.572763 29057 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.572952 29097 leader_election.cc:304] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:43.573854 29370 raft_consensus.cc:2804] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.574290 29370 raft_consensus.cc:697] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:43.574985 29370 consensus_queue.cc:237] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.582006 28953 catalog_manager.cc:5697] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 2 to 3, leader changed from f44afc36ea0f4101a020906f71cda57e (127.28.62.129) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.776503 29355 raft_consensus.cc:993] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.777033 29364 raft_consensus.cc:1081] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.778266 29371 raft_consensus.cc:993] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: : Instructing follower 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.778740 29256 raft_consensus.cc:1081] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Signalling peer 9fe2e7d28def45869be43f6949f29ee6 to start an election
I20260709 13:10:43.778790 29132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:10:43.779516 29132 raft_consensus.cc:493] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.779915 29132 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.780504 29131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:10:43.781075 29131 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.781438 29131 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.786907 29132 raft_consensus.cc:515] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.787601 29131 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.789112 29132 leader_election.cc:290] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 4 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:43.789333 29131 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:43.790560 29057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:43.790797 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2013095314f12b67b76dda0c0ae6c" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:43.791105 29057 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.793118 29205 raft_consensus.cc:3055] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:43.791564 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:43.793593 29205 raft_consensus.cc:740] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:43.793887 29206 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.794425 29205 consensus_queue.cc:260] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.791030 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "9fe2e7d28def45869be43f6949f29ee6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:43.796423 29205 raft_consensus.cc:3060] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.796756 29056 raft_consensus.cc:3055] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:43.797255 29056 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:43.798138 29056 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.799319 29057 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 4.
I20260709 13:10:43.799551 29056 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.800989 29096 leader_election.cc:304] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:43.802008 29370 raft_consensus.cc:2804] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:43.802570 29370 raft_consensus.cc:697] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:43.803623 29205 raft_consensus.cc:2468] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 4.
I20260709 13:10:43.803499 29370 consensus_queue.cc:237] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.805939 29206 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.807183 29097 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe2e7d28def45869be43f6949f29ee6, d6d02fabca594547ac60cf8461ad98dc; no voters: 
I20260709 13:10:43.808173 29351 raft_consensus.cc:2804] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.808193 29056 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe2e7d28def45869be43f6949f29ee6 in term 3.
I20260709 13:10:43.808888 29351 raft_consensus.cc:697] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Leader. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:43.809924 29351 consensus_queue.cc:237] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:43.814096 28953 catalog_manager.cc:5697] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 3 to 4, leader changed from d6d02fabca594547ac60cf8461ad98dc (127.28.62.131) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.826861 28953 catalog_manager.cc:5697] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 reported cstate change: term changed from 2 to 3, leader changed from f44afc36ea0f4101a020906f71cda57e (127.28.62.129) to 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "9fe2e7d28def45869be43f6949f29ee6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.834553 29206 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:43.835922 29351 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:43.848209 29056 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:43.850183 29381 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:43.885866 29206 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:43.887197 29381 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.898330 29056 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:43.899734 29381 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.048221 29056 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.049623 29381 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.059043 29206 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.060739 29351 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.298579 29206 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.300158 29351 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.309087 29056 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.310940 29381 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.353044 29206 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:44.354419 29381 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.361019 29056 raft_consensus.cc:1275] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Refusing update from remote peer 9fe2e7d28def45869be43f6949f29ee6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:44.363593 29351 consensus_queue.cc:1048] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.322386 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:46.331525 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:46.332175 29131 raft_consensus.cc:606] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Received request to transfer leadership to TS d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:46.335397 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:46.335906 29131 raft_consensus.cc:606] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:46.338308 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:46.338881 29131 raft_consensus.cc:606] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:46.341194 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:46.341648 29131 raft_consensus.cc:606] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Received request to transfer leadership to TS d6d02fabca594547ac60cf8461ad98dc
I20260709 13:10:46.344123 29131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
mode: GRACEFUL
new_leader_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:58058
I20260709 13:10:46.344664 29131 raft_consensus.cc:606] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Received request to transfer leadership to TS f44afc36ea0f4101a020906f71cda57e
I20260709 13:10:46.345939 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:46.346403 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:46.420614 29396 raft_consensus.cc:993] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.421142 29370 raft_consensus.cc:1081] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.422765 29056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3875a9dd2688402488c598e98305a036"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:46.423316 29056 raft_consensus.cc:493] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.423652 29056 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.428370 29056 raft_consensus.cc:515] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.429982 29056 leader_election.cc:290] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 4 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:46.431098 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:46.431502 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3875a9dd2688402488c598e98305a036" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:46.431807 29131 raft_consensus.cc:3055] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:46.432044 29206 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.432124 29131 raft_consensus.cc:740] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:46.433107 29131 consensus_queue.cc:260] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.434396 29131 raft_consensus.cc:3060] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.437527 29206 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 4.
I20260709 13:10:46.438948 29022 leader_election.cc:304] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:46.439321 29131 raft_consensus.cc:2468] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 4.
I20260709 13:10:46.440800 29397 raft_consensus.cc:2804] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:46.441759 29397 raft_consensus.cc:697] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 4 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:46.442587 29397 consensus_queue.cc:237] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.449363 28953 catalog_manager.cc:5697] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 3 to 4, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 4 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.526340 29370 raft_consensus.cc:993] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.526897 29396 raft_consensus.cc:1081] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.528650 29056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:46.529194 29056 raft_consensus.cc:493] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.529536 29056 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.533833 29056 raft_consensus.cc:515] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:46.535446 29056 leader_election.cc:290] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 5 election: Requested vote from peers d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:46.536441 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:46.536535 29206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252aeb6d471c4edea87d9796e0171199" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:46.536916 29131 raft_consensus.cc:3055] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:46.537151 29206 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.537266 29131 raft_consensus.cc:740] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:46.538257 29131 consensus_queue.cc:260] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:46.539130 29131 raft_consensus.cc:3060] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.542577 29206 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 5.
I20260709 13:10:46.543699 29022 leader_election.cc:304] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:46.544337 29131 raft_consensus.cc:2468] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 5.
I20260709 13:10:46.544854 29397 raft_consensus.cc:2804] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.545447 29397 raft_consensus.cc:697] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 5 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:46.547271 29397 consensus_queue.cc:237] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } }
I20260709 13:10:46.548627 29370 raft_consensus.cc:993] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:46.549090 29396 raft_consensus.cc:1081] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Signalling peer d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:46.550892 29205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:10:46.551358 29205 raft_consensus.cc:493] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.551712 29205 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.557101 28953 catalog_manager.cc:5697] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 4 to 5, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 5 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.558418 29205 raft_consensus.cc:515] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.560896 29205 leader_election.cc:290] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:46.561349 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:46.561530 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08452a49ed2947b28090a24dbf62b8a3" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:46.561975 29056 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.562105 29131 raft_consensus.cc:3055] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:46.562484 29131 raft_consensus.cc:740] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:46.563213 29131 consensus_queue.cc:260] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.564407 29131 raft_consensus.cc:3060] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.568061 29056 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:46.569278 29170 leader_election.cc:304] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:46.570173 29395 raft_consensus.cc:2804] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:46.570087 29131 raft_consensus.cc:2468] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 3.
I20260709 13:10:46.571700 29395 raft_consensus.cc:697] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:46.572561 29395 consensus_queue.cc:237] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.580062 28953 catalog_manager.cc:5697] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 2 to 3, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.725930 29370 raft_consensus.cc:993] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:46.726388 29396 raft_consensus.cc:1081] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Signalling peer d6d02fabca594547ac60cf8461ad98dc to start an election
I20260709 13:10:46.727869 29205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7"
dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:10:46.728358 29205 raft_consensus.cc:493] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.728638 29205 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.733202 29205 raft_consensus.cc:515] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.734848 29205 leader_election.cc:290] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 4 election: Requested vote from peers f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131), 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381)
I20260709 13:10:46.735906 29056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
I20260709 13:10:46.736002 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9624681ab67d4ba2b3e65bc6246176e7" candidate_uuid: "d6d02fabca594547ac60cf8461ad98dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:46.736641 29056 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.736702 29131 raft_consensus.cc:3055] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:46.737118 29131 raft_consensus.cc:740] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:46.737869 29131 consensus_queue.cc:260] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.738801 29131 raft_consensus.cc:3060] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.741389 29056 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 4.
I20260709 13:10:46.742575 29170 leader_election.cc:304] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:46.743383 29395 raft_consensus.cc:2804] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:46.743388 29131 raft_consensus.cc:2468] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6d02fabca594547ac60cf8461ad98dc in term 4.
I20260709 13:10:46.744083 29395 raft_consensus.cc:697] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 4 LEADER]: Becoming Leader. State: Replica: d6d02fabca594547ac60cf8461ad98dc, State: Running, Role: LEADER
I20260709 13:10:46.745106 29395 consensus_queue.cc:237] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.748063 29370 raft_consensus.cc:993] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: : Instructing follower f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.748749 29407 raft_consensus.cc:1081] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Signalling peer f44afc36ea0f4101a020906f71cda57e to start an election
I20260709 13:10:46.750980 29056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352"
dest_uuid: "f44afc36ea0f4101a020906f71cda57e"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:46.751475 29056 raft_consensus.cc:493] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.751772 29056 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.754231 28953 catalog_manager.cc:5697] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc reported cstate change: term changed from 3 to 4, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to d6d02fabca594547ac60cf8461ad98dc (127.28.62.131). New cstate: current_term: 4 leader_uuid: "d6d02fabca594547ac60cf8461ad98dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.758014 29056 raft_consensus.cc:515] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.759644 29056 leader_election.cc:290] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 4 election: Requested vote from peers 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381), d6d02fabca594547ac60cf8461ad98dc (127.28.62.131:38791)
I20260709 13:10:46.760468 29131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9fe2e7d28def45869be43f6949f29ee6"
I20260709 13:10:46.761063 29131 raft_consensus.cc:3055] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:46.761335 29131 raft_consensus.cc:740] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fe2e7d28def45869be43f6949f29ee6, State: Running, Role: LEADER
I20260709 13:10:46.761271 29205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8ec4da225b4a6a86c1b13d91525352" candidate_uuid: "f44afc36ea0f4101a020906f71cda57e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6d02fabca594547ac60cf8461ad98dc"
I20260709 13:10:46.761968 29205 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.762354 29131 consensus_queue.cc:260] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.763355 29131 raft_consensus.cc:3060] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.766956 29205 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 4.
I20260709 13:10:46.767894 29022 leader_election.cc:304] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6d02fabca594547ac60cf8461ad98dc, f44afc36ea0f4101a020906f71cda57e; no voters: 
I20260709 13:10:46.768467 29131 raft_consensus.cc:2468] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44afc36ea0f4101a020906f71cda57e in term 4.
I20260709 13:10:46.768579 29397 raft_consensus.cc:2804] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:46.769053 29397 raft_consensus.cc:697] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 4 LEADER]: Becoming Leader. State: Replica: f44afc36ea0f4101a020906f71cda57e, State: Running, Role: LEADER
I20260709 13:10:46.769843 29397 consensus_queue.cc:237] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } }
I20260709 13:10:46.776877 28953 catalog_manager.cc:5697] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e reported cstate change: term changed from 3 to 4, leader changed from 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130) to f44afc36ea0f4101a020906f71cda57e (127.28.62.129). New cstate: current_term: 4 leader_uuid: "f44afc36ea0f4101a020906f71cda57e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.869076 29131 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:46.870659 29397 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.881524 29205 raft_consensus.cc:1275] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:46.883126 29412 consensus_queue.cc:1048] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.953058 29131 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 5 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:46.954532 29412 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:46.964780 29205 raft_consensus.cc:1275] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 5 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:46.966357 29398 consensus_queue.cc:1048] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:47.064618 29131 raft_consensus.cc:1275] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:47.066097 29395 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.076987 29056 raft_consensus.cc:1275] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:47.078423 29395 consensus_queue.cc:1048] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.195464 29205 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:47.196663 29398 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d02fabca594547ac60cf8461ad98dc" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 38791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.205536 29131 raft_consensus.cc:1275] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Refusing update from remote peer f44afc36ea0f4101a020906f71cda57e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:47.206947 29412 consensus_queue.cc:1048] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.289572 29131 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:47.290699 29395 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe2e7d28def45869be43f6949f29ee6" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.301959 29056 raft_consensus.cc:1275] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Refusing update from remote peer d6d02fabca594547ac60cf8461ad98dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:47.303305 29405 consensus_queue.cc:1048] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44afc36ea0f4101a020906f71cda57e" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.347256 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:47.352757 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:10:47.378201 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:47.379217 28922 tablet_replica.cc:333] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.379985 28922 raft_consensus.cc:2243] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.380546 28922 raft_consensus.cc:2272] T 900f808371a040c8827725710de1fb0a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.383296 28922 tablet_replica.cc:333] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.383982 28922 raft_consensus.cc:2243] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.384814 28922 raft_consensus.cc:2272] T cc8ec4da225b4a6a86c1b13d91525352 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.387419 28922 tablet_replica.cc:333] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.387929 28922 raft_consensus.cc:2243] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.388679 28922 raft_consensus.cc:2272] T 3875a9dd2688402488c598e98305a036 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.390978 28922 tablet_replica.cc:333] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.391566 28922 raft_consensus.cc:2243] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.391996 28922 raft_consensus.cc:2272] T e3a7cb10a151427bbfd94311781d7757 P f44afc36ea0f4101a020906f71cda57e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.394042 28922 tablet_replica.cc:333] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.394609 28922 raft_consensus.cc:2243] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.395067 28922 raft_consensus.cc:2272] T c9f2013095314f12b67b76dda0c0ae6c P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.396852 28922 tablet_replica.cc:333] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.397378 28922 raft_consensus.cc:2243] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.398212 28922 raft_consensus.cc:2272] T 252aeb6d471c4edea87d9796e0171199 P f44afc36ea0f4101a020906f71cda57e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.400490 28922 tablet_replica.cc:333] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.401007 28922 raft_consensus.cc:2243] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.401566 28922 raft_consensus.cc:2272] T 08452a49ed2947b28090a24dbf62b8a3 P f44afc36ea0f4101a020906f71cda57e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.404021 28922 tablet_replica.cc:333] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.404567 28922 raft_consensus.cc:2243] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.405040 28922 raft_consensus.cc:2272] T 9624681ab67d4ba2b3e65bc6246176e7 P f44afc36ea0f4101a020906f71cda57e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.407343 28922 tablet_replica.cc:333] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e: stopping tablet replica
I20260709 13:10:47.407860 28922 raft_consensus.cc:2243] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.408332 28922 raft_consensus.cc:2272] T 13e6cd69f75d427382eec0db0b6e080a P f44afc36ea0f4101a020906f71cda57e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.553484 29170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:43131: connect: Connection refused (error 111)
I20260709 13:10:47.557337 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:10:47.558954 29170 consensus_peers.cc:597] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc -> Peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Couldn't send request to peer f44afc36ea0f4101a020906f71cda57e. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:43131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.559578 29170 consensus_peers.cc:597] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc -> Peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Couldn't send request to peer f44afc36ea0f4101a020906f71cda57e. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:43131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.559799 29096 consensus_peers.cc:597] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 -> Peer f44afc36ea0f4101a020906f71cda57e (127.28.62.129:43131): Couldn't send request to peer f44afc36ea0f4101a020906f71cda57e. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:43131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.580430 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:10:47.605199 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:47.606099 28922 tablet_replica.cc:333] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.606832 28922 raft_consensus.cc:2243] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.607381 28922 raft_consensus.cc:2272] T 900f808371a040c8827725710de1fb0a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.609814 28922 tablet_replica.cc:333] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
W20260709 13:10:47.610090 29169 consensus_peers.cc:597] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc -> Peer 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381): Couldn't send request to peer 9fe2e7d28def45869be43f6949f29ee6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.610581 28922 raft_consensus.cc:2243] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.611397 28922 raft_consensus.cc:2272] T e3a7cb10a151427bbfd94311781d7757 P 9fe2e7d28def45869be43f6949f29ee6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.612974 28922 tablet_replica.cc:333] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.613466 28922 raft_consensus.cc:2243] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.614125 28922 raft_consensus.cc:2272] T c9f2013095314f12b67b76dda0c0ae6c P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.615625 28922 tablet_replica.cc:333] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.616055 28922 raft_consensus.cc:2243] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.616683 28922 raft_consensus.cc:2272] T 13e6cd69f75d427382eec0db0b6e080a P 9fe2e7d28def45869be43f6949f29ee6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.618311 28922 tablet_replica.cc:333] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.618722 28922 raft_consensus.cc:2243] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.619040 28922 raft_consensus.cc:2272] T cc8ec4da225b4a6a86c1b13d91525352 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.621608 28922 tablet_replica.cc:333] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.622037 28922 raft_consensus.cc:2243] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.622385 28922 raft_consensus.cc:2272] T 252aeb6d471c4edea87d9796e0171199 P 9fe2e7d28def45869be43f6949f29ee6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.624909 28922 tablet_replica.cc:333] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.625345 28922 raft_consensus.cc:2243] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.625761 28922 raft_consensus.cc:2272] T 08452a49ed2947b28090a24dbf62b8a3 P 9fe2e7d28def45869be43f6949f29ee6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.627779 28922 tablet_replica.cc:333] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.628175 28922 raft_consensus.cc:2243] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.628500 28922 raft_consensus.cc:2272] T 9624681ab67d4ba2b3e65bc6246176e7 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.630671 28922 tablet_replica.cc:333] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6: stopping tablet replica
I20260709 13:10:47.631083 28922 raft_consensus.cc:2243] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.631445 28922 raft_consensus.cc:2272] T 3875a9dd2688402488c598e98305a036 P 9fe2e7d28def45869be43f6949f29ee6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.659052 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
I20260709 13:10:47.675348 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
W20260709 13:10:47.697157 29169 consensus_peers.cc:597] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc -> Peer 9fe2e7d28def45869be43f6949f29ee6 (127.28.62.130:45381): Couldn't send request to peer 9fe2e7d28def45869be43f6949f29ee6. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.701792 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:47.702612 28922 tablet_replica.cc:333] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.703225 28922 raft_consensus.cc:2243] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.704241 28922 raft_consensus.cc:2272] T 900f808371a040c8827725710de1fb0a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.706172 28922 tablet_replica.cc:333] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.706672 28922 raft_consensus.cc:2243] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.707093 28922 raft_consensus.cc:2272] T c9f2013095314f12b67b76dda0c0ae6c P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.708633 28922 tablet_replica.cc:333] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.709128 28922 raft_consensus.cc:2243] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.709553 28922 raft_consensus.cc:2272] T 13e6cd69f75d427382eec0db0b6e080a P d6d02fabca594547ac60cf8461ad98dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.711481 28922 tablet_replica.cc:333] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.711998 28922 raft_consensus.cc:2243] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.712404 28922 raft_consensus.cc:2272] T 252aeb6d471c4edea87d9796e0171199 P d6d02fabca594547ac60cf8461ad98dc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.714623 28922 tablet_replica.cc:333] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.715114 28922 raft_consensus.cc:2243] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.715497 28922 raft_consensus.cc:2272] T e3a7cb10a151427bbfd94311781d7757 P d6d02fabca594547ac60cf8461ad98dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.717042 28922 tablet_replica.cc:333] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.717571 28922 raft_consensus.cc:2243] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.717993 28922 raft_consensus.cc:2272] T cc8ec4da225b4a6a86c1b13d91525352 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.719988 28922 tablet_replica.cc:333] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.720458 28922 raft_consensus.cc:2243] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.720871 28922 raft_consensus.cc:2272] T 3875a9dd2688402488c598e98305a036 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.722734 28922 tablet_replica.cc:333] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.723197 28922 raft_consensus.cc:2243] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.723884 28922 raft_consensus.cc:2272] T 08452a49ed2947b28090a24dbf62b8a3 P d6d02fabca594547ac60cf8461ad98dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.725690 28922 tablet_replica.cc:333] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc: stopping tablet replica
I20260709 13:10:47.726128 28922 raft_consensus.cc:2243] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.726819 28922 raft_consensus.cc:2272] T 9624681ab67d4ba2b3e65bc6246176e7 P d6d02fabca594547ac60cf8461ad98dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.753207 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:10:47.770617 28922 master.cc:562] Master@127.28.62.190:44729 shutting down...
I20260709 13:10:47.960191 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.960947 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.961347 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P fbc2a1e452cb4f5cb96aacb829d36fed: stopping tablet replica
I20260709 13:10:47.980134 28922 master.cc:584] Master@127.28.62.190:44729 shutdown complete.
9fe2e7d28def45869be43f6949f29ee6  4
d6d02fabca594547ac60cf8461ad98dc  1
f44afc36ea0f4101a020906f71cda57e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13138 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:10:48.022531 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:38729
I20260709 13:10:48.023641 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:48.029731 29431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.029843 29432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.030575 29434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.031293 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:48.032279 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:48.032464 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:48.032661 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602648032626 us; error 0 us; skew 500 ppm
I20260709 13:10:48.033268 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:48.035983 28922 webserver.cc:533] Webserver started at http://127.28.62.190:44515/ using document root <none> and password file <none>
I20260709 13:10:48.036541 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:48.036754 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:48.037070 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:48.038373 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "12d435549f474ebea16d852db7bfd41b"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.043260 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:48.047071 29439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.047955 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:48.048403 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "12d435549f474ebea16d852db7bfd41b"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.048723 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:48.059302 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:48.060592 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:48.103055 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:38729
I20260709 13:10:48.103143 29490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:38729 every 8 connection(s)
I20260709 13:10:48.107189 29491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.117686 29491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b: Bootstrap starting.
I20260709 13:10:48.122814 29491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:48.127779 29491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b: No bootstrap required, opened a new log
I20260709 13:10:48.130184 29491 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER }
I20260709 13:10:48.130606 29491 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:48.130894 29491 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12d435549f474ebea16d852db7bfd41b, State: Initialized, Role: FOLLOWER
I20260709 13:10:48.131654 29491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER }
I20260709 13:10:48.132138 29491 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:48.132407 29491 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:48.132714 29491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:48.137773 29491 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER }
I20260709 13:10:48.138381 29491 leader_election.cc:304] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12d435549f474ebea16d852db7bfd41b; no voters: 
I20260709 13:10:48.139640 29491 leader_election.cc:290] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:48.140021 29494 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:48.141470 29494 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 1 LEADER]: Becoming Leader. State: Replica: 12d435549f474ebea16d852db7bfd41b, State: Running, Role: LEADER
I20260709 13:10:48.142220 29494 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER }
I20260709 13:10:48.142933 29491 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:48.147589 29496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12d435549f474ebea16d852db7bfd41b. Latest consensus state: current_term: 1 leader_uuid: "12d435549f474ebea16d852db7bfd41b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER } }
I20260709 13:10:48.148459 29496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:48.148603 29495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12d435549f474ebea16d852db7bfd41b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12d435549f474ebea16d852db7bfd41b" member_type: VOTER } }
I20260709 13:10:48.149677 29495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:48.150972 29501 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:48.160099 29501 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:48.161164 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:48.169811 29501 catalog_manager.cc:1383] Generated new cluster ID: 338c416fe00742fd9d24f5ae5a64179c
I20260709 13:10:48.170156 29501 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:48.197672 29501 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:48.198947 29501 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:48.231051 29501 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b: Generated new TSK 0
I20260709 13:10:48.231670 29501 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:48.292788 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:48.299322 29512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.300362 29513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.302508 28922 server_base.cc:1061] running on GCE node
W20260709 13:10:48.302572 29515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.303812 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:48.304008 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:48.304148 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602648304135 us; error 0 us; skew 500 ppm
I20260709 13:10:48.304643 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:48.307154 28922 webserver.cc:533] Webserver started at http://127.28.62.129:35361/ using document root <none> and password file <none>
I20260709 13:10:48.307622 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:48.307777 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:48.307996 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:48.309033 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "34b05fa5f2a646959fd1dd091da57092"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.313617 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:48.317106 29520 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.317955 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:48.318341 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "34b05fa5f2a646959fd1dd091da57092"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.318672 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:48.341773 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:48.343190 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:48.345034 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:48.347719 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:48.347987 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.348337 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:48.348562 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.390635 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:36449
I20260709 13:10:48.390722 29582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:36449 every 8 connection(s)
I20260709 13:10:48.395679 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:48.403555 29587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.403852 29588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.408077 28922 server_base.cc:1061] running on GCE node
W20260709 13:10:48.408248 29590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.409189 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:48.409379 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:48.409600 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602648409584 us; error 0 us; skew 500 ppm
I20260709 13:10:48.410043 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:48.412945 28922 webserver.cc:533] Webserver started at http://127.28.62.130:41281/ using document root <none> and password file <none>
I20260709 13:10:48.413633 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:48.413867 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:48.414165 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:48.414548 29583 heartbeater.cc:344] Connected to a master server at 127.28.62.190:38729
I20260709 13:10:48.414969 29583 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:48.415390 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.415795 29583 heartbeater.cc:507] Master 127.28.62.190:38729 requested a full tablet report, sending...
I20260709 13:10:48.417960 29456 ts_manager.cc:194] Registered new tserver with Master: 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449)
I20260709 13:10:48.419801 29456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54878
I20260709 13:10:48.420306 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:10:48.423977 29595 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.424790 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:48.425093 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.425374 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:48.446789 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:48.448031 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:48.449653 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:48.452034 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:48.452221 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.452528 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:48.452665 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.496083 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:38273
I20260709 13:10:48.496169 29657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:38273 every 8 connection(s)
I20260709 13:10:48.500660 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:48.508832 29661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.509068 29662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.513592 29664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.514950 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:48.515331 29658 heartbeater.cc:344] Connected to a master server at 127.28.62.190:38729
I20260709 13:10:48.515735 29658 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:48.516088 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:48.516336 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:48.516544 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602648516522 us; error 0 us; skew 500 ppm
I20260709 13:10:48.516594 29658 heartbeater.cc:507] Master 127.28.62.190:38729 requested a full tablet report, sending...
I20260709 13:10:48.517194 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:48.518951 29456 ts_manager.cc:194] Registered new tserver with Master: ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:48.520004 28922 webserver.cc:533] Webserver started at http://127.28.62.131:39533/ using document root <none> and password file <none>
I20260709 13:10:48.520650 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:48.520625 29456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54880
I20260709 13:10:48.521054 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:48.521378 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:48.522814 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "59d0cac429dc4f128296b97ae473f402"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.528007 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:10:48.531735 29669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.532795 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:48.533157 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "59d0cac429dc4f128296b97ae473f402"
format_stamp: "Formatted at 2026-07-09 13:10:48 on dist-test-slave-50cs"
I20260709 13:10:48.533524 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:48.571700 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:48.573010 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:48.574309 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:48.576529 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:48.576768 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.577020 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:48.577205 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:48.619344 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:35803
I20260709 13:10:48.619477 29731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:35803 every 8 connection(s)
I20260709 13:10:48.634400 29732 heartbeater.cc:344] Connected to a master server at 127.28.62.190:38729
I20260709 13:10:48.634865 29732 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:48.635914 29732 heartbeater.cc:507] Master 127.28.62.190:38729 requested a full tablet report, sending...
I20260709 13:10:48.638144 29456 ts_manager.cc:194] Registered new tserver with Master: 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:48.638408 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015902695s
I20260709 13:10:48.639962 29456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54894
I20260709 13:10:48.667346 29456 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54898:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:48.670555 29456 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:48.748202 29697 tablet_service.cc:1511] Processing CreateTablet for tablet b8d2cfeebf244adab350f93dff36a1ff (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:48.750113 29697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d2cfeebf244adab350f93dff36a1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.753494 29696 tablet_service.cc:1511] Processing CreateTablet for tablet e688823ed552416e96f1ef140cbad7df (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:48.754734 29694 tablet_service.cc:1511] Processing CreateTablet for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:48.753494 29695 tablet_service.cc:1511] Processing CreateTablet for tablet bf211aa8d7ce43b9a62dfe0f2e328083 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:48.755218 29696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e688823ed552416e96f1ef140cbad7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.758183 29695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf211aa8d7ce43b9a62dfe0f2e328083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.759012 29694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.758795 29693 tablet_service.cc:1511] Processing CreateTablet for tablet d0748528444a435ca705babc2e94b6a0 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:48.760289 29693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0748528444a435ca705babc2e94b6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.760645 29622 tablet_service.cc:1511] Processing CreateTablet for tablet e688823ed552416e96f1ef140cbad7df (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:48.762217 29622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e688823ed552416e96f1ef140cbad7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.762799 29621 tablet_service.cc:1511] Processing CreateTablet for tablet bf211aa8d7ce43b9a62dfe0f2e328083 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:48.764277 29621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf211aa8d7ce43b9a62dfe0f2e328083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.764384 29623 tablet_service.cc:1511] Processing CreateTablet for tablet b8d2cfeebf244adab350f93dff36a1ff (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:48.765967 29623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d2cfeebf244adab350f93dff36a1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.765808 29692 tablet_service.cc:1511] Processing CreateTablet for tablet 038c8dba18d54dddb8e7323e80c62a67 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:48.767647 29692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038c8dba18d54dddb8e7323e80c62a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.771086 29620 tablet_service.cc:1511] Processing CreateTablet for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:48.772675 29620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.774837 29619 tablet_service.cc:1511] Processing CreateTablet for tablet d0748528444a435ca705babc2e94b6a0 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:48.776373 29619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0748528444a435ca705babc2e94b6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.777362 29616 tablet_service.cc:1511] Processing CreateTablet for tablet 851b85327b1f47ee8c19d1b5c1e3680e (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:48.779068 29616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851b85327b1f47ee8c19d1b5c1e3680e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.781176 29691 tablet_service.cc:1511] Processing CreateTablet for tablet 58045c6b3eba4ec99091f66e877033f6 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:48.782565 29691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58045c6b3eba4ec99091f66e877033f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.791702 29544 tablet_service.cc:1511] Processing CreateTablet for tablet d0748528444a435ca705babc2e94b6a0 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:48.778751 29618 tablet_service.cc:1511] Processing CreateTablet for tablet 038c8dba18d54dddb8e7323e80c62a67 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:48.795909 29546 tablet_service.cc:1511] Processing CreateTablet for tablet bf211aa8d7ce43b9a62dfe0f2e328083 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:48.794548 29545 tablet_service.cc:1511] Processing CreateTablet for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:48.798241 29618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038c8dba18d54dddb8e7323e80c62a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.794641 29548 tablet_service.cc:1511] Processing CreateTablet for tablet b8d2cfeebf244adab350f93dff36a1ff (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:48.800045 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 038c8dba18d54dddb8e7323e80c62a67 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:48.794076 29617 tablet_service.cc:1511] Processing CreateTablet for tablet 58045c6b3eba4ec99091f66e877033f6 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:48.795987 29547 tablet_service.cc:1511] Processing CreateTablet for tablet e688823ed552416e96f1ef140cbad7df (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:48.802858 29617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58045c6b3eba4ec99091f66e877033f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.796466 29542 tablet_service.cc:1511] Processing CreateTablet for tablet 58045c6b3eba4ec99091f66e877033f6 (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:48.793344 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0748528444a435ca705babc2e94b6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.806775 29545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.807471 29546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf211aa8d7ce43b9a62dfe0f2e328083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.809741 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 038c8dba18d54dddb8e7323e80c62a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.813833 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58045c6b3eba4ec99091f66e877033f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.818310 29547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e688823ed552416e96f1ef140cbad7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.821859 29548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d2cfeebf244adab350f93dff36a1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.822321 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 851b85327b1f47ee8c19d1b5c1e3680e (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:48.823750 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851b85327b1f47ee8c19d1b5c1e3680e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.840750 29690 tablet_service.cc:1511] Processing CreateTablet for tablet 851b85327b1f47ee8c19d1b5c1e3680e (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:48.845754 29540 tablet_service.cc:1511] Processing CreateTablet for tablet 2acaf0d894514a29921b551dfc70507a (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:48.847214 29540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acaf0d894514a29921b551dfc70507a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.857673 29689 tablet_service.cc:1511] Processing CreateTablet for tablet 2acaf0d894514a29921b551dfc70507a (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:48.861761 29688 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a1dd815f54e64b17a397077e932eb (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:48.869720 29690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851b85327b1f47ee8c19d1b5c1e3680e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.870769 29688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a1dd815f54e64b17a397077e932eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.875041 29689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acaf0d894514a29921b551dfc70507a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.874817 29548 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a1dd815f54e64b17a397077e932eb (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:48.876636 29548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a1dd815f54e64b17a397077e932eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.974241 29616 tablet_service.cc:1511] Processing CreateTablet for tablet 2acaf0d894514a29921b551dfc70507a (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:48.976413 29616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acaf0d894514a29921b551dfc70507a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.983014 29615 tablet_service.cc:1511] Processing CreateTablet for tablet 2e3a1dd815f54e64b17a397077e932eb (DEFAULT_TABLE table=test-workload [id=7b3d72a7d6354600875a2fc54f6f37c3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:48.984853 29615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3a1dd815f54e64b17a397077e932eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.998135 29748 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.002251 29747 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.016768 29748 tablet_bootstrap.cc:654] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.020447 29749 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.043747 29749 tablet_bootstrap.cc:654] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.057582 29747 tablet_bootstrap.cc:654] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.069907 29749 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.070444 29749 ts_tablet_manager.cc:1403] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.012s
I20260709 13:10:49.070652 29747 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.071100 29747 ts_tablet_manager.cc:1403] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.004s
I20260709 13:10:49.071169 29748 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.071666 29748 ts_tablet_manager.cc:1403] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 13:10:49.073884 29747 raft_consensus.cc:359] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.073777 29749 raft_consensus.cc:359] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.074560 29747 raft_consensus.cc:385] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.074715 29749 raft_consensus.cc:385] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.074927 29747 raft_consensus.cc:740] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.075299 29749 raft_consensus.cc:740] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.075326 29748 raft_consensus.cc:359] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.075830 29747 consensus_queue.cc:260] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.076184 29748 raft_consensus.cc:385] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.076661 29748 raft_consensus.cc:740] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.076211 29749 consensus_queue.cc:260] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.078224 29583 heartbeater.cc:499] Master 127.28.62.190:38729 was elected leader, sending a full tablet report...
I20260709 13:10:49.078457 29747 ts_tablet_manager.cc:1434] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:49.079730 29747 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.079747 29658 heartbeater.cc:499] Master 127.28.62.190:38729 was elected leader, sending a full tablet report...
I20260709 13:10:49.080444 29749 ts_tablet_manager.cc:1434] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:10:49.081369 29749 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.087455 29747 tablet_bootstrap.cc:654] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.088493 29749 tablet_bootstrap.cc:654] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.077423 29748 consensus_queue.cc:260] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.099414 29732 heartbeater.cc:499] Master 127.28.62.190:38729 was elected leader, sending a full tablet report...
I20260709 13:10:49.101104 29748 ts_tablet_manager.cc:1434] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.029s	user 0.014s	sys 0.001s
I20260709 13:10:49.102916 29748 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.112031 29754 raft_consensus.cc:493] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.112891 29754 raft_consensus.cc:515] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.113125 29748 tablet_bootstrap.cc:654] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.116503 29749 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.117066 29749 ts_tablet_manager.cc:1403] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.018s
I20260709 13:10:49.120883 29749 raft_consensus.cc:359] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.121714 29749 raft_consensus.cc:385] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.122045 29749 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.122846 29749 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.125833 29749 ts_tablet_manager.cc:1434] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 13:10:49.127468 29749 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.129855 29754 leader_election.cc:290] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.130937 29748 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.134593 29749 tablet_bootstrap.cc:654] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.140239 29748 ts_tablet_manager.cc:1403] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.011s
I20260709 13:10:49.143257 29748 raft_consensus.cc:359] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.143990 29748 raft_consensus.cc:385] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.144366 29748 raft_consensus.cc:740] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.145148 29748 consensus_queue.cc:260] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.147356 29748 ts_tablet_manager.cc:1434] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:10:49.148347 29748 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.149526 29749 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.149173 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.150022 29749 ts_tablet_manager.cc:1403] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.002s
I20260709 13:10:49.150127 29558 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 0.
I20260709 13:10:49.152077 29599 leader_election.cc:304] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.153331 29749 raft_consensus.cc:359] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.154157 29749 raft_consensus.cc:385] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.154508 29749 raft_consensus.cc:740] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
W20260709 13:10:49.154673 29504 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:49.155241 29748 tablet_bootstrap.cc:654] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.155228 29749 consensus_queue.cc:260] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.156265 29754 raft_consensus.cc:2804] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.157164 29754 raft_consensus.cc:493] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.161605 29754 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.163662 29748 tablet_bootstrap.cc:492] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.157584 29749 ts_tablet_manager.cc:1434] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:49.160334 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.164134 29748 ts_tablet_manager.cc:1403] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:10:49.165891 29749 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.167106 29748 raft_consensus.cc:359] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.167891 29748 raft_consensus.cc:385] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.168196 29748 raft_consensus.cc:740] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.169100 29748 consensus_queue.cc:260] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.170162 29754 raft_consensus.cc:515] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.171674 29748 ts_tablet_manager.cc:1434] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:49.172518 29754 leader_election.cc:290] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.172708 29748 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.173321 29747 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.173813 29747 ts_tablet_manager.cc:1403] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.026s
I20260709 13:10:49.175788 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.176469 29558 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:49.176784 29599 leader_election.cc:343] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.176703 29747 raft_consensus.cc:359] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.177670 29747 raft_consensus.cc:385] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.177989 29747 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.178721 29747 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.179790 29748 tablet_bootstrap.cc:654] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.180923 29747 ts_tablet_manager.cc:1434] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:10:49.175927 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.181960 29747 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.182001 29707 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.191855 29749 tablet_bootstrap.cc:654] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.193444 29707 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.194857 29558 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.195361 29754 raft_consensus.cc:493] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.197657 29754 raft_consensus.cc:515] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.200994 29754 leader_election.cc:290] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.198859 29599 leader_election.cc:304] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.201459 29747 tablet_bootstrap.cc:654] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.203941 29757 raft_consensus.cc:493] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.204703 29757 raft_consensus.cc:515] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.205822 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.206514 29707 raft_consensus.cc:2468] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 0.
I20260709 13:10:49.203928 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.210355 29757 leader_election.cc:290] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.207825 29754 raft_consensus.cc:2804] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.220708 29599 leader_election.cc:304] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.222771 29754 raft_consensus.cc:697] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:49.224115 29754 consensus_queue.cc:237] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.225369 29758 raft_consensus.cc:2804] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.227495 29758 raft_consensus.cc:493] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.227891 29758 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.233062 29749 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.233594 29749 ts_tablet_manager.cc:1403] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.004s
I20260709 13:10:49.238085 29749 raft_consensus.cc:359] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.238834 29749 raft_consensus.cc:385] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.238423 29758 raft_consensus.cc:515] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.246865 29748 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.247675 29748 ts_tablet_manager.cc:1403] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.075s	user 0.037s	sys 0.026s
I20260709 13:10:49.248536 29758 leader_election.cc:290] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.246644 29749 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
W20260709 13:10:49.226742 29599 leader_election.cc:343] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.251341 29749 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.253026 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.253183 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.253796 29707 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.254896 29749 ts_tablet_manager.cc:1434] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:10:49.256404 29749 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
W20260709 13:10:49.257937 29599 leader_election.cc:343] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.262095 29707 raft_consensus.cc:2468] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.263725 29599 leader_election.cc:304] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:49.263684 29748 raft_consensus.cc:359] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.264816 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.264952 29748 raft_consensus.cc:385] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.265228 29758 raft_consensus.cc:2804] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.265554 29748 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
W20260709 13:10:49.266791 29673 leader_election.cc:343] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.266799 29748 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.273252 29749 tablet_bootstrap.cc:654] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.273597 29748 ts_tablet_manager.cc:1434] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:10:49.274875 29748 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.275471 29454 catalog_manager.cc:5697] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.279665 29758 raft_consensus.cc:697] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:49.280426 29749 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.281072 29749 ts_tablet_manager.cc:1403] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.011s
I20260709 13:10:49.282811 29748 tablet_bootstrap.cc:654] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.284590 29749 raft_consensus.cc:359] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.285559 29749 raft_consensus.cc:385] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.285982 29749 raft_consensus.cc:740] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.287052 29749 consensus_queue.cc:260] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.288216 29747 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.289040 29747 ts_tablet_manager.cc:1403] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.031s
I20260709 13:10:49.289667 29749 ts_tablet_manager.cc:1434] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:10:49.280722 29758 consensus_queue.cc:237] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.291476 29749 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.292239 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.294317 29671 leader_election.cc:304] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402; no voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:49.295030 29747 raft_consensus.cc:359] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.295606 29757 raft_consensus.cc:2749] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.295794 29747 raft_consensus.cc:385] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.296183 29747 raft_consensus.cc:740] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.297037 29747 consensus_queue.cc:260] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.297725 29749 tablet_bootstrap.cc:654] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.304527 29747 ts_tablet_manager.cc:1434] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:10:49.307703 29748 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.308523 29748 ts_tablet_manager.cc:1403] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.002s
I20260709 13:10:49.306324 29747 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.314021 29748 raft_consensus.cc:359] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.316558 29748 raft_consensus.cc:385] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.317104 29748 raft_consensus.cc:740] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.318531 29748 consensus_queue.cc:260] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.324054 29749 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.324589 29749 ts_tablet_manager.cc:1403] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.022s
I20260709 13:10:49.325553 29748 ts_tablet_manager.cc:1434] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.002s
I20260709 13:10:49.326658 29748 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.327925 29749 raft_consensus.cc:359] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.328684 29749 raft_consensus.cc:385] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.328979 29749 raft_consensus.cc:740] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.329843 29749 consensus_queue.cc:260] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.332163 29749 ts_tablet_manager.cc:1434] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:49.333024 29749 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.334221 29747 tablet_bootstrap.cc:654] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.335482 29758 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.336006 29758 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.338212 29758 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803), 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449)
I20260709 13:10:49.339367 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.340094 29558 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 0.
I20260709 13:10:49.339344 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.341704 29599 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.344792 29749 tablet_bootstrap.cc:654] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:49.345162 29599 leader_election.cc:343] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.334225 29748 tablet_bootstrap.cc:654] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.348060 29758 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.348512 29758 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.348968 29758 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.346719 29454 catalog_manager.cc:5697] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.352638 29747 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.352974 29749 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.353180 29747 ts_tablet_manager.cc:1403] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.004s
I20260709 13:10:49.353487 29749 ts_tablet_manager.cc:1403] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 13:10:49.356534 29747 raft_consensus.cc:359] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.356760 29749 raft_consensus.cc:359] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.357456 29747 raft_consensus.cc:385] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.357535 29749 raft_consensus.cc:385] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.357923 29749 raft_consensus.cc:740] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.357885 29747 raft_consensus.cc:740] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.358870 29749 consensus_queue.cc:260] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.360219 29747 consensus_queue.cc:260] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.361613 29749 ts_tablet_manager.cc:1434] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:49.362709 29749 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.365832 29748 tablet_bootstrap.cc:492] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.366364 29748 ts_tablet_manager.cc:1403] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.004s
I20260709 13:10:49.367342 29747 ts_tablet_manager.cc:1434] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:10:49.368449 29747 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.369225 29748 raft_consensus.cc:359] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.370013 29748 raft_consensus.cc:385] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.370323 29748 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.370669 29749 tablet_bootstrap.cc:654] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.371186 29748 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.362828 29758 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.375388 29748 ts_tablet_manager.cc:1434] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:10:49.376400 29748 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.377605 29747 tablet_bootstrap.cc:654] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.378742 29758 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Requested vote from peers 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803), 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449)
I20260709 13:10:49.382782 29749 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.383219 29748 tablet_bootstrap.cc:654] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.383602 29749 ts_tablet_manager.cc:1403] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:10:49.383726 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.384267 29757 raft_consensus.cc:493] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.384414 29558 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.384768 29757 raft_consensus.cc:515] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.386960 29757 leader_election.cc:290] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.387734 29749 raft_consensus.cc:359] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.388567 29749 raft_consensus.cc:385] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.388622 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.389086 29749 raft_consensus.cc:740] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.389430 29633 raft_consensus.cc:2468] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
I20260709 13:10:49.390268 29747 tablet_bootstrap.cc:492] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.390081 29749 consensus_queue.cc:260] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.390751 29747 ts_tablet_manager.cc:1403] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:10:49.391682 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.382962 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.393172 29707 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.393831 29747 raft_consensus.cc:359] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.394598 29747 raft_consensus.cc:385] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.394932 29747 raft_consensus.cc:740] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
W20260709 13:10:49.397908 29673 leader_election.cc:343] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.398566 29671 leader_election.cc:304] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:49.399672 29757 raft_consensus.cc:2804] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.400032 29757 raft_consensus.cc:493] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.400375 29757 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.403894 29707 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.405105 29753 raft_consensus.cc:493] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.405616 29753 raft_consensus.cc:515] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.407807 29558 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.392689 29749 ts_tablet_manager.cc:1434] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:49.397796 29747 consensus_queue.cc:260] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.409741 29757 raft_consensus.cc:515] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.412158 29757 leader_election.cc:290] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.413550 29749 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.414522 29599 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.416525 29758 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.417258 29758 raft_consensus.cc:697] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:49.418435 29758 consensus_queue.cc:237] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:49.420748 29749 tablet_bootstrap.cc:654] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.421985 29757 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.422485 29757 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.422868 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:49.423400 29633 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.425047 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.425539 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
W20260709 13:10:49.426817 29673 leader_election.cc:343] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.427783 29757 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
W20260709 13:10:49.427663 29673 leader_election.cc:343] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.429528 29753 leader_election.cc:290] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.430557 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.437501 29754 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.446488 29758 raft_consensus.cc:493] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.445297 29671 leader_election.cc:343] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.447139 29758 raft_consensus.cc:515] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.447705 29671 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402; no voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:49.445241 29754 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.451049 29758 leader_election.cc:290] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.451756 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.452175 29754 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.452896 29757 raft_consensus.cc:2749] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:49.454943 29599 leader_election.cc:343] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.455596 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.445236 29748 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.456712 29748 ts_tablet_manager.cc:1403] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.019s
I20260709 13:10:49.455899 29456 catalog_manager.cc:5697] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:49.457976 29599 leader_election.cc:343] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.460120 29633 raft_consensus.cc:2468] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.461355 29671 leader_election.cc:304] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:49.461897 29749 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.462344 29749 ts_tablet_manager.cc:1403] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.014s
I20260709 13:10:49.463189 29757 raft_consensus.cc:2804] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.463913 29747 ts_tablet_manager.cc:1434] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.028s
I20260709 13:10:49.464814 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.465461 29557 raft_consensus.cc:2468] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 0.
I20260709 13:10:49.470137 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.471398 29599 leader_election.cc:304] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:49.471722 29748 raft_consensus.cc:359] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.472175 29754 raft_consensus.cc:2804] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.472427 29748 raft_consensus.cc:385] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.472540 29754 raft_consensus.cc:493] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.472748 29748 raft_consensus.cc:740] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.472900 29754 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.473762 29748 consensus_queue.cc:260] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.476068 29747 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
W20260709 13:10:49.480751 29599 leader_election.cc:343] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.481226 29599 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:49.482033 29758 raft_consensus.cc:2749] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.483049 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.483559 29749 raft_consensus.cc:359] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.483870 29754 raft_consensus.cc:515] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.484269 29749 raft_consensus.cc:385] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.484649 29749 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.485443 29633 raft_consensus.cc:2393] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34b05fa5f2a646959fd1dd091da57092 in current term 1: Already voted for candidate ce34c4fcb73549fe9bf9595ffeaef339 in this term.
I20260709 13:10:49.485363 29749 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.476799 29757 raft_consensus.cc:697] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:49.488657 29757 consensus_queue.cc:237] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.490615 29754 leader_election.cc:290] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.492417 29747 tablet_bootstrap.cc:654] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.493532 29749 ts_tablet_manager.cc:1434] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:10:49.494604 29749 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: Bootstrap starting.
I20260709 13:10:49.495262 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.496938 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.497700 29557 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.501066 29749 tablet_bootstrap.cc:654] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.506150 29557 raft_consensus.cc:2468] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 1.
I20260709 13:10:49.506618 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
W20260709 13:10:49.516450 29524 leader_election.cc:343] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.518497 29455 catalog_manager.cc:5697] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.519393 29748 ts_tablet_manager.cc:1434] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.019s
I20260709 13:10:49.521186 29748 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
W20260709 13:10:49.507081 29599 leader_election.cc:343] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.530925 29748 tablet_bootstrap.cc:654] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.530867 29522 leader_election.cc:304] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092; no voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:49.532011 29785 raft_consensus.cc:2749] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.514020 29757 raft_consensus.cc:493] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.534720 29599 leader_election.cc:304] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:49.534399 29757 raft_consensus.cc:515] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.535651 29754 raft_consensus.cc:2804] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.536211 29754 raft_consensus.cc:697] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:49.537205 29754 consensus_queue.cc:237] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.538826 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.539610 29557 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
I20260709 13:10:49.538959 29747 tablet_bootstrap.cc:492] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.540514 29747 ts_tablet_manager.cc:1403] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.025s
I20260709 13:10:49.540860 29673 leader_election.cc:304] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:49.541755 29749 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: No bootstrap required, opened a new log
I20260709 13:10:49.541934 29790 raft_consensus.cc:2804] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.542426 29749 ts_tablet_manager.cc:1403] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.003s
I20260709 13:10:49.542393 29790 raft_consensus.cc:493] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.543009 29790 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.544029 29747 raft_consensus.cc:359] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.544898 29747 raft_consensus.cc:385] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.545264 29747 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.545907 29757 leader_election.cc:290] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.546452 29749 raft_consensus.cc:359] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.547252 29749 raft_consensus.cc:385] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.547618 29749 raft_consensus.cc:740] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.546716 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.546303 29747 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.548367 29749 consensus_queue.cc:260] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.549206 29633 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
I20260709 13:10:49.551191 29757 raft_consensus.cc:493] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.551474 29749 ts_tablet_manager.cc:1434] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:49.551692 29757 raft_consensus.cc:515] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.552537 29790 raft_consensus.cc:515] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.554435 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.554865 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.555491 29633 raft_consensus.cc:2468] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
W20260709 13:10:49.555804 29673 leader_election.cc:343] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.556252 29748 tablet_bootstrap.cc:492] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.556746 29671 leader_election.cc:304] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:49.557642 29789 raft_consensus.cc:2804] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.557847 29757 leader_election.cc:290] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.556921 29747 ts_tablet_manager.cc:1434] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:49.558080 29789 raft_consensus.cc:493] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.556761 29748 ts_tablet_manager.cc:1403] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.007s
I20260709 13:10:49.558684 29789 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.561775 29748 raft_consensus.cc:359] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.562513 29748 raft_consensus.cc:385] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.562803 29748 raft_consensus.cc:740] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.563086 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:49.563869 29633 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.563526 29748 consensus_queue.cc:260] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.564895 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.565616 29557 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.568584 29747 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.569761 29790 leader_election.cc:290] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.567373 29789 raft_consensus.cc:515] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.574076 29748 ts_tablet_manager.cc:1434] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:10:49.575349 29748 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.579982 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.581322 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
W20260709 13:10:49.581720 29673 leader_election.cc:343] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:49.581967 29632 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.585237 29747 tablet_bootstrap.cc:654] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.589879 29748 tablet_bootstrap.cc:654] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.590184 29632 raft_consensus.cc:2468] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.590402 29455 catalog_manager.cc:5697] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.591583 29671 leader_election.cc:304] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:49.592585 29790 raft_consensus.cc:2804] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.593127 29790 raft_consensus.cc:697] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:49.594061 29790 consensus_queue.cc:237] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.596493 29557 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.597838 29673 leader_election.cc:304] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:49.598906 29757 raft_consensus.cc:2804] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.599748 29633 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.602054 29789 leader_election.cc:290] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.604379 29748 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.605124 29748 ts_tablet_manager.cc:1403] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.001s
I20260709 13:10:49.609191 29748 raft_consensus.cc:359] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.610535 29748 raft_consensus.cc:385] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.611004 29748 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.612401 29748 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.615994 29748 ts_tablet_manager.cc:1434] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:49.617439 29748 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: Bootstrap starting.
I20260709 13:10:49.627087 29748 tablet_bootstrap.cc:654] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.635104 29757 raft_consensus.cc:697] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:49.638996 29757 consensus_queue.cc:237] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.642460 29754 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.649166 29455 catalog_manager.cc:5697] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.651054 29748 tablet_bootstrap.cc:492] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: No bootstrap required, opened a new log
I20260709 13:10:49.651541 29748 ts_tablet_manager.cc:1403] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 13:10:49.653832 29748 raft_consensus.cc:359] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.654608 29748 raft_consensus.cc:385] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.654901 29748 raft_consensus.cc:740] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.653631 29747 tablet_bootstrap.cc:492] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.656068 29747 ts_tablet_manager.cc:1403] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.088s	user 0.034s	sys 0.032s
I20260709 13:10:49.655606 29748 consensus_queue.cc:260] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.656703 29790 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.657167 29790 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.659041 29747 raft_consensus.cc:359] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.659464 29790 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.659804 29747 raft_consensus.cc:385] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.660161 29747 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.660775 29748 ts_tablet_manager.cc:1434] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:10:49.660775 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.661070 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.662190 29633 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
I20260709 13:10:49.663563 29671 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.664289 29790 raft_consensus.cc:2804] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.664629 29790 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.664980 29790 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.667512 29747 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.668526 29557 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 0.
I20260709 13:10:49.670301 29747 ts_tablet_manager.cc:1434] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:49.671293 29747 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.673322 29790 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.676017 29790 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.676872 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:49.677525 29557 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.678424 29747 tablet_bootstrap.cc:654] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:49.683504 29599 consensus_peers.cc:597] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 -> Peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Couldn't send request to peer 34b05fa5f2a646959fd1dd091da57092. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.681766 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:49.683377 29456 catalog_manager.cc:5697] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.685299 29633 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.693671 29785 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.694257 29785 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.696218 29785 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.697332 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.698042 29707 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 0.
I20260709 13:10:49.699259 29524 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:49.700196 29785 raft_consensus.cc:2804] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.700592 29785 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.700982 29785 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.706393 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.707086 29632 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 0.
I20260709 13:10:49.708659 29633 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.709354 29557 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 1.
I20260709 13:10:49.709920 29754 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.710125 29671 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.711043 29790 raft_consensus.cc:2804] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.711575 29790 raft_consensus.cc:697] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:49.712491 29790 consensus_queue.cc:237] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.720705 29785 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.722769 29785 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.723932 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.724591 29707 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.724577 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:49.725586 29633 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.727761 29747 tablet_bootstrap.cc:492] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.728353 29747 ts_tablet_manager.cc:1403] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.016s
I20260709 13:10:49.732051 29747 raft_consensus.cc:359] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.732556 29707 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 1.
I20260709 13:10:49.732961 29747 raft_consensus.cc:385] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.733388 29747 raft_consensus.cc:740] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.734895 29524 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:49.733515 29633 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 1.
I20260709 13:10:49.736286 29747 consensus_queue.cc:260] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.735896 29785 raft_consensus.cc:2804] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.738453 29747 ts_tablet_manager.cc:1434] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:49.738765 29785 raft_consensus.cc:697] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:49.739375 29747 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.739585 29785 consensus_queue.cc:237] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.744736 29456 catalog_manager.cc:5697] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.746238 29747 tablet_bootstrap.cc:654] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.752228 29754 consensus_queue.cc:1048] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.753926 29747 tablet_bootstrap.cc:492] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.754966 29747 ts_tablet_manager.cc:1403] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:10:49.757781 29747 raft_consensus.cc:359] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.758525 29747 raft_consensus.cc:385] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.758823 29747 raft_consensus.cc:740] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.757537 29455 catalog_manager.cc:5697] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.759657 29747 consensus_queue.cc:260] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.762507 29747 ts_tablet_manager.cc:1434] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:49.763495 29747 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: Bootstrap starting.
I20260709 13:10:49.769836 29747 tablet_bootstrap.cc:654] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:49.777068 29747 tablet_bootstrap.cc:492] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: No bootstrap required, opened a new log
I20260709 13:10:49.777652 29747 ts_tablet_manager.cc:1403] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.003s
I20260709 13:10:49.780746 29747 raft_consensus.cc:359] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.781548 29747 raft_consensus.cc:385] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:49.781857 29747 raft_consensus.cc:740] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Initialized, Role: FOLLOWER
I20260709 13:10:49.782578 29747 consensus_queue.cc:260] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.784693 29747 ts_tablet_manager.cc:1434] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:10:49.809299 29785 raft_consensus.cc:493] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.809891 29785 raft_consensus.cc:515] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.810832 29790 raft_consensus.cc:493] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.811245 29790 raft_consensus.cc:515] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.811942 29785 leader_election.cc:290] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.812783 29633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf211aa8d7ce43b9a62dfe0f2e328083" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.813114 29790 leader_election.cc:290] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:49.813442 29633 raft_consensus.cc:2468] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 0.
I20260709 13:10:49.814013 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34b05fa5f2a646959fd1dd091da57092" is_pre_election: true
I20260709 13:10:49.814218 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.813107 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf211aa8d7ce43b9a62dfe0f2e328083" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.814515 29522 leader_election.cc:304] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.814862 29558 raft_consensus.cc:2393] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59d0cac429dc4f128296b97ae473f402 in current term 1: Already voted for candidate ce34c4fcb73549fe9bf9595ffeaef339 in this term.
I20260709 13:10:49.815145 29707 raft_consensus.cc:2468] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 0.
I20260709 13:10:49.815400 29785 raft_consensus.cc:2804] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:49.815789 29785 raft_consensus.cc:493] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.816152 29785 raft_consensus.cc:3060] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.816092 29673 leader_election.cc:304] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402; no voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:49.817365 29790 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.821636 29785 raft_consensus.cc:515] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.823737 29785 leader_election.cc:290] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.824177 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf211aa8d7ce43b9a62dfe0f2e328083" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:49.824326 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf211aa8d7ce43b9a62dfe0f2e328083" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:49.823752 29790 raft_consensus.cc:2749] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.824954 29707 raft_consensus.cc:3060] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.824906 29632 raft_consensus.cc:3060] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.830426 29632 raft_consensus.cc:2468] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 1.
I20260709 13:10:49.831259 29707 raft_consensus.cc:2468] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 1.
I20260709 13:10:49.831460 29522 leader_election.cc:304] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:49.832463 29785 raft_consensus.cc:2804] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:49.832816 29753 raft_consensus.cc:493] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.833436 29785 raft_consensus.cc:697] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:49.833287 29753 raft_consensus.cc:515] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.834287 29785 consensus_queue.cc:237] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:49.835495 29753 leader_election.cc:290] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:49.836051 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:49.836755 29632 raft_consensus.cc:2393] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34b05fa5f2a646959fd1dd091da57092 in current term 1: Already voted for candidate 59d0cac429dc4f128296b97ae473f402 in this term.
I20260709 13:10:49.836987 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:49.838248 29524 leader_election.cc:304] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092; no voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:49.839015 29753 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.844848 29758 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.844553 29455 catalog_manager.cc:5697] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.846292 29753 raft_consensus.cc:2749] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:49.857514 29770 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:49.902482 29790 consensus_queue.cc:1048] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.912629 29558 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:49.919808 29758 consensus_queue.cc:1048] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.920953 29790 consensus_queue.cc:1048] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:49.921977 29758 consensus_queue.cc:1048] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.053539 29790 consensus_queue.cc:1048] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.061334 29632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:50.061951 29632 raft_consensus.cc:606] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:50.063817 29757 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.068042 29789 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.076045 29757 consensus_queue.cc:1048] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.103678 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:50.104401 29707 raft_consensus.cc:606] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:50.111398 29632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:50.111971 29632 raft_consensus.cc:606] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:50.118112 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:50.118629 29707 raft_consensus.cc:606] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Received request to transfer leadership to TS ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:50.121973 29753 raft_consensus.cc:493] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.122519 29753 raft_consensus.cc:515] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.124670 29753 leader_election.cc:290] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.125437 29632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" is_pre_election: true
I20260709 13:10:50.126145 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d0cac429dc4f128296b97ae473f402" is_pre_election: true
I20260709 13:10:50.127614 29524 leader_election.cc:304] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092; no voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:50.128258 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:50.128886 29707 raft_consensus.cc:606] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Received request to transfer leadership to TS ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:50.128995 29753 raft_consensus.cc:2749] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:50.134580 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:50.135205 29707 raft_consensus.cc:606] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Received request to transfer leadership to TS ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:50.140729 29632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:50.141214 29632 raft_consensus.cc:606] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Received request to transfer leadership to TS 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:50.186754 29753 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.197391 29785 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.230242 29557 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.256867 29790 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.263090 29757 raft_consensus.cc:993] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: : Instructing follower ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.263557 29789 raft_consensus.cc:1081] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Signalling peer ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.266673 29633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:10:50.267241 29633 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.267624 29633 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.270905 29757 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.274487 29633 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.277930 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.278499 29707 raft_consensus.cc:3055] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.278818 29707 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:50.278695 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:50.279619 29707 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.280579 29707 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.290066 29785 consensus_queue.cc:1048] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:50.276942 29633 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.303512 29707 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 2.
I20260709 13:10:50.305759 29599 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:50.307135 29770 raft_consensus.cc:2804] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.307678 29770 raft_consensus.cc:697] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.308557 29770 consensus_queue.cc:237] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.316256 29785 consensus_queue.cc:1048] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:50.321202 29455 catalog_manager.cc:5697] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 1 to 2, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.327554 29757 raft_consensus.cc:993] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: : Instructing follower ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.328171 29757 raft_consensus.cc:1081] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Signalling peer ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.330806 29631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:10:50.331589 29631 raft_consensus.cc:493] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.332080 29631 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.348649 29631 raft_consensus.cc:515] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.351969 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:50.352620 29557 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.352880 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acaf0d894514a29921b551dfc70507a" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.353669 29707 raft_consensus.cc:3055] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.354053 29707 raft_consensus.cc:740] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:50.355293 29707 consensus_queue.cc:260] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.356562 29707 raft_consensus.cc:3060] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.360385 29631 leader_election.cc:290] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.360477 29557 raft_consensus.cc:2468] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 2.
I20260709 13:10:50.362501 29599 leader_election.cc:304] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:50.363451 29770 raft_consensus.cc:2804] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.364017 29770 raft_consensus.cc:697] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.364303 29707 raft_consensus.cc:2468] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 2.
I20260709 13:10:50.364970 29770 consensus_queue.cc:237] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.371945 29770 raft_consensus.cc:993] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.372435 29770 raft_consensus.cc:1081] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.374329 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37270
I20260709 13:10:50.374187 29453 catalog_manager.cc:5697] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 1 to 2, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.375207 29557 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.375916 29557 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.385488 29557 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:50.388933 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.389030 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:50.389590 29707 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.389752 29631 raft_consensus.cc:3055] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.390173 29631 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.391330 29557 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Requested vote from peers 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:50.391074 29631 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:50.392299 29631 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.395038 29707 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.396116 29524 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:50.396808 29785 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.397244 29785 raft_consensus.cc:697] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:50.398062 29785 consensus_queue.cc:237] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:50.400959 29631 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.405637 29453 catalog_manager.cc:5697] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 1 to 2, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.448019 29754 raft_consensus.cc:993] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:50.448488 29754 raft_consensus.cc:1081] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Signalling peer 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:50.450031 29707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:40864
I20260709 13:10:50.450551 29707 raft_consensus.cc:493] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.450870 29707 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.455632 29707 raft_consensus.cc:515] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.457296 29707 leader_election.cc:290] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 2 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:50.458415 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:50.458415 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e3a1dd815f54e64b17a397077e932eb" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:50.459329 29631 raft_consensus.cc:3055] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.459390 29557 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.459856 29631 raft_consensus.cc:740] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.460764 29631 consensus_queue.cc:260] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.462116 29631 raft_consensus.cc:3060] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.467391 29557 raft_consensus.cc:2468] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 2.
I20260709 13:10:50.468724 29790 raft_consensus.cc:993] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.469225 29790 raft_consensus.cc:1081] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.469276 29673 leader_election.cc:304] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:50.470060 29631 raft_consensus.cc:2468] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 2.
I20260709 13:10:50.470266 29790 raft_consensus.cc:2804] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.470775 29790 raft_consensus.cc:697] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:50.471573 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37276
I20260709 13:10:50.471704 29790 consensus_queue.cc:237] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.472527 29557 raft_consensus.cc:493] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.473039 29557 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.479048 29557 raft_consensus.cc:515] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.479422 29453 catalog_manager.cc:5697] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 1 to 2, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.480938 29557 leader_election.cc:290] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.481617 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:50.482206 29631 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.482206 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c601f3e0a0d4fd5a7ba7d41ee9eb6cf" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.482892 29707 raft_consensus.cc:3055] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.483225 29707 raft_consensus.cc:740] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:50.484068 29707 consensus_queue.cc:260] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.485253 29707 raft_consensus.cc:3060] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.489931 29631 raft_consensus.cc:2468] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.491578 29522 leader_election.cc:304] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:50.492405 29785 raft_consensus.cc:2804] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.492550 29707 raft_consensus.cc:2468] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.492944 29785 raft_consensus.cc:697] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:50.493350 29754 raft_consensus.cc:993] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.493825 29770 raft_consensus.cc:1081] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:50.493884 29785 consensus_queue.cc:237] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.495395 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37270
I20260709 13:10:50.495875 29557 raft_consensus.cc:493] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.496138 29557 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.501675 29453 catalog_manager.cc:5697] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 1 to 2, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.502430 29557 raft_consensus.cc:515] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.504485 29557 leader_election.cc:290] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.505573 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.505679 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:50.506268 29631 raft_consensus.cc:3055] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.506196 29707 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.506702 29631 raft_consensus.cc:740] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.507661 29631 consensus_queue.cc:260] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.508849 29631 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.512210 29707 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.513262 29524 leader_election.cc:304] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:50.514098 29785 raft_consensus.cc:2804] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.514555 29785 raft_consensus.cc:697] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:50.515276 29785 consensus_queue.cc:237] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.515578 29631 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:50.521703 29453 catalog_manager.cc:5697] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 1 to 2, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.593055 29789 raft_consensus.cc:993] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: : Instructing follower ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.593585 29790 raft_consensus.cc:1081] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Signalling peer ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:50.595110 29631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:10:50.595618 29631 raft_consensus.cc:493] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.595918 29631 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.600664 29631 raft_consensus.cc:515] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.602470 29631 leader_election.cc:290] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:50.603233 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:50.603861 29557 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.603844 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:50.604532 29707 raft_consensus.cc:3055] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.604900 29707 raft_consensus.cc:740] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:50.605762 29707 consensus_queue.cc:260] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.606930 29707 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.611011 29557 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 2.
I20260709 13:10:50.612298 29599 leader_election.cc:304] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:50.613173 29707 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 2.
I20260709 13:10:50.613253 29754 raft_consensus.cc:2804] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.614019 29754 raft_consensus.cc:697] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:50.614923 29754 consensus_queue.cc:237] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:50.622027 29453 catalog_manager.cc:5697] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 1 to 2, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.770123 29707 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.771461 29754 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.779644 29557 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.787245 29557 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.788693 29754 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.868736 29707 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.870111 29785 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.880426 29631 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.881901 29753 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.884370 29631 raft_consensus.cc:1275] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.886816 29790 consensus_queue.cc:1048] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.895344 29557 raft_consensus.cc:1275] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.897686 29789 consensus_queue.cc:1048] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.922204 29707 raft_consensus.cc:1275] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.923250 29753 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.931842 29631 raft_consensus.cc:1275] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.933274 29785 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.973331 29707 raft_consensus.cc:1275] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.974541 29770 consensus_queue.cc:1048] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.976976 29557 raft_consensus.cc:1275] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.978235 29770 consensus_queue.cc:1048] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.022645 29707 raft_consensus.cc:1275] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.023811 29770 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:51.033505 29706 raft_consensus.cc:1275] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.035391 29813 consensus_queue.cc:1048] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.036433 29557 raft_consensus.cc:1275] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.041591 29758 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.046088 29631 raft_consensus.cc:1275] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:51.048457 29785 consensus_queue.cc:1048] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.177721 28922 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:10:53.178560 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:53.202299 29557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:53.202790 29557 raft_consensus.cc:606] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Received request to transfer leadership to TS 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:53.205111 29557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:53.205603 29557 raft_consensus.cc:606] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Received request to transfer leadership to TS 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:53.206598 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:53.207193 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:53.517828 29813 raft_consensus.cc:993] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:53.518297 29844 raft_consensus.cc:1081] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Signalling peer 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:53.519976 29707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:40878
I20260709 13:10:53.520591 29707 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.520951 29707 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.525815 29707 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:53.527431 29707 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 3 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:53.528357 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:53.528728 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:53.528975 29557 raft_consensus.cc:3055] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:53.529340 29631 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.529500 29557 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:53.530267 29557 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:53.531165 29557 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.534730 29631 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 3.
I20260709 13:10:53.535713 29557 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 3.
I20260709 13:10:53.536147 29671 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:53.537004 29789 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:53.538203 29789 raft_consensus.cc:697] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:53.539086 29789 consensus_queue.cc:237] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:53.547236 29453 catalog_manager.cc:5697] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 2 to 3, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.623082 29813 raft_consensus.cc:993] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:53.623560 29844 raft_consensus.cc:1081] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Signalling peer 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:53.624977 29707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:40878
I20260709 13:10:53.625351 29707 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.625607 29707 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.629532 29707 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:53.630882 29707 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 2 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:53.631771 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:53.631981 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:53.632298 29557 raft_consensus.cc:3055] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.632573 29631 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.632603 29557 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:53.633529 29557 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:53.634538 29557 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.639240 29557 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 2.
I20260709 13:10:53.639282 29631 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 2.
I20260709 13:10:53.640312 29673 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:53.640997 29789 raft_consensus.cc:2804] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.641456 29789 raft_consensus.cc:697] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:53.642158 29789 consensus_queue.cc:237] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:53.652309 29453 catalog_manager.cc:5697] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 1 to 2, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.926170 29631 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:53.927506 29789 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.931421 29557 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:53.933060 29789 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.115594 29557 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.116946 29845 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.125699 29631 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.127970 29853 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.208107 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.223009 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:54.223567 29707 raft_consensus.cc:606] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:54.228897 29707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:40884
I20260709 13:10:54.229444 29707 raft_consensus.cc:606] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:54.243819 29631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:54.244365 29631 raft_consensus.cc:606] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:54.249056 29631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:54.249640 29631 raft_consensus.cc:606] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:54.254406 29631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
mode: GRACEFUL
new_leader_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:34230
I20260709 13:10:54.254920 29631 raft_consensus.cc:606] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Received request to transfer leadership to TS 34b05fa5f2a646959fd1dd091da57092
I20260709 13:10:54.351908 29860 raft_consensus.cc:993] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.352376 29754 raft_consensus.cc:1081] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.354017 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37270
I20260709 13:10:54.354434 29557 raft_consensus.cc:493] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.354660 29557 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.358875 29557 raft_consensus.cc:515] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.360595 29557 leader_election.cc:290] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:54.361444 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:54.361631 29707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58045c6b3eba4ec99091f66e877033f6" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:54.362202 29707 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.362182 29631 raft_consensus.cc:3055] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:54.362749 29631 raft_consensus.cc:740] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:54.363065 29853 raft_consensus.cc:993] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.363521 29789 raft_consensus.cc:1081] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.363765 29631 consensus_queue.cc:260] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.365087 29631 raft_consensus.cc:3060] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.365186 29558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37276
I20260709 13:10:54.365811 29558 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.366166 29558 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.368683 29707 raft_consensus.cc:2468] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:54.370071 29524 leader_election.cc:304] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:54.370903 29844 raft_consensus.cc:2804] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:54.370877 29631 raft_consensus.cc:2468] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 2.
I20260709 13:10:54.372421 29844 raft_consensus.cc:697] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:54.372220 29558 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:54.373421 29844 consensus_queue.cc:237] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.375167 29558 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 4 election: Requested vote from peers 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:54.375121 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:54.375891 29706 raft_consensus.cc:3055] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.376257 29706 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:54.377864 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:54.377070 29706 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:54.378448 29631 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.378970 29706 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.382936 29754 raft_consensus.cc:993] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.383690 29453 catalog_manager.cc:5697] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 1 to 2, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.385140 29631 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 4.
I20260709 13:10:54.386443 29706 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 4.
I20260709 13:10:54.386570 29522 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:54.387720 29754 raft_consensus.cc:1081] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.388204 29844 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:54.388674 29844 raft_consensus.cc:697] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:54.389192 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37270
I20260709 13:10:54.389704 29557 raft_consensus.cc:493] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.389385 29844 consensus_queue.cc:237] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:54.390002 29557 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.395699 29557 raft_consensus.cc:515] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.397675 29557 leader_election.cc:290] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:54.398553 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:54.398437 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "038c8dba18d54dddb8e7323e80c62a67" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:54.399199 29631 raft_consensus.cc:3055] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.399480 29631 raft_consensus.cc:740] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:54.399399 29706 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.400341 29631 consensus_queue.cc:260] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.401305 29631 raft_consensus.cc:3060] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.406462 29631 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.407300 29706 raft_consensus.cc:2468] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.407444 29522 leader_election.cc:304] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:54.408933 29844 raft_consensus.cc:2804] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.409482 29844 raft_consensus.cc:697] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:54.410382 29844 consensus_queue.cc:237] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.410722 29453 catalog_manager.cc:5697] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 3 to 4, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 4 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.423365 29453 catalog_manager.cc:5697] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 2 to 3, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.575899 29853 raft_consensus.cc:993] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.576345 29789 raft_consensus.cc:1081] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.577834 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37276
I20260709 13:10:54.578251 29557 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.578492 29557 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.582823 29557 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.584244 29557 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:54.585229 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:54.585194 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:54.585976 29631 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.585969 29706 raft_consensus.cc:3055] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.586422 29706 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:54.587235 29706 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.588410 29706 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.592559 29631 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.593947 29522 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:54.594735 29844 raft_consensus.cc:2804] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.594875 29706 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.595180 29844 raft_consensus.cc:697] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:54.595999 29844 consensus_queue.cc:237] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.601862 29453 catalog_manager.cc:5697] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 2 to 3, leader changed from 59d0cac429dc4f128296b97ae473f402 (127.28.62.131) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.605600 29754 raft_consensus.cc:993] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: : Instructing follower 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.606069 29754 raft_consensus.cc:1081] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Signalling peer 34b05fa5f2a646959fd1dd091da57092 to start an election
I20260709 13:10:54.607591 29557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
 from {username='slave'} at 127.0.0.1:37270
I20260709 13:10:54.608075 29557 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:54.608408 29557 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.613911 29557 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.615325 29557 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Requested vote from peers ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:54.616370 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:54.616489 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "34b05fa5f2a646959fd1dd091da57092" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:54.617120 29631 raft_consensus.cc:3055] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.617209 29706 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.617556 29631 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:54.618374 29631 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.619575 29631 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.625250 29706 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.626546 29524 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34b05fa5f2a646959fd1dd091da57092, 59d0cac429dc4f128296b97ae473f402; no voters: 
I20260709 13:10:54.626996 29631 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34b05fa5f2a646959fd1dd091da57092 in term 3.
I20260709 13:10:54.627509 29844 raft_consensus.cc:2804] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:54.628012 29844 raft_consensus.cc:697] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Becoming Leader. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:54.628804 29844 consensus_queue.cc:237] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:54.635761 29453 catalog_manager.cc:5697] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 reported cstate change: term changed from 2 to 3, leader changed from ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130) to 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34b05fa5f2a646959fd1dd091da57092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.863981 29631 raft_consensus.cc:1275] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:54.865455 29844 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.874292 29706 raft_consensus.cc:1275] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:54.875828 29844 consensus_queue.cc:1048] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.879655 29633 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:54.880939 29861 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.882562 29707 raft_consensus.cc:1275] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.884171 29844 consensus_queue.cc:1048] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.914466 29706 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:54.915939 29875 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:54.923484 29631 raft_consensus.cc:1275] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.924744 29861 consensus_queue.cc:1048] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.042469 29631 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.044734 29861 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.045619 29707 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.047233 29875 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.055619 29633 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.058367 29844 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.065572 29706 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Refusing update from remote peer 34b05fa5f2a646959fd1dd091da57092: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.070358 29844 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.262317 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.270515 29557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:57.271291 29557 raft_consensus.cc:606] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Received request to transfer leadership to TS 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:57.274276 29557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:57.274823 29557 raft_consensus.cc:606] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 LEADER]: Received request to transfer leadership to TS ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:57.277585 29558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:57.278111 29558 raft_consensus.cc:606] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Received request to transfer leadership to TS ce34c4fcb73549fe9bf9595ffeaef339
I20260709 13:10:57.281240 29558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
mode: GRACEFUL
new_leader_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:37286
I20260709 13:10:57.281795 29558 raft_consensus.cc:606] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Received request to transfer leadership to TS 59d0cac429dc4f128296b97ae473f402
I20260709 13:10:57.282877 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:57.283344 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:57.349375 29876 raft_consensus.cc:993] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:57.349879 29876 raft_consensus.cc:1081] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Signalling peer 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:57.351505 29706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:40878
I20260709 13:10:57.352041 29706 raft_consensus.cc:493] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.352380 29706 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.357904 29706 raft_consensus.cc:515] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.359781 29706 leader_election.cc:290] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 4 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:57.361044 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:57.361320 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "851b85327b1f47ee8c19d1b5c1e3680e" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:57.361660 29631 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.362093 29558 raft_consensus.cc:3055] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.362416 29558 raft_consensus.cc:740] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:57.363246 29558 consensus_queue.cc:260] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.364351 29558 raft_consensus.cc:3060] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.367457 29631 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 4.
I20260709 13:10:57.369020 29671 leader_election.cc:304] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:57.370134 29789 raft_consensus.cc:2804] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:57.371003 29558 raft_consensus.cc:2468] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 4.
I20260709 13:10:57.371269 29789 raft_consensus.cc:697] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 4 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:57.372403 29789 consensus_queue.cc:237] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.380076 29453 catalog_manager.cc:5697] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 3 to 4, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 4 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.505863 29861 raft_consensus.cc:993] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:57.506439 29876 raft_consensus.cc:1081] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 LEADER]: Signalling peer ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:57.508008 29631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:10:57.508563 29631 raft_consensus.cc:493] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.508908 29631 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.513523 29631 raft_consensus.cc:515] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:57.515154 29631 leader_election.cc:290] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 5 election: Requested vote from peers 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803), 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449)
I20260709 13:10:57.516217 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:57.516427 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d2cfeebf244adab350f93dff36a1ff" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:57.516949 29706 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.517091 29558 raft_consensus.cc:3055] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:57.517606 29558 raft_consensus.cc:740] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:57.518462 29558 consensus_queue.cc:260] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:57.519737 29558 raft_consensus.cc:3060] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.523311 29706 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 5.
I20260709 13:10:57.524650 29599 leader_election.cc:304] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:57.525516 29754 raft_consensus.cc:2804] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:57.527294 29754 raft_consensus.cc:697] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 5 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:57.528355 29558 raft_consensus.cc:2468] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 5.
I20260709 13:10:57.528661 29754 consensus_queue.cc:237] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } }
I20260709 13:10:57.537097 29453 catalog_manager.cc:5697] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 4 to 5, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 5 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.581239 29861 raft_consensus.cc:993] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:57.581718 29876 raft_consensus.cc:1081] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Signalling peer 59d0cac429dc4f128296b97ae473f402 to start an election
I20260709 13:10:57.583256 29706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df"
dest_uuid: "59d0cac429dc4f128296b97ae473f402"
 from {username='slave'} at 127.0.0.1:40878
I20260709 13:10:57.583927 29706 raft_consensus.cc:493] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.584355 29706 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.586256 29861 raft_consensus.cc:993] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: : Instructing follower ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:57.586704 29876 raft_consensus.cc:1081] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Signalling peer ce34c4fcb73549fe9bf9595ffeaef339 to start an election
I20260709 13:10:57.588330 29633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0"
dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
 from {username='slave'} at 127.0.0.1:34228
I20260709 13:10:57.588866 29633 raft_consensus.cc:493] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.589205 29633 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.590129 29706 raft_consensus.cc:515] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.591842 29706 leader_election.cc:290] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 4 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130:38273)
I20260709 13:10:57.592844 29558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:57.593456 29558 raft_consensus.cc:3055] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.593753 29558 raft_consensus.cc:740] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:57.594090 29631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e688823ed552416e96f1ef140cbad7df" candidate_uuid: "59d0cac429dc4f128296b97ae473f402" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce34c4fcb73549fe9bf9595ffeaef339"
I20260709 13:10:57.594596 29631 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.594547 29558 consensus_queue.cc:260] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.595992 29558 raft_consensus.cc:3060] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.596024 29633 raft_consensus.cc:515] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.598259 29633 leader_election.cc:290] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 3 election: Requested vote from peers 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449), 59d0cac429dc4f128296b97ae473f402 (127.28.62.131:35803)
I20260709 13:10:57.599469 29557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34b05fa5f2a646959fd1dd091da57092"
I20260709 13:10:57.600090 29557 raft_consensus.cc:3055] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:57.600426 29557 raft_consensus.cc:740] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34b05fa5f2a646959fd1dd091da57092, State: Running, Role: LEADER
I20260709 13:10:57.601197 29706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0748528444a435ca705babc2e94b6a0" candidate_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59d0cac429dc4f128296b97ae473f402"
I20260709 13:10:57.601329 29631 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 4.
I20260709 13:10:57.601274 29557 consensus_queue.cc:260] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.602041 29706 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.602682 29671 leader_election.cc:304] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:57.602932 29557 raft_consensus.cc:3060] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.603375 29558 raft_consensus.cc:2468] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59d0cac429dc4f128296b97ae473f402 in term 4.
I20260709 13:10:57.603626 29789 raft_consensus.cc:2804] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:57.604121 29789 raft_consensus.cc:697] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 4 LEADER]: Becoming Leader. State: Replica: 59d0cac429dc4f128296b97ae473f402, State: Running, Role: LEADER
I20260709 13:10:57.604890 29789 consensus_queue.cc:237] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.611569 29706 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 3.
I20260709 13:10:57.612982 29599 leader_election.cc:304] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d0cac429dc4f128296b97ae473f402, ce34c4fcb73549fe9bf9595ffeaef339; no voters: 
I20260709 13:10:57.613816 29890 raft_consensus.cc:2804] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.613927 29557 raft_consensus.cc:2468] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce34c4fcb73549fe9bf9595ffeaef339 in term 3.
I20260709 13:10:57.613248 29453 catalog_manager.cc:5697] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 reported cstate change: term changed from 3 to 4, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to 59d0cac429dc4f128296b97ae473f402 (127.28.62.131). New cstate: current_term: 4 leader_uuid: "59d0cac429dc4f128296b97ae473f402" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.614399 29890 raft_consensus.cc:697] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 LEADER]: Becoming Leader. State: Replica: ce34c4fcb73549fe9bf9595ffeaef339, State: Running, Role: LEADER
I20260709 13:10:57.615410 29890 consensus_queue.cc:237] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } }
I20260709 13:10:57.624648 29454 catalog_manager.cc:5697] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 reported cstate change: term changed from 2 to 3, leader changed from 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129) to ce34c4fcb73549fe9bf9595ffeaef339 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.756835 29557 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:57.758129 29789 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.768460 29631 raft_consensus.cc:1275] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:57.770208 29897 consensus_queue.cc:1048] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:57.966315 29706 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 5 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:57.967722 29890 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.977639 29557 raft_consensus.cc:1275] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 5 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:57.979911 29754 consensus_queue.cc:1048] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:57.991497 29557 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:57.992931 29897 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:58.002722 29631 raft_consensus.cc:1275] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Refusing update from remote peer 59d0cac429dc4f128296b97ae473f402: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:58.004812 29884 consensus_queue.cc:1048] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce34c4fcb73549fe9bf9595ffeaef339" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:58.006894 29706 raft_consensus.cc:1275] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.008790 29754 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d0cac429dc4f128296b97ae473f402" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.020783 29557 raft_consensus.cc:1275] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Refusing update from remote peer ce34c4fcb73549fe9bf9595ffeaef339: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.022742 29890 consensus_queue.cc:1048] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34b05fa5f2a646959fd1dd091da57092" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 36449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.284237 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.290362 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:10:58.315951 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:58.316977 28922 tablet_replica.cc:333] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.317984 28922 raft_consensus.cc:2243] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:58.318058 29599 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:10:58.319187 28922 raft_consensus.cc:2272] T 58045c6b3eba4ec99091f66e877033f6 P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.321874 29599 consensus_peers.cc:597] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 -> Peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Couldn't send request to peer 34b05fa5f2a646959fd1dd091da57092. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.322203 28922 tablet_replica.cc:333] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.322860 28922 raft_consensus.cc:2243] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.323698 28922 raft_consensus.cc:2272] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.325711 28922 tablet_replica.cc:333] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.326253 28922 raft_consensus.cc:2243] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.326679 28922 raft_consensus.cc:2272] T 851b85327b1f47ee8c19d1b5c1e3680e P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.329012 28922 tablet_replica.cc:333] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.329618 28922 raft_consensus.cc:2243] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.330506 28922 raft_consensus.cc:2272] T 038c8dba18d54dddb8e7323e80c62a67 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.332320 28922 tablet_replica.cc:333] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.332831 28922 raft_consensus.cc:2243] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.333251 28922 raft_consensus.cc:2272] T 2acaf0d894514a29921b551dfc70507a P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.334924 28922 tablet_replica.cc:333] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.335469 28922 raft_consensus.cc:2243] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.335889 28922 raft_consensus.cc:2272] T b8d2cfeebf244adab350f93dff36a1ff P 34b05fa5f2a646959fd1dd091da57092 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.338258 28922 tablet_replica.cc:333] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.338938 28922 raft_consensus.cc:2243] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.339394 28922 raft_consensus.cc:2272] T e688823ed552416e96f1ef140cbad7df P 34b05fa5f2a646959fd1dd091da57092 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.341491 28922 tablet_replica.cc:333] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.342061 28922 raft_consensus.cc:2243] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.342948 28922 raft_consensus.cc:2272] T bf211aa8d7ce43b9a62dfe0f2e328083 P 34b05fa5f2a646959fd1dd091da57092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.344856 28922 tablet_replica.cc:333] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.345409 28922 raft_consensus.cc:2243] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.345856 28922 raft_consensus.cc:2272] T 2e3a1dd815f54e64b17a397077e932eb P 34b05fa5f2a646959fd1dd091da57092 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.347527 28922 tablet_replica.cc:333] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092: stopping tablet replica
I20260709 13:10:58.347988 28922 raft_consensus.cc:2243] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.348387 28922 raft_consensus.cc:2272] T d0748528444a435ca705babc2e94b6a0 P 34b05fa5f2a646959fd1dd091da57092 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.369509 29673 consensus_peers.cc:597] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 -> Peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Couldn't send request to peer 34b05fa5f2a646959fd1dd091da57092. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:36449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.371176 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:10:58.378852 29673 consensus_peers.cc:597] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 -> Peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Couldn't send request to peer 34b05fa5f2a646959fd1dd091da57092. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:36449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.392026 29599 consensus_peers.cc:597] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 -> Peer 34b05fa5f2a646959fd1dd091da57092 (127.28.62.129:36449): Couldn't send request to peer 34b05fa5f2a646959fd1dd091da57092. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:36449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.400302 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:10:58.425117 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:58.426000 28922 tablet_replica.cc:333] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.426607 28922 raft_consensus.cc:2243] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.427192 28922 raft_consensus.cc:2272] T bf211aa8d7ce43b9a62dfe0f2e328083 P ce34c4fcb73549fe9bf9595ffeaef339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.429301 28922 tablet_replica.cc:333] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.429989 28922 raft_consensus.cc:2243] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.430444 28922 raft_consensus.cc:2272] T e688823ed552416e96f1ef140cbad7df P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.432698 28922 tablet_replica.cc:333] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.433240 28922 raft_consensus.cc:2243] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.433730 28922 raft_consensus.cc:2272] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.435621 28922 tablet_replica.cc:333] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.436132 28922 raft_consensus.cc:2243] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.436569 28922 raft_consensus.cc:2272] T 2e3a1dd815f54e64b17a397077e932eb P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.438342 28922 tablet_replica.cc:333] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.438777 28922 raft_consensus.cc:2243] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.439146 28922 raft_consensus.cc:2272] T 038c8dba18d54dddb8e7323e80c62a67 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.440889 28922 tablet_replica.cc:333] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.441438 28922 raft_consensus.cc:2243] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.442536 28922 raft_consensus.cc:2272] T 2acaf0d894514a29921b551dfc70507a P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.445060 28922 tablet_replica.cc:333] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.445629 28922 raft_consensus.cc:2243] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.446310 28922 raft_consensus.cc:2272] T b8d2cfeebf244adab350f93dff36a1ff P ce34c4fcb73549fe9bf9595ffeaef339 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.448338 28922 tablet_replica.cc:333] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.448789 28922 raft_consensus.cc:2243] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.449167 28922 raft_consensus.cc:2272] T 851b85327b1f47ee8c19d1b5c1e3680e P ce34c4fcb73549fe9bf9595ffeaef339 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.451397 28922 tablet_replica.cc:333] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.451880 28922 raft_consensus.cc:2243] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.452235 28922 raft_consensus.cc:2272] T 58045c6b3eba4ec99091f66e877033f6 P ce34c4fcb73549fe9bf9595ffeaef339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.453896 28922 tablet_replica.cc:333] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339: stopping tablet replica
I20260709 13:10:58.454313 28922 raft_consensus.cc:2243] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.455281 28922 raft_consensus.cc:2272] T d0748528444a435ca705babc2e94b6a0 P ce34c4fcb73549fe9bf9595ffeaef339 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.484544 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
I20260709 13:10:58.503074 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
I20260709 13:10:58.526782 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:58.527503 28922 tablet_replica.cc:333] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.528213 28922 raft_consensus.cc:2243] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.529055 28922 raft_consensus.cc:2272] T 851b85327b1f47ee8c19d1b5c1e3680e P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.531391 28922 tablet_replica.cc:333] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.531977 28922 raft_consensus.cc:2243] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.532764 28922 raft_consensus.cc:2272] T 2e3a1dd815f54e64b17a397077e932eb P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.534835 28922 tablet_replica.cc:333] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.535480 28922 raft_consensus.cc:2243] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.536027 28922 raft_consensus.cc:2272] T 8c601f3e0a0d4fd5a7ba7d41ee9eb6cf P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.537914 28922 tablet_replica.cc:333] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.538470 28922 raft_consensus.cc:2243] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.538934 28922 raft_consensus.cc:2272] T b8d2cfeebf244adab350f93dff36a1ff P 59d0cac429dc4f128296b97ae473f402 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.541244 28922 tablet_replica.cc:333] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.541894 28922 raft_consensus.cc:2243] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.542353 28922 raft_consensus.cc:2272] T 2acaf0d894514a29921b551dfc70507a P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.544096 28922 tablet_replica.cc:333] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.544713 28922 raft_consensus.cc:2243] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.545147 28922 raft_consensus.cc:2272] T bf211aa8d7ce43b9a62dfe0f2e328083 P 59d0cac429dc4f128296b97ae473f402 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.546972 28922 tablet_replica.cc:333] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.547499 28922 raft_consensus.cc:2243] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.548229 28922 raft_consensus.cc:2272] T e688823ed552416e96f1ef140cbad7df P 59d0cac429dc4f128296b97ae473f402 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.550324 28922 tablet_replica.cc:333] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.550854 28922 raft_consensus.cc:2243] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.551291 28922 raft_consensus.cc:2272] T 038c8dba18d54dddb8e7323e80c62a67 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.553011 28922 tablet_replica.cc:333] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.553610 28922 raft_consensus.cc:2243] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.554037 28922 raft_consensus.cc:2272] T d0748528444a435ca705babc2e94b6a0 P 59d0cac429dc4f128296b97ae473f402 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.556267 28922 tablet_replica.cc:333] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402: stopping tablet replica
I20260709 13:10:58.556790 28922 raft_consensus.cc:2243] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.557262 28922 raft_consensus.cc:2272] T 58045c6b3eba4ec99091f66e877033f6 P 59d0cac429dc4f128296b97ae473f402 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.587023 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:10:58.605822 28922 master.cc:562] Master@127.28.62.190:38729 shutting down...
I20260709 13:10:58.627473 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.628237 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.628623 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 12d435549f474ebea16d852db7bfd41b: stopping tablet replica
I20260709 13:10:58.651512 28922 master.cc:584] Master@127.28.62.190:38729 shutdown complete.
34b05fa5f2a646959fd1dd091da57092  5
59d0cac429dc4f128296b97ae473f402  1
ce34c4fcb73549fe9bf9595ffeaef339  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10672 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:10:58.695416 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:37953
I20260709 13:10:58.696587 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:58.703485 29912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:58.703383 29911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:58.703639 29914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:58.704989 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:58.706067 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:58.706257 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:58.706458 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602658706438 us; error 0 us; skew 500 ppm
I20260709 13:10:58.707007 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:58.710038 28922 webserver.cc:533] Webserver started at http://127.28.62.190:33531/ using document root <none> and password file <none>
I20260709 13:10:58.710587 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:58.710785 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:58.711086 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:58.712551 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "5ee583f4769f453a90eb7fcae5ac930b"
format_stamp: "Formatted at 2026-07-09 13:10:58 on dist-test-slave-50cs"
I20260709 13:10:58.717816 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:10:58.721587 29919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:58.722527 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:58.722852 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "5ee583f4769f453a90eb7fcae5ac930b"
format_stamp: "Formatted at 2026-07-09 13:10:58 on dist-test-slave-50cs"
I20260709 13:10:58.723174 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:58.750645 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:58.751929 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:58.798221 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:37953
I20260709 13:10:58.798267 29970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:37953 every 8 connection(s)
I20260709 13:10:58.803407 29971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.814379 29971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Bootstrap starting.
I20260709 13:10:58.819736 29971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:58.824776 29971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: No bootstrap required, opened a new log
I20260709 13:10:58.827103 29971 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER }
I20260709 13:10:58.827499 29971 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:58.827782 29971 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ee583f4769f453a90eb7fcae5ac930b, State: Initialized, Role: FOLLOWER
I20260709 13:10:58.828445 29971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER }
I20260709 13:10:58.828924 29971 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:58.829169 29971 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:58.829473 29971 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:58.834355 29971 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER }
I20260709 13:10:58.834980 29971 leader_election.cc:304] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ee583f4769f453a90eb7fcae5ac930b; no voters: 
I20260709 13:10:58.836288 29971 leader_election.cc:290] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:58.836786 29974 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:58.838303 29974 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 1 LEADER]: Becoming Leader. State: Replica: 5ee583f4769f453a90eb7fcae5ac930b, State: Running, Role: LEADER
I20260709 13:10:58.839041 29974 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER }
I20260709 13:10:58.839370 29971 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:58.844161 29976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ee583f4769f453a90eb7fcae5ac930b. Latest consensus state: current_term: 1 leader_uuid: "5ee583f4769f453a90eb7fcae5ac930b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER } }
I20260709 13:10:58.844296 29975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ee583f4769f453a90eb7fcae5ac930b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ee583f4769f453a90eb7fcae5ac930b" member_type: VOTER } }
I20260709 13:10:58.844926 29975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:58.844918 29976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:58.847854 29981 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:58.856475 29981 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:58.857489 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:58.865830 29981 catalog_manager.cc:1383] Generated new cluster ID: 3cfcd59d708c428f8393c577d97a6222
I20260709 13:10:58.866173 29981 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:58.895800 29981 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:58.897270 29981 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:58.910809 29981 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Generated new TSK 0
I20260709 13:10:58.911957 29981 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:58.926122 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:58.932484 29992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:58.933485 29993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:58.935230 29995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:58.935622 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:58.936502 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:58.936726 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:58.936875 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602658936863 us; error 0 us; skew 500 ppm
I20260709 13:10:58.937450 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:58.940212 28922 webserver.cc:533] Webserver started at http://127.28.62.129:39579/ using document root <none> and password file <none>
I20260709 13:10:58.940795 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:58.941023 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:58.941493 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:58.942752 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "34f51764a89048468a6faa21020812b0"
format_stamp: "Formatted at 2026-07-09 13:10:58 on dist-test-slave-50cs"
I20260709 13:10:58.948355 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:58.952903 30000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:58.953796 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:58.954116 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "34f51764a89048468a6faa21020812b0"
format_stamp: "Formatted at 2026-07-09 13:10:58 on dist-test-slave-50cs"
I20260709 13:10:58.954396 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:58.976272 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:58.977677 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:58.979321 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:58.982350 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:58.982693 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:58.982978 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:58.983166 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.027081 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:39437
I20260709 13:10:59.027199 30062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:39437 every 8 connection(s)
I20260709 13:10:59.032240 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:59.040027 30067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:59.040473 30068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:59.042721 30070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:59.044327 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:59.045213 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:59.045506 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:59.045650 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602659045637 us; error 0 us; skew 500 ppm
I20260709 13:10:59.046119 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:59.049203 28922 webserver.cc:533] Webserver started at http://127.28.62.130:34149/ using document root <none> and password file <none>
I20260709 13:10:59.050030 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:59.050315 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:59.050702 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:59.051962 30063 heartbeater.cc:344] Connected to a master server at 127.28.62.190:37953
I20260709 13:10:59.052449 30063 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:59.052598 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "98b3b699b87245df85d3aa84c13f5691"
format_stamp: "Formatted at 2026-07-09 13:10:59 on dist-test-slave-50cs"
I20260709 13:10:59.053691 30063 heartbeater.cc:507] Master 127.28.62.190:37953 requested a full tablet report, sending...
I20260709 13:10:59.056926 29936 ts_manager.cc:194] Registered new tserver with Master: 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:10:59.059194 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:59.059294 29936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59056
I20260709 13:10:59.063877 30075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.064653 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:59.064965 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "98b3b699b87245df85d3aa84c13f5691"
format_stamp: "Formatted at 2026-07-09 13:10:59 on dist-test-slave-50cs"
I20260709 13:10:59.065224 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:59.081904 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:59.083309 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:59.085143 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:59.087594 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:59.087848 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.088094 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:59.088265 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.131335 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:38581
I20260709 13:10:59.131433 30137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:38581 every 8 connection(s)
I20260709 13:10:59.136806 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:59.144659 30141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:59.156342 30142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:59.157236 28922 server_base.cc:1061] running on GCE node
I20260709 13:10:59.157987 30138 heartbeater.cc:344] Connected to a master server at 127.28.62.190:37953
I20260709 13:10:59.158428 30138 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:59.158620 30144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:59.159407 30138 heartbeater.cc:507] Master 127.28.62.190:37953 requested a full tablet report, sending...
I20260709 13:10:59.159816 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:59.160086 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:59.160270 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602659160254 us; error 0 us; skew 500 ppm
I20260709 13:10:59.160869 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:59.161664 29936 ts_manager.cc:194] Registered new tserver with Master: 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:10:59.163231 29936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59070
I20260709 13:10:59.163656 28922 webserver.cc:533] Webserver started at http://127.28.62.131:43165/ using document root <none> and password file <none>
I20260709 13:10:59.164211 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:59.164431 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:59.164712 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:59.165977 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "ef9ab4d665234a799376bf42ef5d058c"
format_stamp: "Formatted at 2026-07-09 13:10:59 on dist-test-slave-50cs"
I20260709 13:10:59.170522 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:10:59.174144 30149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.175256 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:59.175632 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "ef9ab4d665234a799376bf42ef5d058c"
format_stamp: "Formatted at 2026-07-09 13:10:59 on dist-test-slave-50cs"
I20260709 13:10:59.175982 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:59.205786 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:59.207206 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:59.208827 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:59.211408 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:59.211668 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.211954 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:59.212158 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:59.258025 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:36297
I20260709 13:10:59.258152 30211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:36297 every 8 connection(s)
I20260709 13:10:59.273337 30212 heartbeater.cc:344] Connected to a master server at 127.28.62.190:37953
I20260709 13:10:59.273958 30212 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:59.274863 30212 heartbeater.cc:507] Master 127.28.62.190:37953 requested a full tablet report, sending...
I20260709 13:10:59.277247 29936 ts_manager.cc:194] Registered new tserver with Master: ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:10:59.277779 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016191199s
I20260709 13:10:59.278944 29936 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59080
I20260709 13:10:59.306813 29936 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59090:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:59.313057 29936 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:59.529105 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 74c6f7e90c624b64bdbb67860d561418 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:59.530670 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c6f7e90c624b64bdbb67860d561418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.532044 30101 tablet_service.cc:1511] Processing CreateTablet for tablet e0f2e33addec48d89bb483d29ce55ad4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:59.532039 30102 tablet_service.cc:1511] Processing CreateTablet for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:59.533535 30101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f2e33addec48d89bb483d29ce55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.534564 30174 tablet_service.cc:1511] Processing CreateTablet for tablet 9d12004749df410ea5dcce097780c358 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:59.535945 30174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d12004749df410ea5dcce097780c358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.538098 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 88e3e05564894b51b12ceb093978f695 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:59.538901 30175 tablet_service.cc:1511] Processing CreateTablet for tablet e0f2e33addec48d89bb483d29ce55ad4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:59.539968 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e3e05564894b51b12ceb093978f695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.540740 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f2e33addec48d89bb483d29ce55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.543046 30176 tablet_service.cc:1511] Processing CreateTablet for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:59.544883 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.547078 30177 tablet_service.cc:1511] Processing CreateTablet for tablet 74c6f7e90c624b64bdbb67860d561418 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:59.549125 30102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.552112 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 9d12004749df410ea5dcce097780c358 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:59.553547 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d12004749df410ea5dcce097780c358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.554029 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c6f7e90c624b64bdbb67860d561418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.558525 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 88e3e05564894b51b12ceb093978f695 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:59.560160 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e3e05564894b51b12ceb093978f695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.563001 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 39df33df3e0d43b5a35e334a03324f92 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:59.564968 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39df33df3e0d43b5a35e334a03324f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.567605 30171 tablet_service.cc:1511] Processing CreateTablet for tablet e06bbfa07cb545c8b65a4a6f1dae9516 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:59.569022 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e06bbfa07cb545c8b65a4a6f1dae9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.570420 30097 tablet_service.cc:1511] Processing CreateTablet for tablet e06bbfa07cb545c8b65a4a6f1dae9516 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:59.571835 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e06bbfa07cb545c8b65a4a6f1dae9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.574200 30098 tablet_service.cc:1511] Processing CreateTablet for tablet 39df33df3e0d43b5a35e334a03324f92 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:59.575626 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39df33df3e0d43b5a35e334a03324f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.580295 30096 tablet_service.cc:1511] Processing CreateTablet for tablet dadd68eba45b4971b4072c8ef0de88d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:59.582343 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd68eba45b4971b4072c8ef0de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.603879 30170 tablet_service.cc:1511] Processing CreateTablet for tablet dadd68eba45b4971b4072c8ef0de88d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:59.605370 30170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd68eba45b4971b4072c8ef0de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.611099 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 9d12004749df410ea5dcce097780c358 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:59.612308 30028 tablet_service.cc:1511] Processing CreateTablet for tablet 74c6f7e90c624b64bdbb67860d561418 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:59.613034 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d12004749df410ea5dcce097780c358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.614703 30027 tablet_service.cc:1511] Processing CreateTablet for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:59.614959 30024 tablet_service.cc:1511] Processing CreateTablet for tablet 88e3e05564894b51b12ceb093978f695 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:59.617388 30023 tablet_service.cc:1511] Processing CreateTablet for tablet 39df33df3e0d43b5a35e334a03324f92 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:59.616572 30026 tablet_service.cc:1511] Processing CreateTablet for tablet e0f2e33addec48d89bb483d29ce55ad4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:59.623109 30021 tablet_service.cc:1511] Processing CreateTablet for tablet dadd68eba45b4971b4072c8ef0de88d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:59.620594 30022 tablet_service.cc:1511] Processing CreateTablet for tablet e06bbfa07cb545c8b65a4a6f1dae9516 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:59.629791 30028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c6f7e90c624b64bdbb67860d561418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.630544 30021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd68eba45b4971b4072c8ef0de88d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.631302 30026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f2e33addec48d89bb483d29ce55ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.633070 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.633901 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e06bbfa07cb545c8b65a4a6f1dae9516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.641538 30023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39df33df3e0d43b5a35e334a03324f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.643953 30024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e3e05564894b51b12ceb093978f695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.663139 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 15751030df864f9c84e3d822bc8b63e3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:59.665015 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15751030df864f9c84e3d822bc8b63e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.684998 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 15751030df864f9c84e3d822bc8b63e3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:59.687148 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15751030df864f9c84e3d822bc8b63e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.699482 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 15751030df864f9c84e3d822bc8b63e3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:59.710296 30019 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b7d91eea54fb4990789f41041df86 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:59.712060 30019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b7d91eea54fb4990789f41041df86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.717044 30097 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b7d91eea54fb4990789f41041df86 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:59.718587 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b7d91eea54fb4990789f41041df86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.727675 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15751030df864f9c84e3d822bc8b63e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.730871 30227 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:10:59.745827 30177 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b7d91eea54fb4990789f41041df86 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:59.752416 30171 tablet_service.cc:1511] Processing CreateTablet for tablet 3facd19034dd44899de7471297d45bbc (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:59.752779 30096 tablet_service.cc:1511] Processing CreateTablet for tablet 3facd19034dd44899de7471297d45bbc (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:59.756109 30028 tablet_service.cc:1511] Processing CreateTablet for tablet 6920367ae7ee4f54a639b9db0e071e84 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:59.760918 30227 tablet_bootstrap.cc:654] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:59.760738 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 6920367ae7ee4f54a639b9db0e071e84 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:59.765043 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 6920367ae7ee4f54a639b9db0e071e84 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:59.774471 30028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6920367ae7ee4f54a639b9db0e071e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.775761 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b7d91eea54fb4990789f41041df86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.778352 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3facd19034dd44899de7471297d45bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.771078 30027 tablet_service.cc:1511] Processing CreateTablet for tablet b7a9a88da98d43b8a556cba3e2768e28 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:59.779500 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a9a88da98d43b8a556cba3e2768e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.774425 30175 tablet_service.cc:1511] Processing CreateTablet for tablet b7a9a88da98d43b8a556cba3e2768e28 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:59.776731 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 3facd19034dd44899de7471297d45bbc (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:59.780074 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3facd19034dd44899de7471297d45bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.770669 30099 tablet_service.cc:1511] Processing CreateTablet for tablet b7a9a88da98d43b8a556cba3e2768e28 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:59.781576 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6920367ae7ee4f54a639b9db0e071e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.782384 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6920367ae7ee4f54a639b9db0e071e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.783097 30228 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:10:59.783139 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 82bd288ed43e47fbabdbcfbfaca06dfb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:59.794108 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3facd19034dd44899de7471297d45bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.793943 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 82bd288ed43e47fbabdbcfbfaca06dfb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:59.799782 30229 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:10:59.800895 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a9a88da98d43b8a556cba3e2768e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.801515 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bd288ed43e47fbabdbcfbfaca06dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.806209 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 82bd288ed43e47fbabdbcfbfaca06dfb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:59.811874 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a9a88da98d43b8a556cba3e2768e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.814540 30227 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:10:59.815052 30227 ts_tablet_manager.cc:1403] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.001s
I20260709 13:10:59.816036 30229 tablet_bootstrap.cc:654] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:59.816618 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bd288ed43e47fbabdbcfbfaca06dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.816993 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 813e1f3ea7f7411c9c6061753e927dfe (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:59.818264 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e1f3ea7f7411c9c6061753e927dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.824465 30227 raft_consensus.cc:359] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:10:59.832108 30227 raft_consensus.cc:385] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:59.832727 30227 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:10:59.834093 30227 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:10:59.845345 30228 tablet_bootstrap.cc:654] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:59.849442 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bd288ed43e47fbabdbcfbfaca06dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.851279 30227 ts_tablet_manager.cc:1434] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.036s	user 0.017s	sys 0.008s
W20260709 13:10:59.852627 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:59.854769 30228 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:10:59.855397 30228 ts_tablet_manager.cc:1403] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.004s
I20260709 13:10:59.858819 30228 raft_consensus.cc:359] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:10:59.859664 30228 raft_consensus.cc:385] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:59.860055 30228 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:10:59.861522 30228 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:10:59.863817 30212 heartbeater.cc:499] Master 127.28.62.190:37953 was elected leader, sending a full tablet report...
I20260709 13:10:59.865717 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 813e1f3ea7f7411c9c6061753e927dfe (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:59.866250 30227 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:10:59.867110 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e1f3ea7f7411c9c6061753e927dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.867372 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 4c91803ea87d43adb17baf51a5093b3c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:59.868696 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c91803ea87d43adb17baf51a5093b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.873245 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 813e1f3ea7f7411c9c6061753e927dfe (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:59.874754 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e1f3ea7f7411c9c6061753e927dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.887889 30229 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:10:59.888427 30229 ts_tablet_manager.cc:1403] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.089s	user 0.033s	sys 0.008s
I20260709 13:10:59.915374 30096 tablet_service.cc:1511] Processing CreateTablet for tablet 4c91803ea87d43adb17baf51a5093b3c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:59.916978 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c91803ea87d43adb17baf51a5093b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.915774 30227 tablet_bootstrap.cc:654] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:59.929143 30138 heartbeater.cc:499] Master 127.28.62.190:37953 was elected leader, sending a full tablet report...
I20260709 13:10:59.933858 30234 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.937465 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 4c91803ea87d43adb17baf51a5093b3c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:59.940477 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c91803ea87d43adb17baf51a5093b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.942291 30229 raft_consensus.cc:359] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:10:59.943113 30229 raft_consensus.cc:385] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:59.943450 30229 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:10:59.944262 30229 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:10:59.934535 30234 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:10:59.955960 30228 ts_tablet_manager.cc:1434] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.100s	user 0.016s	sys 0.023s
I20260709 13:10:59.965540 30234 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:10:59.957690 30228 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:10:59.975731 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 0c855bd93d50418aa0aec7a1a3c2e228 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:59.977293 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c855bd93d50418aa0aec7a1a3c2e228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.979563 30227 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:10:59.980141 30227 ts_tablet_manager.cc:1403] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.114s	user 0.007s	sys 0.008s
I20260709 13:10:59.982993 30228 tablet_bootstrap.cc:654] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:59.983239 30227 raft_consensus.cc:359] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:10:59.983999 30227 raft_consensus.cc:385] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:59.984328 30227 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:10:59.989276 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 76d91f22e2654dd1ae5451605e7a3b23 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:59.985105 30227 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:10:59.992442 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d91f22e2654dd1ae5451605e7a3b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.004515 30229 ts_tablet_manager.cc:1434] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.020s
I20260709 13:11:00.002640 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 0c855bd93d50418aa0aec7a1a3c2e228 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:00.005460 30063 heartbeater.cc:499] Master 127.28.62.190:37953 was elected leader, sending a full tablet report...
I20260709 13:11:00.005679 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c855bd93d50418aa0aec7a1a3c2e228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.021556 30237 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.022276 30237 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.005656 30229 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:00.042234 30229 tablet_bootstrap.cc:654] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.045109 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31c2ecc47149adb9b7dd839def365c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:00.047148 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31c2ecc47149adb9b7dd839def365c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.048193 30227 ts_tablet_manager.cc:1434] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:11:00.049314 30227 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.055486 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 76d91f22e2654dd1ae5451605e7a3b23 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:00.057029 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d91f22e2654dd1ae5451605e7a3b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.058266 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 76d91f22e2654dd1ae5451605e7a3b23 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:00.059790 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d91f22e2654dd1ae5451605e7a3b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.061324 30096 tablet_service.cc:1511] Processing CreateTablet for tablet 0c855bd93d50418aa0aec7a1a3c2e228 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:00.062300 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.062656 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c855bd93d50418aa0aec7a1a3c2e228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.062996 30187 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:00.064632 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:00.065683 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31c2ecc47149adb9b7dd839def365c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:00.066982 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31c2ecc47149adb9b7dd839def365c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.067346 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31c2ecc47149adb9b7dd839def365c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:00.068627 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31c2ecc47149adb9b7dd839def365c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.069605 30234 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:00.070060 30234 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.069706 30027 tablet_service.cc:1511] Processing CreateTablet for tablet 34df6751216d4ac584919e5640b25bc4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:00.070446 30234 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.071564 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df6751216d4ac584919e5640b25bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.103744 30228 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:00.104317 30228 ts_tablet_manager.cc:1403] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.147s	user 0.008s	sys 0.008s
I20260709 13:11:00.098794 30237 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.091320 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:00.117746 30077 leader_election.cc:343] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.120287 30228 raft_consensus.cc:359] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.122682 30228 raft_consensus.cc:385] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.123124 30228 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.124203 30228 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.127260 30227 tablet_bootstrap.cc:654] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.127540 30228 ts_tablet_manager.cc:1434] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:11:00.128639 30228 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:00.143064 30229 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:00.143784 30229 ts_tablet_manager.cc:1403] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.138s	user 0.020s	sys 0.003s
I20260709 13:11:00.143836 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 34df6751216d4ac584919e5640b25bc4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:00.145222 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df6751216d4ac584919e5640b25bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.149276 30229 raft_consensus.cc:359] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.150436 30229 raft_consensus.cc:385] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.150836 30229 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.152050 30229 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.152850 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 34df6751216d4ac584919e5640b25bc4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:00.154268 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df6751216d4ac584919e5640b25bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.155418 30229 ts_tablet_manager.cc:1434] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.001s
I20260709 13:11:00.157202 30229 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:00.159904 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 7a672a61589048279810adba842422a0 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:00.162382 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a672a61589048279810adba842422a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.133610 30234 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:11:00.184284 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:00.184945 30187 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.199717 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 7a672a61589048279810adba842422a0 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:00.214466 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a672a61589048279810adba842422a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.218324 30227 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:00.218926 30227 ts_tablet_manager.cc:1403] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.170s	user 0.050s	sys 0.039s
I20260709 13:11:00.219390 30237 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.219936 30237 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.222167 30237 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.221979 30227 raft_consensus.cc:359] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.222734 30227 raft_consensus.cc:385] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.223047 30227 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.223769 30227 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.224795 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 7a672a61589048279810adba842422a0 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:00.226377 30227 ts_tablet_manager.cc:1434] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:00.227429 30227 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.227587 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a672a61589048279810adba842422a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.229105 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 1df0056e71a84e3aa2756ee599e24a66 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:00.230583 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df0056e71a84e3aa2756ee599e24a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.233013 30171 tablet_service.cc:1511] Processing CreateTablet for tablet 1df0056e71a84e3aa2756ee599e24a66 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:00.234613 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df0056e71a84e3aa2756ee599e24a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.234856 30227 tablet_bootstrap.cc:654] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.237777 30234 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:00.239516 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:00.242691 30077 leader_election.cc:343] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.253288 30229 tablet_bootstrap.cc:654] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.267681 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 1df0056e71a84e3aa2756ee599e24a66 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:00.269093 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df0056e71a84e3aa2756ee599e24a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.272836 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.274480 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:00.276037 30001 leader_election.cc:343] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:00.276773 30001 leader_election.cc:343] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.281167 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.282001 30186 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:00.283238 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.284147 30228 tablet_bootstrap.cc:654] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.288205 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:00.294040 30237 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:00.294407 30002 leader_election.cc:343] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.294615 30237 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.294930 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:00.295125 30237 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.296686 30187 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:00.288348 30227 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:00.297763 30227 ts_tablet_manager.cc:1403] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.033s
I20260709 13:11:00.297791 30240 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:00.300962 30227 raft_consensus.cc:359] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.304880 30227 raft_consensus.cc:385] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.305429 30227 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.308818 30227 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.311468 30227 ts_tablet_manager.cc:1434] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:11:00.314044 30227 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.318681 30097 tablet_service.cc:1511] Processing CreateTablet for tablet 9a61c48865d1417593366ed1611c2836 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:00.315734 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 9a61c48865d1417593366ed1611c2836 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:00.320066 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a61c48865d1417593366ed1611c2836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.320909 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a61c48865d1417593366ed1611c2836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.316052 30237 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.328549 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:00.330358 30001 leader_election.cc:343] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.334681 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.335727 30234 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:00.336279 30234 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:00.337162 30234 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:11:00.339663 30229 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:00.340176 30229 ts_tablet_manager.cc:1403] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.183s	user 0.025s	sys 0.030s
I20260709 13:11:00.342418 30237 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.342711 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:00.343257 30229 raft_consensus.cc:359] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.343750 30187 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.344053 30229 raft_consensus.cc:385] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.344409 30229 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.345311 30229 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.351704 30229 ts_tablet_manager.cc:1434] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:11:00.352865 30229 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:00.355758 30232 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.355911 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 9a61c48865d1417593366ed1611c2836 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:00.356365 30232 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.358605 29935 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.357405 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a61c48865d1417593366ed1611c2836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.362118 30227 tablet_bootstrap.cc:654] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.363734 30232 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.367641 30187 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:00.378262 30027 tablet_service.cc:1511] Processing CreateTablet for tablet db55e372a60b4a1a9c52676be275cf56 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:00.379647 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db55e372a60b4a1a9c52676be275cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.383890 30234 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.384431 30234 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.386656 30234 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.387844 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:00.389444 30077 leader_election.cc:343] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.389813 30228 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:00.393942 30228 ts_tablet_manager.cc:1403] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.266s	user 0.019s	sys 0.011s
I20260709 13:11:00.401057 30100 tablet_service.cc:1511] Processing CreateTablet for tablet db55e372a60b4a1a9c52676be275cf56 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:00.402493 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db55e372a60b4a1a9c52676be275cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.397126 30228 raft_consensus.cc:359] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.407991 30228 raft_consensus.cc:385] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:00.411830 30250 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:00.413292 30228 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.414647 30228 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.420977 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 396297d3a2474246b40507f61f59858c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:00.417819 30171 tablet_service.cc:1511] Processing CreateTablet for tablet db55e372a60b4a1a9c52676be275cf56 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:00.423627 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396297d3a2474246b40507f61f59858c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.424355 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db55e372a60b4a1a9c52676be275cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.430974 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:00.431823 30232 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.431895 30237 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:00.432533 30237 raft_consensus.cc:697] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:00.432413 30232 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.433502 30237 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.434551 30232 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.434454 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 396297d3a2474246b40507f61f59858c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:00.416981 30228 ts_tablet_manager.cc:1434] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:11:00.440810 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396297d3a2474246b40507f61f59858c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.443832 30229 tablet_bootstrap.cc:654] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.445981 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:00.450937 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:00.451227 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.452744 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 396297d3a2474246b40507f61f59858c (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:11:00.453330 30151 leader_election.cc:343] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.454308 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396297d3a2474246b40507f61f59858c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:00.456877 30077 leader_election.cc:343] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.457638 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:00.459239 30234 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:00.454334 30151 leader_election.cc:343] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.461726 30228 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:00.462677 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.464762 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.465566 30112 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:00.467891 30227 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:00.468423 30227 ts_tablet_manager.cc:1403] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.155s	user 0.026s	sys 0.018s
W20260709 13:11:00.470985 30150 leader_election.cc:343] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.471539 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:00.472391 30232 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:00.473358 30227 raft_consensus.cc:359] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.474443 30227 raft_consensus.cc:385] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.474851 30227 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.475847 30227 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.473869 30150 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.486140 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a1d04afff45a7a0def29171749edf (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:00.487165 30227 ts_tablet_manager.cc:1434] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:11:00.487617 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a1d04afff45a7a0def29171749edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.488685 30227 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.489815 30232 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:00.490378 30232 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.490823 30232 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.514534 30228 tablet_bootstrap.cc:654] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.523134 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a1d04afff45a7a0def29171749edf (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:00.524605 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a1d04afff45a7a0def29171749edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.538185 29934 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.539770 30099 tablet_service.cc:1511] Processing CreateTablet for tablet fd9e5e8f77524a8e8e19542c915fb343 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:00.541445 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9e5e8f77524a8e8e19542c915fb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.543725 30175 tablet_service.cc:1511] Processing CreateTablet for tablet fd9e5e8f77524a8e8e19542c915fb343 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:00.546612 30097 tablet_service.cc:1511] Processing CreateTablet for tablet fa63b06fc4f446c8b2e800abeaaeabce (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:00.547163 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9e5e8f77524a8e8e19542c915fb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.548095 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa63b06fc4f446c8b2e800abeaaeabce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.545220 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a1d04afff45a7a0def29171749edf (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:00.551787 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a1d04afff45a7a0def29171749edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.555717 30229 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:00.556468 30229 ts_tablet_manager.cc:1403] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.204s	user 0.030s	sys 0.020s
I20260709 13:11:00.556931 30027 tablet_service.cc:1511] Processing CreateTablet for tablet fd9e5e8f77524a8e8e19542c915fb343 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:00.558426 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9e5e8f77524a8e8e19542c915fb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.559845 30229 raft_consensus.cc:359] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:11:00.569830 30173 tablet_service.cc:1511] Processing CreateTablet for tablet fa63b06fc4f446c8b2e800abeaaeabce (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:00.563736 30229 raft_consensus.cc:385] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.571343 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa63b06fc4f446c8b2e800abeaaeabce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.571388 30227 tablet_bootstrap.cc:654] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.578985 30025 tablet_service.cc:1511] Processing CreateTablet for tablet fa63b06fc4f446c8b2e800abeaaeabce (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:00.534246 30232 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.605458 30020 tablet_service.cc:1511] Processing CreateTablet for tablet cb153e5e2ed243b6a7741de46f707450 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:00.607543 30232 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.608520 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:00.609045 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:00.610044 30112 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:00.610154 30151 leader_election.cc:343] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.608814 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa63b06fc4f446c8b2e800abeaaeabce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.611297 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb153e5e2ed243b6a7741de46f707450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.624701 30176 tablet_service.cc:1511] Processing CreateTablet for tablet cb153e5e2ed243b6a7741de46f707450 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:00.626289 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb153e5e2ed243b6a7741de46f707450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.630247 30112 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:00.631108 30099 tablet_service.cc:1511] Processing CreateTablet for tablet cb153e5e2ed243b6a7741de46f707450 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:00.633044 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb153e5e2ed243b6a7741de46f707450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.633289 30150 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.635594 30227 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:00.636204 30227 ts_tablet_manager.cc:1403] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.007s
I20260709 13:11:00.637120 30232 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:00.639343 30227 raft_consensus.cc:359] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.640298 30227 raft_consensus.cc:385] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.571386 30229 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.642365 30229 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:11:00.643595 30228 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:00.644104 30228 ts_tablet_manager.cc:1403] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.009s
I20260709 13:11:00.647118 30228 raft_consensus.cc:359] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.647850 30228 raft_consensus.cc:385] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.648136 30228 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.648726 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2caa8c9ec4f85b73c3be44168d116 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:00.649187 30229 ts_tablet_manager.cc:1434] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.003s
I20260709 13:11:00.648988 30228 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.650146 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2caa8c9ec4f85b73c3be44168d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.656388 30229 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:00.661700 30097 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2caa8c9ec4f85b73c3be44168d116 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:00.663062 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2caa8c9ec4f85b73c3be44168d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.657919 30228 ts_tablet_manager.cc:1434] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:11:00.666806 30228 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:00.640609 30227 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.668298 30227 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.675472 30262 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.675982 30262 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.678592 30229 tablet_bootstrap.cc:654] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.679229 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:00.680917 30151 leader_election.cc:343] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.681823 30232 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:00.683403 30232 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.681732 30228 tablet_bootstrap.cc:654] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.687086 30227 ts_tablet_manager.cc:1434] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:11:00.688220 30227 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.689558 30262 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.691133 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2caa8c9ec4f85b73c3be44168d116 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:00.699873 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2caa8c9ec4f85b73c3be44168d116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.700256 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 722cf622ecb54a338f6b0c13e1ce9bed (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:00.701875 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722cf622ecb54a338f6b0c13e1ce9bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.707938 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 722cf622ecb54a338f6b0c13e1ce9bed (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:00.712800 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722cf622ecb54a338f6b0c13e1ce9bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.717877 30229 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:00.718628 30228 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:00.720652 30227 tablet_bootstrap.cc:654] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.718799 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 722cf622ecb54a338f6b0c13e1ce9bed (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:00.721616 30229 ts_tablet_manager.cc:1403] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.017s
I20260709 13:11:00.723137 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722cf622ecb54a338f6b0c13e1ce9bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.723999 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 056561f84fe249b496e33c1560ab5a76 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:00.725433 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056561f84fe249b496e33c1560ab5a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.726946 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 056561f84fe249b496e33c1560ab5a76 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:00.728243 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056561f84fe249b496e33c1560ab5a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.721371 30228 ts_tablet_manager.cc:1403] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.003s
I20260709 13:11:00.734442 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.735188 30112 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:00.736630 30228 raft_consensus.cc:359] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.739456 29935 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.741010 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.747262 30020 tablet_service.cc:1511] Processing CreateTablet for tablet bbc08410209249758a644676ff99841d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:00.748605 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc08410209249758a644676ff99841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.752625 30228 raft_consensus.cc:385] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.753345 30263 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:00.754076 30263 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.754055 30228 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.754714 30263 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.755492 30228 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.741891 30229 raft_consensus.cc:359] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.765619 30229 raft_consensus.cc:385] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.766052 30229 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.766916 30229 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.767277 30237 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.768076 30237 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.772001 30237 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.773823 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.776674 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.778414 30229 ts_tablet_manager.cc:1434] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:11:00.756538 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 056561f84fe249b496e33c1560ab5a76 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:11:00.778417 30002 leader_election.cc:343] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.787813 30037 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.788784 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 01f7556bbcd34819a44043784cacf8b2 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:00.792130 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f7556bbcd34819a44043784cacf8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.794126 30232 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.792399 30001 leader_election.cc:343] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.796479 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056561f84fe249b496e33c1560ab5a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.796278 30232 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.778752 30172 tablet_service.cc:1511] Processing CreateTablet for tablet bbc08410209249758a644676ff99841d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:00.798310 30103 tablet_service.cc:1511] Processing CreateTablet for tablet bbc08410209249758a644676ff99841d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:00.799708 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc08410209249758a644676ff99841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.798707 30232 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.800343 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:00.801322 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.801977 30112 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
W20260709 13:11:00.802048 30151 leader_election.cc:343] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.803462 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.804634 30232 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:00.777428 30263 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.805599 30232 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.806056 30232 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.806514 30001 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:00.807993 30237 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:00.808648 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:00.809298 30263 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:00.810335 30151 leader_election.cc:343] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.813509 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:00.814149 30112 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.821503 30112 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:00.823414 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc08410209249758a644676ff99841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.829831 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 01f7556bbcd34819a44043784cacf8b2 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:00.830930 30228 ts_tablet_manager.cc:1434] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 13:11:00.831391 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f7556bbcd34819a44043784cacf8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.832119 30228 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:00.837598 30234 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:00.834406 30229 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:00.842053 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 01f7556bbcd34819a44043784cacf8b2 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:00.843256 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f7556bbcd34819a44043784cacf8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.846544 30227 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:00.847115 30227 ts_tablet_manager.cc:1403] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.159s	user 0.028s	sys 0.036s
W20260709 13:11:00.857062 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:00.858546 30096 tablet_service.cc:1511] Processing CreateTablet for tablet 92792ac48d644c99ac833ab354f052c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:00.859886 30171 tablet_service.cc:1511] Processing CreateTablet for tablet 92792ac48d644c99ac833ab354f052c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:00.862018 30228 tablet_bootstrap.cc:654] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.861258 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92792ac48d644c99ac833ab354f052c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.862115 30098 tablet_service.cc:1511] Processing CreateTablet for tablet e3976f5c231948d6bd8a5345ec54d5d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:00.865841 30227 raft_consensus.cc:359] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.866644 30227 raft_consensus.cc:385] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:00.866971 30227 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:00.867836 30227 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.868637 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:00.860320 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92792ac48d644c99ac833ab354f052c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.869796 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3976f5c231948d6bd8a5345ec54d5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.872856 30263 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:00.873458 30263 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:00.874650 30263 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.876747 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 92792ac48d644c99ac833ab354f052c3 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:00.877858 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92792ac48d644c99ac833ab354f052c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.894953 30232 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.898070 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:00.899607 30151 leader_election.cc:343] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:00.900604 30020 tablet_service.cc:1511] Processing CreateTablet for tablet e3976f5c231948d6bd8a5345ec54d5d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:00.902432 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3976f5c231948d6bd8a5345ec54d5d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:00.903491 30001 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:00.914801 30240 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.915694 30240 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:00.932641 30227 ts_tablet_manager.cc:1434] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 13:11:00.933784 30237 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.934113 30229 tablet_bootstrap.cc:654] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.933842 30227 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:00.934242 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:00.941243 30112 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.935272 30232 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:00.934332 30237 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } }
I20260709 13:11:00.939771 30176 tablet_service.cc:1511] Processing CreateTablet for tablet e3976f5c231948d6bd8a5345ec54d5d5 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:00.943347 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3976f5c231948d6bd8a5345ec54d5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.954368 30237 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.954646 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:00.963927 30112 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:00.965695 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.968559 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce29391518248688fe4f7fd0e2eee7a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:00.970281 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce29391518248688fe4f7fd0e2eee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.980150 30227 tablet_bootstrap.cc:654] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:00.982932 30240 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:00.983886 30240 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:00.987028 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:00.987934 30185 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:00.989913 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:00.991039 30237 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:00.991585 30237 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.991977 30237 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:00.993300 30171 tablet_service.cc:1511] Processing CreateTablet for tablet f86541372f8c463da3fe465d9c571876 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:00.994742 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86541372f8c463da3fe465d9c571876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.999076 30177 tablet_service.cc:1511] Processing CreateTablet for tablet d11240e2763045ecaa6122102420302e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:00.999076 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce29391518248688fe4f7fd0e2eee7a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:01.000125 30027 tablet_service.cc:1511] Processing CreateTablet for tablet f86541372f8c463da3fe465d9c571876 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:01.001382 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86541372f8c463da3fe465d9c571876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.003108 30026 tablet_service.cc:1511] Processing CreateTablet for tablet d11240e2763045ecaa6122102420302e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:01.004377 30026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11240e2763045ecaa6122102420302e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.006764 30228 tablet_bootstrap.cc:492] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:01.007313 30228 ts_tablet_manager.cc:1403] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.023s
W20260709 13:11:01.009925 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55566.5us
I20260709 13:11:01.021893 30228 raft_consensus.cc:359] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.022086 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce29391518248688fe4f7fd0e2eee7a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:01.022743 30228 raft_consensus.cc:385] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.022548 30028 tablet_service.cc:1511] Processing CreateTablet for tablet 155d3e6034f842759244a283f46a67b9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:01.023140 30228 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.024039 30228 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.024055 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce29391518248688fe4f7fd0e2eee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.026124 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11240e2763045ecaa6122102420302e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.026046 30097 tablet_service.cc:1511] Processing CreateTablet for tablet f86541372f8c463da3fe465d9c571876 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:01.027698 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86541372f8c463da3fe465d9c571876. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:01.029037 30001 leader_election.cc:343] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.029703 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 155d3e6034f842759244a283f46a67b9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:01.031175 30098 tablet_service.cc:1511] Processing CreateTablet for tablet d11240e2763045ecaa6122102420302e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:01.031648 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:01.032621 30232 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:01.033133 30232 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:01.034030 30232 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.031147 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d3e6034f842759244a283f46a67b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.033989 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce29391518248688fe4f7fd0e2eee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.037575 30028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d3e6034f842759244a283f46a67b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.038204 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d11240e2763045ecaa6122102420302e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.038883 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:01.042896 30001 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:01.044427 30271 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.049919 30228 ts_tablet_manager.cc:1434] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:11:01.056027 30229 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:01.056639 30229 ts_tablet_manager.cc:1403] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.002s
I20260709 13:11:01.058668 30277 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:01.060902 30228 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:01.070382 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 155d3e6034f842759244a283f46a67b9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:01.071905 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d3e6034f842759244a283f46a67b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.090893 30228 tablet_bootstrap.cc:654] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.101114 29936 catalog_manager.cc:5697] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.141903 30227 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:01.142428 30227 ts_tablet_manager.cc:1403] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.209s	user 0.016s	sys 0.012s
I20260709 13:11:01.145179 30227 raft_consensus.cc:359] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.145937 30227 raft_consensus.cc:385] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.146314 30227 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.146775 30237 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.147135 30227 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.149639 30227 ts_tablet_manager.cc:1434] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:01.152892 30172 tablet_service.cc:1511] Processing CreateTablet for tablet ef9600254f4d48368aff10ed883134fd (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:01.154949 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:01.156587 30001 leader_election.cc:343] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.162465 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9600254f4d48368aff10ed883134fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.166252 30022 tablet_service.cc:1511] Processing CreateTablet for tablet ef9600254f4d48368aff10ed883134fd (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:01.167958 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9600254f4d48368aff10ed883134fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.166787 30227 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:01.170359 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 729e969847cf4fbcb29c2681ec03a97a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:01.171619 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729e969847cf4fbcb29c2681ec03a97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.171403 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:01.172199 30186 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.176005 30229 raft_consensus.cc:359] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.176853 30229 raft_consensus.cc:385] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.181506 30237 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:01.177160 30229 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.189646 30227 tablet_bootstrap.cc:654] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.214883 30186 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:01.217630 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:01.232254 30237 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:01.233049 30237 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:01.234396 30237 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.232806 30229 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.238886 30096 tablet_service.cc:1511] Processing CreateTablet for tablet 535e413e4f2b46fe966812acbf31570a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:01.241048 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 729e969847cf4fbcb29c2681ec03a97a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:01.240425 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535e413e4f2b46fe966812acbf31570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.246119 30100 tablet_service.cc:1511] Processing CreateTablet for tablet c0bc2d269504461f9c5ae0cdf5385b9b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:01.248879 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0bc2d269504461f9c5ae0cdf5385b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.250362 30172 tablet_service.cc:1511] Processing CreateTablet for tablet c0bc2d269504461f9c5ae0cdf5385b9b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:01.251772 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0bc2d269504461f9c5ae0cdf5385b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.252327 30228 tablet_bootstrap.cc:492] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:01.252815 30228 ts_tablet_manager.cc:1403] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.019s
I20260709 13:11:01.240347 30229 ts_tablet_manager.cc:1434] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.183s	user 0.007s	sys 0.001s
I20260709 13:11:01.264180 30229 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
W20260709 13:11:01.256489 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.259652 30263 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:01.265929 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 535e413e4f2b46fe966812acbf31570a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:01.259989 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729e969847cf4fbcb29c2681ec03a97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.261360 30028 tablet_service.cc:1511] Processing CreateTablet for tablet 535e413e4f2b46fe966812acbf31570a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:01.255607 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 729e969847cf4fbcb29c2681ec03a97a (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:01.271901 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729e969847cf4fbcb29c2681ec03a97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.255736 30026 tablet_service.cc:1511] Processing CreateTablet for tablet c0bc2d269504461f9c5ae0cdf5385b9b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:01.274471 30098 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7dd6e303964f99bd9728c2f53891af (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:01.280928 30026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0bc2d269504461f9c5ae0cdf5385b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.281034 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7dd6e303964f99bd9728c2f53891af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.284356 30177 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7dd6e303964f99bd9728c2f53891af (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:01.279093 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535e413e4f2b46fe966812acbf31570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.286082 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7dd6e303964f99bd9728c2f53891af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.287760 30027 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7dd6e303964f99bd9728c2f53891af (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:01.295508 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8dc2d031b14a58b3ed72d7a06855e1 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:01.296810 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8dc2d031b14a58b3ed72d7a06855e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.297664 30028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535e413e4f2b46fe966812acbf31570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.299410 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7dd6e303964f99bd9728c2f53891af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.301317 30263 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.301870 30263 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.304013 30263 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.310500 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:01.311444 30113 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:01.313354 30150 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:01.314531 30263 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:01.314997 30263 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.315441 30263 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.311501 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:01.319777 30038 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:01.321110 30229 tablet_bootstrap.cc:654] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.326081 30097 tablet_service.cc:1511] Processing CreateTablet for tablet ef9600254f4d48368aff10ed883134fd (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:01.327970 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9600254f4d48368aff10ed883134fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.332312 30232 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.336205 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8dc2d031b14a58b3ed72d7a06855e1 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:01.332998 30232 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.337873 30240 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.338389 30240 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.340016 30232 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.340554 30240 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:01.340803 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:01.342244 30151 leader_election.cc:343] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.343515 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8dc2d031b14a58b3ed72d7a06855e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.328802 30263 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.345463 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:01.345357 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:01.349685 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:01.350152 30001 leader_election.cc:343] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.350378 30111 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
W20260709 13:11:01.350911 30002 leader_election.cc:343] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.351315 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:01.352365 30240 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:01.353966 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 3f8dc2d031b14a58b3ed72d7a06855e1 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:01.355132 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f8dc2d031b14a58b3ed72d7a06855e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.358850 30227 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:01.359328 30227 ts_tablet_manager.cc:1403] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.193s	user 0.021s	sys 0.026s
I20260709 13:11:01.362949 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:01.261209 30228 raft_consensus.cc:359] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.364353 30228 raft_consensus.cc:385] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.364651 30232 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:01.365046 30228 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.365249 30232 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.365833 30232 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.366056 30228 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.368006 30227 raft_consensus.cc:359] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.368929 30227 raft_consensus.cc:385] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.369798 30227 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.387391 30227 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.399636 30227 ts_tablet_manager.cc:1434] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:11:01.401898 30227 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:01.419373 30263 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.420727 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:01.438299 30228 ts_tablet_manager.cc:1434] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.185s	user 0.011s	sys 0.000s
I20260709 13:11:01.439244 30228 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:01.433660 30038 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.446514 30232 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.452214 30096 tablet_service.cc:1511] Processing CreateTablet for tablet f3d5b014e8a54181ad5978055b4514b4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:01.454264 30022 tablet_service.cc:1511] Processing CreateTablet for tablet f3d5b014e8a54181ad5978055b4514b4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:01.464399 30172 tablet_service.cc:1511] Processing CreateTablet for tablet f3d5b014e8a54181ad5978055b4514b4 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:01.465291 30232 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.456837 30228 tablet_bootstrap.cc:654] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.465534 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d5b014e8a54181ad5978055b4514b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:01.460354 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.465979 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d5b014e8a54181ad5978055b4514b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.471623 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:01.473779 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:01.474473 30111 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.478369 30100 tablet_service.cc:1511] Processing CreateTablet for tablet 838f13bafde24742a950e2e4d62e21e9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:01.471971 30096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d5b014e8a54181ad5978055b4514b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.480286 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838f13bafde24742a950e2e4d62e21e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.481333 30229 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:01.481884 30229 ts_tablet_manager.cc:1403] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.218s	user 0.022s	sys 0.025s
W20260709 13:11:01.483655 30151 leader_election.cc:343] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:01.481349 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 838f13bafde24742a950e2e4d62e21e9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:01.486008 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838f13bafde24742a950e2e4d62e21e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.491892 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 814415efcb8c4963a2b88aafeeaa75bb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:01.495391 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814415efcb8c4963a2b88aafeeaa75bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.495841 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 814415efcb8c4963a2b88aafeeaa75bb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:01.497023 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814415efcb8c4963a2b88aafeeaa75bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.485993 30227 tablet_bootstrap.cc:654] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.504577 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 814415efcb8c4963a2b88aafeeaa75bb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:01.506124 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814415efcb8c4963a2b88aafeeaa75bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.506518 30177 tablet_service.cc:1511] Processing CreateTablet for tablet 838f13bafde24742a950e2e4d62e21e9 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:01.507882 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838f13bafde24742a950e2e4d62e21e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:01.511684 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.508277 30038 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:01.513270 30232 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:01.514968 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:01.515648 30113 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.519140 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:01.520382 30263 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:01.520936 30263 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:01.522086 30263 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.524364 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 6065fdc6916b4a589b781d16204e51c6 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:01.525732 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6065fdc6916b4a589b781d16204e51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.485389 30229 raft_consensus.cc:359] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.528080 30229 raft_consensus.cc:385] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.528443 30229 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.529206 30229 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.530190 30024 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddff3913cdf4e70a580878770e0b745 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:01.530740 30027 tablet_service.cc:1511] Processing CreateTablet for tablet 6065fdc6916b4a589b781d16204e51c6 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:01.515756 29934 catalog_manager.cc:5697] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.531847 30229 ts_tablet_manager.cc:1434] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:11:01.535332 30111 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:01.537346 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 6065fdc6916b4a589b781d16204e51c6 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:01.538674 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6065fdc6916b4a589b781d16204e51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.555883 30021 tablet_service.cc:1511] Processing CreateTablet for tablet d99bf410d55b470d8191aa69458330db (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:01.557541 30171 tablet_service.cc:1511] Processing CreateTablet for tablet d99bf410d55b470d8191aa69458330db (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:01.557936 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddff3913cdf4e70a580878770e0b745 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:01.559049 30171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99bf410d55b470d8191aa69458330db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.562512 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddff3913cdf4e70a580878770e0b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.575958 30021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99bf410d55b470d8191aa69458330db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.568646 30261 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:01.582068 30113 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:01.585752 30019 tablet_service.cc:1511] Processing CreateTablet for tablet 9b108c73739d43d89aafdc212aae9d1b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:01.592885 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6065fdc6916b4a589b781d16204e51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.593490 30228 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:01.593979 30228 ts_tablet_manager.cc:1403] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.007s
I20260709 13:11:01.601650 30024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddff3913cdf4e70a580878770e0b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.601508 30098 tablet_service.cc:1511] Processing CreateTablet for tablet d99bf410d55b470d8191aa69458330db (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:01.601874 30102 tablet_service.cc:1511] Processing CreateTablet for tablet 9b108c73739d43d89aafdc212aae9d1b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:01.603135 30098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99bf410d55b470d8191aa69458330db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.604005 30102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b108c73739d43d89aafdc212aae9d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.605458 30019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b108c73739d43d89aafdc212aae9d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.602774 30099 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddff3913cdf4e70a580878770e0b745 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:01.609544 30099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddff3913cdf4e70a580878770e0b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.613121 30229 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:01.596984 30228 raft_consensus.cc:359] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.623134 30228 raft_consensus.cc:385] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.623566 30228 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.628335 30228 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.633234 30228 ts_tablet_manager.cc:1434] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:11:01.634553 30175 tablet_service.cc:1511] Processing CreateTablet for tablet 9b108c73739d43d89aafdc212aae9d1b (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:01.640180 30175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b108c73739d43d89aafdc212aae9d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.637804 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 0285ca89cc9843cab1c6899c6f83dd16 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:01.637918 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:01.641742 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0285ca89cc9843cab1c6899c6f83dd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.642884 30261 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:01.643417 30261 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:01.644269 30261 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.647169 30173 tablet_service.cc:1511] Processing CreateTablet for tablet 0285ca89cc9843cab1c6899c6f83dd16 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:01.648696 30173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0285ca89cc9843cab1c6899c6f83dd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.661674 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 0285ca89cc9843cab1c6899c6f83dd16 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:01.663192 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0285ca89cc9843cab1c6899c6f83dd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.678025 30227 tablet_bootstrap.cc:492] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:01.678763 30227 ts_tablet_manager.cc:1403] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.009s
I20260709 13:11:01.683387 30272 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.684161 30272 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.686901 30028 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:01.688971 30028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.698220 30227 raft_consensus.cc:359] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.699648 30227 raft_consensus.cc:385] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.700042 30227 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.722697 30027 tablet_service.cc:1511] Processing CreateTablet for tablet 42209a176ad44af88b5b1710846183cb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:01.723476 30026 tablet_service.cc:1511] Processing CreateTablet for tablet d14e2286ffc64880b1518c6743938daa (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:01.722807 30176 tablet_service.cc:1511] Processing CreateTablet for tablet 42209a176ad44af88b5b1710846183cb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:01.724248 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42209a176ad44af88b5b1710846183cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.724479 30170 tablet_service.cc:1511] Processing CreateTablet for tablet d14e2286ffc64880b1518c6743938daa (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:01.725057 30176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42209a176ad44af88b5b1710846183cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.725900 30170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e2286ffc64880b1518c6743938daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.727013 30022 tablet_service.cc:1511] Processing CreateTablet for tablet cfbfe72ddc624143b4f12cb68c249a4e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:01.728274 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbfe72ddc624143b4f12cb68c249a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.728410 30097 tablet_service.cc:1511] Processing CreateTablet for tablet 42209a176ad44af88b5b1710846183cb (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:01.728626 30101 tablet_service.cc:1511] Processing CreateTablet for tablet cfbfe72ddc624143b4f12cb68c249a4e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:01.729741 30097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42209a176ad44af88b5b1710846183cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.732975 30172 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:01.733752 30026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e2286ffc64880b1518c6743938daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.733803 30101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbfe72ddc624143b4f12cb68c249a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.734418 30172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.735199 30100 tablet_service.cc:1511] Processing CreateTablet for tablet d14e2286ffc64880b1518c6743938daa (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:01.736313 30100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e2286ffc64880b1518c6743938daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.701085 30227 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.738300 30103 tablet_service.cc:1511] Processing CreateTablet for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:01.741719 30103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.745240 29936 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.746088 30095 tablet_service.cc:1511] Processing CreateTablet for tablet b7398efc3342427c8ca63da3a989684d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:01.747517 30095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7398efc3342427c8ca63da3a989684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.750854 30174 tablet_service.cc:1511] Processing CreateTablet for tablet cfbfe72ddc624143b4f12cb68c249a4e (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:01.752316 30174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbfe72ddc624143b4f12cb68c249a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.761962 30227 ts_tablet_manager.cc:1434] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:11:01.763049 30227 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:01.775200 30229 tablet_bootstrap.cc:654] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.787796 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:01.788537 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:01.789656 30187 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:01.794445 30019 tablet_service.cc:1511] Processing CreateTablet for tablet b7398efc3342427c8ca63da3a989684d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:01.796224 30019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7398efc3342427c8ca63da3a989684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.800109 30228 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:01.810076 30177 tablet_service.cc:1511] Processing CreateTablet for tablet b7398efc3342427c8ca63da3a989684d (DEFAULT_TABLE table=test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:01.812661 30177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7398efc3342427c8ca63da3a989684d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:01.775310 30289 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.814437 30289 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.818650 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:01.819401 30038 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:01.823232 30227 tablet_bootstrap.cc:654] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.825871 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:01.779898 30272 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:01.826108 30289 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.829072 30240 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:01.780370 29934 catalog_manager.cc:5697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.835201 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:01.837314 30272 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.853693 30261 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:01.854200 30261 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.854593 30261 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.863426 30228 tablet_bootstrap.cc:654] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.867168 30272 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:01.870316 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:01.871795 30240 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:01.872052 29935 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:01.874622 30150 leader_election.cc:343] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:01.876160 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:01.894109 30038 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.919340 30227 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:01.920171 30227 ts_tablet_manager.cc:1403] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.010s
I20260709 13:11:01.923346 30227 raft_consensus.cc:359] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.924165 30227 raft_consensus.cc:385] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.924460 30227 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.925580 30227 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.928035 30227 ts_tablet_manager.cc:1434] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:01.929014 30227 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:01.963536 30229 tablet_bootstrap.cc:492] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:01.964217 30229 ts_tablet_manager.cc:1403] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.351s	user 0.020s	sys 0.026s
I20260709 13:11:01.969628 30229 raft_consensus.cc:359] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.970764 30229 raft_consensus.cc:385] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.971180 30229 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.972419 30229 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.976197 30229 ts_tablet_manager.cc:1434] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:11:01.972117 30261 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.977583 30229 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:01.980338 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:01.981122 30036 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:01.984304 30228 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:01.984798 30228 ts_tablet_manager.cc:1403] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.185s	user 0.007s	sys 0.028s
I20260709 13:11:01.985271 30229 tablet_bootstrap.cc:654] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.987996 30228 raft_consensus.cc:359] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.989387 30228 raft_consensus.cc:385] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:01.990363 30228 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:01.989125 30227 tablet_bootstrap.cc:654] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:01.996471 30261 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:01.992219 30036 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:01.998907 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.000332 30261 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.002815 30240 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:02.003562 30240 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.004004 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:02.006841 30150 leader_election.cc:343] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.008179 30263 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.008723 30263 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:01.991909 30228 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.011513 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.001998 30261 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:02.012634 30263 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.014752 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.015516 30036 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:02.016984 30228 ts_tablet_manager.cc:1434] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.003s
I20260709 13:11:02.017145 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.017990 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.018716 30110 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:02.019730 30240 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.014284 30261 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.022007 30263 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.022337 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.022855 30263 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.023434 30263 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.025708 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.026930 30240 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.027894 30229 tablet_bootstrap.cc:492] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.028812 30229 ts_tablet_manager.cc:1403] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.012s
I20260709 13:11:02.031598 30229 raft_consensus.cc:359] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.032091 30263 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.036439 30229 raft_consensus.cc:385] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.036836 30229 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.032603 30228 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.038138 30227 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.038590 30227 ts_tablet_manager.cc:1403] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.013s
I20260709 13:11:02.039179 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:02.039731 30038 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.041836 30227 raft_consensus.cc:359] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.042655 30227 raft_consensus.cc:385] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.042937 30227 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.043445 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:02.043752 30228 tablet_bootstrap.cc:654] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.044030 30110 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.043670 30227 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.046132 30227 ts_tablet_manager.cc:1434] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:02.047125 30227 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.047595 30232 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:02.049624 30263 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.045636 30229 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.053022 30229 ts_tablet_manager.cc:1434] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:11:02.054126 30229 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.054320 30227 tablet_bootstrap.cc:654] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.056077 30110 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:02.061961 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.063990 30289 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.064958 30289 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:02.066269 30289 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.067885 30229 tablet_bootstrap.cc:654] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.067117 29935 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.080051 30227 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.080621 30227 ts_tablet_manager.cc:1403] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.000s
I20260709 13:11:02.093866 30261 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:02.095276 30036 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.104184 30038 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:02.118538 30227 raft_consensus.cc:359] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.119210 30227 raft_consensus.cc:385] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.119411 30227 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.120015 30227 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.122860 30227 ts_tablet_manager.cc:1434] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:11:02.123927 30227 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.130936 30228 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.131788 30229 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.132426 30229 ts_tablet_manager.cc:1403] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.005s
I20260709 13:11:02.131789 30228 ts_tablet_manager.cc:1403] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.108s	user 0.021s	sys 0.014s
I20260709 13:11:02.136391 30240 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:02.137008 30240 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.137364 30229 raft_consensus.cc:359] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.138245 30229 raft_consensus.cc:385] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.141227 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.141515 30229 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.142760 30227 tablet_bootstrap.cc:654] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.142444 30229 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.141276 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.144707 30228 raft_consensus.cc:359] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.145180 30229 ts_tablet_manager.cc:1434] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:02.146741 29936 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.145561 30228 raft_consensus.cc:385] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.146042 30240 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.147008 30001 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.149513 30228 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.150058 30303 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.151460 30228 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.149082 30229 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.154706 30228 ts_tablet_manager.cc:1434] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:11:02.155167 30227 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.155606 30227 ts_tablet_manager.cc:1403] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 13:11:02.158679 30227 raft_consensus.cc:359] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.159452 30227 raft_consensus.cc:385] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.159790 30227 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.160521 30227 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.161955 30229 tablet_bootstrap.cc:654] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.162331 30228 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.162719 30227 ts_tablet_manager.cc:1434] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:11:02.163671 30227 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.171061 30227 tablet_bootstrap.cc:654] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.180728 30228 tablet_bootstrap.cc:654] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.200925 30261 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.202955 30229 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.203505 30229 ts_tablet_manager.cc:1403] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.055s	user 0.036s	sys 0.010s
I20260709 13:11:02.205160 30228 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.205761 30228 ts_tablet_manager.cc:1403] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
I20260709 13:11:02.206334 30229 raft_consensus.cc:359] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.207085 30229 raft_consensus.cc:385] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.207302 30227 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.207361 30229 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.207953 30227 ts_tablet_manager.cc:1403] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.016s
I20260709 13:11:02.208371 30229 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.208925 30228 raft_consensus.cc:359] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.209901 30228 raft_consensus.cc:385] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.210230 30228 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.210876 30229 ts_tablet_manager.cc:1434] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:02.210964 30228 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.212218 30229 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.211884 30227 raft_consensus.cc:359] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.212646 30227 raft_consensus.cc:385] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.212961 30227 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.213479 30228 ts_tablet_manager.cc:1434] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:02.214507 30228 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.213943 30227 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.218219 30229 tablet_bootstrap.cc:654] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.219017 30227 ts_tablet_manager.cc:1434] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:11:02.220136 30227 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.221187 30228 tablet_bootstrap.cc:654] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.226732 30227 tablet_bootstrap.cc:654] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:02.228901 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.240777 30289 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.241542 30289 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.244221 30289 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.244727 30289 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.245208 30289 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.246008 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.246469 30227 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.247057 30227 ts_tablet_manager.cc:1403] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 13:11:02.247936 30289 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:02.249531 30151 leader_election.cc:343] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.249601 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.249977 30227 raft_consensus.cc:359] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.250736 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.251005 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:02.251726 30150 leader_election.cc:343] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.252223 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:02.252450 30151 leader_election.cc:343] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.251003 30227 raft_consensus.cc:385] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:02.253454 30150 leader_election.cc:343] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.253472 30227 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.254182 30261 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.254069 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:02.254807 30240 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.254922 30227 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.255846 30289 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.255878 30240 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.259430 30227 ts_tablet_manager.cc:1434] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:02.259531 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.260607 30227 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.260325 30112 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.262888 30001 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:02.263896 30303 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.264357 30303 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.264775 30303 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.255040 30228 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.267788 30228 ts_tablet_manager.cc:1403] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.003s
I20260709 13:11:02.268404 30227 tablet_bootstrap.cc:654] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.270020 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.270826 30187 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.259538 30229 tablet_bootstrap.cc:492] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.277323 30229 ts_tablet_manager.cc:1403] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.016s
I20260709 13:11:02.268627 30240 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.273546 30232 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.271085 30289 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.281661 30289 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.283808 30289 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.283545 30229 raft_consensus.cc:359] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.284435 30229 raft_consensus.cc:385] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.284860 30229 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.285871 30229 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.287050 30303 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.287937 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.288545 30229 ts_tablet_manager.cc:1434] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:02.280869 30232 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:02.290038 30151 leader_election.cc:343] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.290390 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:02.290966 30112 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.291350 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.291808 30232 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.292455 30303 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.294458 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.295843 30229 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.296831 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:02.301071 30151 leader_election.cc:343] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.279686 30228 raft_consensus.cc:359] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.301729 30228 raft_consensus.cc:385] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.302098 30228 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
W20260709 13:11:02.302182 30150 leader_election.cc:343] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.299482 30112 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.302758 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:02.302963 30228 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.303589 30232 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.303618 30001 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:02.304023 30113 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:02.304706 30303 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.305502 30303 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:02.305562 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:02.306223 30187 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.306538 30303 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.302405 30227 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.308804 30228 ts_tablet_manager.cc:1434] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:11:02.313956 30227 ts_tablet_manager.cc:1403] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.014s
I20260709 13:11:02.314527 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:02.314953 30228 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.315873 30232 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.319710 30232 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.320147 30232 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.313500 30229 tablet_bootstrap.cc:654] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.325462 30228 tablet_bootstrap.cc:654] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.324776 29936 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.328467 30232 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.317113 30227 raft_consensus.cc:359] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.329566 30227 raft_consensus.cc:385] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.329914 30227 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.330667 30227 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.332863 30227 ts_tablet_manager.cc:1434] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:11:02.333876 30227 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.336156 30228 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.336978 30228 ts_tablet_manager.cc:1403] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:11:02.337814 30272 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.338362 30272 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.341871 30232 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.342501 30227 tablet_bootstrap.cc:654] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.340909 30228 raft_consensus.cc:359] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.342751 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.344399 30036 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:02.342769 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:02.346946 30151 leader_election.cc:343] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.340993 30272 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.348337 30113 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.318576 30187 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.349458 30228 raft_consensus.cc:385] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.349836 30228 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.350749 30228 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.351459 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.352942 30228 ts_tablet_manager.cc:1434] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:02.353564 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:02.354051 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.354333 30112 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.357578 30272 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.366376 30228 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.373636 30229 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.378866 30229 ts_tablet_manager.cc:1403] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.002s
I20260709 13:11:02.379892 30303 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.373255 30272 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.380577 30303 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.384652 30228 tablet_bootstrap.cc:654] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.387732 30229 raft_consensus.cc:359] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.389153 30232 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.392422 30229 raft_consensus.cc:385] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.392174 30232 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.393931 30303 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.394892 30232 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.393052 30227 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.395728 30227 ts_tablet_manager.cc:1403] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.034s
I20260709 13:11:02.396409 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:02.397931 30151 leader_election.cc:343] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.398008 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.393781 30228 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.398803 30229 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.398967 30228 ts_tablet_manager.cc:1403] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:11:02.402407 30112 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:02.399654 30227 raft_consensus.cc:359] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.402982 30303 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.403060 30227 raft_consensus.cc:385] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.403687 30227 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.403544 30303 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.404729 30227 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.406986 30303 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.407778 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.408491 30186 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.408108 30229 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.410020 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.409844 30227 ts_tablet_manager.cc:1434] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:11:02.411152 30240 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.411605 30240 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.412034 30240 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.413179 30229 ts_tablet_manager.cc:1434] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:11:02.411437 30227 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.414579 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.415385 30111 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.415584 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:02.414142 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.416918 30228 raft_consensus.cc:359] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.416960 30232 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.418473 30228 raft_consensus.cc:385] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.418623 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.418752 30232 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:02.418917 30228 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.419760 30271 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.419760 30228 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.422343 30228 ts_tablet_manager.cc:1434] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:11:02.422278 30240 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.423761 30228 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.424381 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.419831 30232 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.430573 30240 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.430768 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:02.431455 30112 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.433333 30227 tablet_bootstrap.cc:654] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.433364 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:02.434139 30186 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.437460 30229 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
W20260709 13:11:02.453730 30150 leader_election.cc:343] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.457078 30228 tablet_bootstrap.cc:654] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.455389 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:02.457787 30263 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:02.476385 30036 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.467059 30112 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.483889 30289 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.485141 30186 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.486826 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.488233 30240 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.489346 30240 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:02.490969 30240 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.493202 30289 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.504767 30227 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.505487 30227 ts_tablet_manager.cc:1403] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.094s	user 0.031s	sys 0.023s
I20260709 13:11:02.516855 29936 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.537348 30272 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:02.567572 30272 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.570109 30272 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.570807 30229 tablet_bootstrap.cc:654] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.581974 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.585935 30227 raft_consensus.cc:359] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.586776 30227 raft_consensus.cc:385] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.587105 30227 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.587774 30227 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.588378 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.590008 30227 ts_tablet_manager.cc:1434] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:11:02.594024 30227 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.590685 30077 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.591468 30289 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:11:02.595018 30331 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:02.595471 30272 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.600245 30240 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:02.601179 30240 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.611304 30228 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.611814 30228 ts_tablet_manager.cc:1403] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.188s	user 0.008s	sys 0.009s
I20260709 13:11:02.612411 30261 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.621320 30228 raft_consensus.cc:359] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.622057 30228 raft_consensus.cc:385] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.622339 30228 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.623131 30228 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.627600 30240 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.627959 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.630966 30228 ts_tablet_manager.cc:1434] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 13:11:02.633090 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.634893 30228 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.636022 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:02.637187 30229 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.637725 30229 ts_tablet_manager.cc:1403] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.019s
I20260709 13:11:02.638134 29936 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.646353 30240 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.651106 30227 tablet_bootstrap.cc:654] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.653585 30240 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.654150 30240 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.652746 30229 raft_consensus.cc:359] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.655947 30229 raft_consensus.cc:385] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.656260 30229 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.656926 30229 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.659883 30229 ts_tablet_manager.cc:1434] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:11:02.660794 30229 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.665850 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:02.666610 30113 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.667896 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:02.668653 30271 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.669044 30271 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.669441 30271 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.669366 30240 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.677380 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.678108 30186 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:02.680760 30228 tablet_bootstrap.cc:654] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.695667 30229 tablet_bootstrap.cc:654] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.700186 30271 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.700937 30228 tablet_bootstrap.cc:492] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.701442 30228 ts_tablet_manager.cc:1403] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.006s
I20260709 13:11:02.704098 30227 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.704665 30228 raft_consensus.cc:359] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.705384 30228 raft_consensus.cc:385] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.705709 30228 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.706622 30228 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.707362 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:02.708168 30110 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.708940 30228 ts_tablet_manager.cc:1434] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:02.709892 30228 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.716089 30228 tablet_bootstrap.cc:654] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.718763 30110 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.720436 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:02.721612 30240 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.722278 30240 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:02.723397 30240 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.704667 30227 ts_tablet_manager.cc:1403] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.006s
I20260709 13:11:02.728374 30228 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.728785 30228 ts_tablet_manager.cc:1403] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 13:11:02.730684 30228 raft_consensus.cc:359] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.731092 30271 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.731180 30228 raft_consensus.cc:385] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.731653 30228 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.732285 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:02.732311 30228 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.733322 30186 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.733698 30272 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.734113 30272 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.733258 30227 raft_consensus.cc:359] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.735342 30227 raft_consensus.cc:385] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.735610 30227 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.736078 30272 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.737936 30272 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.737733 30227 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.738387 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.739037 30187 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:02.739156 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.738366 30272 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:02.740934 30077 leader_election.cc:343] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.741288 30227 ts_tablet_manager.cc:1434] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:11:02.741858 30272 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.741706 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:02.743147 30228 ts_tablet_manager.cc:1434] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:11:02.743824 30227 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.744029 30228 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.743778 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.746443 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:02.747176 30187 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:02.755640 30272 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.752849 30038 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.767880 30261 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.768625 30261 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.751477 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:02.769939 30327 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:02.769027 30186 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:02.770291 30327 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.770689 30327 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.772125 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:02.756798 30272 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.774405 30228 tablet_bootstrap.cc:654] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:02.775843 30151 leader_election.cc:343] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.776012 30261 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:02.780658 30327 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.786158 29935 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.789330 30227 tablet_bootstrap.cc:654] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.782440 30272 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.791594 30327 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:02.784678 30077 leader_election.cc:343] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.795817 30229 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.796296 30229 ts_tablet_manager.cc:1403] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.136s	user 0.022s	sys 0.017s
I20260709 13:11:02.802309 30229 raft_consensus.cc:359] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.803246 30229 raft_consensus.cc:385] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.803596 30229 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.804469 30229 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.807652 30229 ts_tablet_manager.cc:1434] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:02.808961 30229 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.816349 30227 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.816996 30227 ts_tablet_manager.cc:1403] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.008s
I20260709 13:11:02.817904 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:02.819026 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:02.819703 30186 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.823562 30229 tablet_bootstrap.cc:654] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.825556 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:02.830299 30150 leader_election.cc:343] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.830775 30150 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:02.834349 30261 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:02.836030 30077 leader_election.cc:343] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:02.838562 30227 raft_consensus.cc:359] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.840206 30227 raft_consensus.cc:385] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.840595 30227 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.841259 30228 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:02.841796 30228 ts_tablet_manager.cc:1403] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.014s
I20260709 13:11:02.841665 30227 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.844606 30228 raft_consensus.cc:359] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.839013 30272 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.845579 30228 raft_consensus.cc:385] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.847401 30228 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.847213 30186 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:02.849612 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:02.850409 30327 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.850193 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:02.850904 30327 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:02.851025 30187 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.851403 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:02.852012 30037 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.851791 30327 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.847231 30272 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:02.862247 30227 ts_tablet_manager.cc:1434] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:11:02.863206 30227 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.864267 30037 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:02.865471 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:02.861059 30240 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:11:02.866550 30272 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.848048 30228 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.867053 30272 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:02.867871 30272 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.875772 30227 tablet_bootstrap.cc:654] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:02.875837 30151 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.878093 29936 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.883817 30229 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:02.884399 30229 ts_tablet_manager.cc:1403] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.015s
I20260709 13:11:02.887059 30229 raft_consensus.cc:359] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.889539 30229 raft_consensus.cc:385] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.890473 30229 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.892064 30229 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:02.906616 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:02.907467 30187 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:02.927400 30229 ts_tablet_manager.cc:1434] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 13:11:02.928591 30229 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:02.929209 30228 ts_tablet_manager.cc:1434] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.008s
I20260709 13:11:02.930264 30228 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:02.935493 30227 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:02.936007 30227 ts_tablet_manager.cc:1403] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.012s
I20260709 13:11:02.943657 30303 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:02.947108 29935 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.951108 30229 tablet_bootstrap.cc:654] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.952993 30240 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:02.953115 30227 raft_consensus.cc:359] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.953814 30227 raft_consensus.cc:385] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.954077 30227 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.954718 30227 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:02.956799 30227 ts_tablet_manager.cc:1434] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:11:02.957732 30227 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:02.975656 30228 tablet_bootstrap.cc:654] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.977424 30227 tablet_bootstrap.cc:654] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.981129 30271 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.004369 30263 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:03.063206 30232 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.063930 30232 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.067322 30271 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.068068 30271 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.071252 30229 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:03.071496 30261 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.071863 30229 ts_tablet_manager.cc:1403] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.143s	user 0.040s	sys 0.046s
I20260709 13:11:03.072043 30261 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.072854 30227 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:03.073344 30227 ts_tablet_manager.cc:1403] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.034s
I20260709 13:11:03.075217 30229 raft_consensus.cc:359] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.076113 30229 raft_consensus.cc:385] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.076033 30271 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:03.076308 30227 raft_consensus.cc:359] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.076807 30229 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.077101 30227 raft_consensus.cc:385] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.077626 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:03.078027 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:03.077239 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:03.077772 30227 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.077811 30229 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.078933 30113 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
W20260709 13:11:03.079912 30151 leader_election.cc:343] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.079309 30227 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:03.080669 30151 leader_election.cc:343] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.080786 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:03.081602 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:03.081553 30185 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:03.082696 30227 ts_tablet_manager.cc:1434] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:11:03.082612 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:03.083951 30227 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:03.084561 30271 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.085035 30271 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.086220 30229 ts_tablet_manager.cc:1434] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
W20260709 13:11:03.086139 30150 leader_election.cc:343] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.086825 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:03.087420 30261 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:03.088109 30289 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.088481 30240 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.088686 30289 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.089180 30289 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.089672 30229 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:03.089035 30240 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.091509 30289 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:03.092602 30240 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:03.093700 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:03.094113 30227 tablet_bootstrap.cc:654] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.093891 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:03.094628 30113 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:03.096740 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:03.096925 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:03.098261 30303 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.098672 30303 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.099071 30303 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.099587 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:03.100304 30185 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:03.100875 30229 tablet_bootstrap.cc:654] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:03.101824 30151 leader_election.cc:343] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.085476 30271 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.104206 30232 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:03.106389 30150 leader_election.cc:343] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.107460 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:03.106913 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:03.112349 30232 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.113451 30303 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.121479 30228 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:03.122299 30228 ts_tablet_manager.cc:1403] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.051s
I20260709 13:11:03.123601 30271 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.126368 30303 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:03.127435 30271 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:03.129930 30228 raft_consensus.cc:359] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.131187 30228 raft_consensus.cc:385] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.131608 30228 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.132830 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:03.132851 30228 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.134042 30110 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.136096 30228 ts_tablet_manager.cc:1434] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:03.137864 30228 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:03.144423 30228 tablet_bootstrap.cc:654] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.153139 30227 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:03.155257 30227 ts_tablet_manager.cc:1403] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.017s
I20260709 13:11:03.159387 30227 raft_consensus.cc:359] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.160411 30227 raft_consensus.cc:385] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.160806 30227 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.173363 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:03.174124 30113 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.180716 30228 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:03.181574 30228 ts_tablet_manager.cc:1403] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.013s
I20260709 13:11:03.184800 30228 raft_consensus.cc:359] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.185683 30228 raft_consensus.cc:385] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.186089 30228 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.185132 30227 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.187054 30228 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.189179 30227 ts_tablet_manager.cc:1434] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:11:03.189371 30228 ts_tablet_manager.cc:1434] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:03.191507 30227 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:03.191507 30228 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:03.201138 30228 tablet_bootstrap.cc:654] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.202101 30271 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.210726 30227 tablet_bootstrap.cc:654] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:03.212172 30150 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.62.190:37953, user_credentials={real_user=slave}} blocked reactor thread for 98203.2us
W20260709 13:11:03.213151 30150 leader_election.cc:343] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.213732 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:03.216027 30232 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.216885 30228 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:03.224210 30228 ts_tablet_manager.cc:1403] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:11:03.224347 30110 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:03.226222 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:03.227247 30271 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.227828 30271 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:03.228932 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:03.229861 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:03.233007 30187 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.234350 30113 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:03.235908 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:03.236831 30303 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.229858 30185 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.237416 30303 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:03.228946 30228 raft_consensus.cc:359] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.241717 30228 raft_consensus.cc:385] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.242244 30228 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.240602 30303 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.242964 30228 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.228932 30271 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.247426 30229 tablet_bootstrap.cc:492] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:03.248020 30229 ts_tablet_manager.cc:1403] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.159s	user 0.031s	sys 0.040s
I20260709 13:11:03.250995 30228 ts_tablet_manager.cc:1434] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:11:03.253218 30228 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:03.277359 30185 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:03.279142 30229 raft_consensus.cc:359] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.280752 30229 raft_consensus.cc:385] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.281121 30229 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.281904 30229 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:03.294575 30240 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.303544 30187 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:04.031131 30227 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.031744 30227 ts_tablet_manager.cc:1403] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.840s	user 0.039s	sys 0.058s
I20260709 13:11:04.034303 30227 raft_consensus.cc:359] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.034974 30227 raft_consensus.cc:385] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.035256 30227 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.036335 30227 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.038344 30227 ts_tablet_manager.cc:1434] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:11:04.039052 30227 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.045235 30227 tablet_bootstrap.cc:654] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.051139 30227 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.051632 30227 ts_tablet_manager.cc:1403] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:11:04.054248 30227 raft_consensus.cc:359] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.054968 30227 raft_consensus.cc:385] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.055240 30227 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.055940 30227 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.057885 30227 ts_tablet_manager.cc:1434] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:04.059301 30227 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.066048 30227 tablet_bootstrap.cc:654] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.072157 30227 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.072623 30227 ts_tablet_manager.cc:1403] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:11:04.075155 30227 raft_consensus.cc:359] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.075795 30227 raft_consensus.cc:385] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.076050 30227 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.076683 30227 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.078143 30227 ts_tablet_manager.cc:1434] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:11:04.078964 30227 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.085044 30227 tablet_bootstrap.cc:654] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.091572 30374 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.095026 30351 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.095549 30351 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.096444 30377 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.096935 30377 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.098867 30377 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.103206 30351 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.095567 30227 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.104139 30227 ts_tablet_manager.cc:1403] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:11:04.105298 30379 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.105959 30379 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.108779 30379 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.109683 30227 raft_consensus.cc:359] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.110450 30227 raft_consensus.cc:385] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.113620 30227 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.114894 30379 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.115391 30379 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.114771 30227 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:04.116246 30002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.006s	sys 0.019s
W20260709 13:11:04.116773 30002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.006s	sys 0.019s
I20260709 13:11:04.117363 30379 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.117841 30227 ts_tablet_manager.cc:1434] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:11:04.118737 30227 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.118824 30036 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.121580 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 867946us
I20260709 13:11:04.125635 30227 tablet_bootstrap.cc:654] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.125950 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.128444 30151 leader_election.cc:343] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.132306 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.134384 30151 leader_election.cc:343] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:04.139747 30229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.007s	sys 0.020s
W20260709 13:11:04.140255 30229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.007s	sys 0.020s
I20260709 13:11:04.142560 30374 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.142902 30228 tablet_bootstrap.cc:700] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Time spent opening tablet: real 0.817s	user 0.015s	sys 0.028s
I20260709 13:11:04.144586 30228 tablet_bootstrap.cc:654] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.146517 30229 ts_tablet_manager.cc:1434] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.898s	user 0.012s	sys 0.024s
W20260709 13:11:04.146971 30229 ts_tablet_manager.cc:1467] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Tablet startup took 898ms
W20260709 13:11:04.147310 30229 ts_tablet_manager.cc:1469] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Trace:
0709 13:10:59.974430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.974602 (+   172us) service_pool.cc:224] Handling call
0709 13:10:59.976731 (+  2129us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:59.976847 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:00.033197 (+ 56350us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:00.119549 (+ 86352us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:00.120211 (+   662us) inbound_call.cc:177] Queueing success response
0709 13:11:03.089240 (+2969029us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:03.248330 (+159090us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:03.248888 (+   558us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:03.252142 (+  3254us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":14961,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":3758,"tablet-open.queue_time_us":2969112,"thread_start_us":857310,"threads_started":1}
I20260709 13:11:04.159407 30229 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:04.168051 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.172447 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.173660 30077 consensus_peers.cc:597] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:04.175428 30351 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:11:04.178145 30077 leader_election.cc:343] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.190613 30229 tablet_bootstrap.cc:654] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:04.191021 30077 leader_election.cc:343] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.202339 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.212316 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.213037 30109 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:04.223346 30227 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.223860 30227 ts_tablet_manager.cc:1403] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.105s	user 0.024s	sys 0.022s
I20260709 13:11:04.236912 29935 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 40) took 1004 ms. Trace:
I20260709 13:11:04.237619 29935 rpcz_store.cc:276] 0709 13:11:03.232134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.238289 (+  6155us) service_pool.cc:224] Handling call
0709 13:11:04.236816 (+998527us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:11:04.239185 29936 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.248850 30228 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:04.249604 30228 ts_tablet_manager.cc:1403] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.997s	user 0.026s	sys 0.039s
I20260709 13:11:04.252035 30227 raft_consensus.cc:359] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.253002 30227 raft_consensus.cc:385] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.253422 30227 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
W20260709 13:11:04.254063 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:04.254293 30227 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.257231 30227 ts_tablet_manager.cc:1434] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:11:04.279412 30326 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.280084 30326 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.308964 30228 raft_consensus.cc:359] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.346725 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:04.408198 30181 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:04.386497 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:04.409080 30180 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:04.350015 30289 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.410530 30289 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.411310 30228 raft_consensus.cc:385] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.404327 30227 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.411914 30228 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.416633 30228 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.419162 30228 ts_tablet_manager.cc:1434] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.169s	user 0.009s	sys 0.006s
I20260709 13:11:04.420027 30228 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
W20260709 13:11:04.338403 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800035060 after lost signal to thread 28925
I20260709 13:11:04.355244 30271 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.355201 30327 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:04.329891 30150 leader_election.cc:343] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.425868 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.425283 30327 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:04.430581 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800035740 after lost signal to thread 29970
W20260709 13:11:04.431588 30151 leader_election.cc:343] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:04.432157 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800133b80 after lost signal to thread 30062
W20260709 13:11:04.433482 29967 debug-util.cc:398] Leaking SignalData structure 0x7b080017e540 after lost signal to thread 30137
I20260709 13:11:04.428997 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.434613 30263 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:04.434897 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800227300 after lost signal to thread 30211
W20260709 13:11:04.435721 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105895us
I20260709 13:11:04.439077 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:04.439916 30263 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.440275 30263 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.440622 30263 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.448801 30327 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.450919 30229 tablet_bootstrap.cc:492] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:04.451447 30229 ts_tablet_manager.cc:1403] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.292s	user 0.015s	sys 0.027s
I20260709 13:11:04.429389 30289 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.454591 30229 raft_consensus.cc:359] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.455348 30229 raft_consensus.cc:385] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.455612 30229 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.456264 30229 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.427345 30271 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.459154 30271 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.461490 30229 ts_tablet_manager.cc:1434] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:04.462078 30228 tablet_bootstrap.cc:654] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.462450 30229 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:04.462114 30227 tablet_bootstrap.cc:654] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.463511 30326 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.465813 30271 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.466509 30289 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.467132 30289 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.467837 30351 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.468175 30261 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.469679 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.474956 30229 tablet_bootstrap.cc:654] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.466533 30374 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:04.468669 30261 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.477984 30289 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.477559 30351 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.511654 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.516209 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.520761 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:04.528707 30181 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:04.533130 30261 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.534149 30263 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.511934 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:11:04.540840 30151 leader_election.cc:343] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:04.541018 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59367us
I20260709 13:11:04.527046 30038 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:04.525640 30271 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.539006 30227 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.544761 30227 ts_tablet_manager.cc:1403] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.287s	user 0.034s	sys 0.023s
I20260709 13:11:04.542204 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.548513 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:04.551545 30326 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.545948 30271 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.552006 30326 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.552459 30326 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.553731 30271 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.545070 30351 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.555821 30351 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.556236 30351 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.558808 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:04.561590 30151 leader_election.cc:343] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.562223 30263 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.565543 30229 tablet_bootstrap.cc:492] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:04.566043 30229 ts_tablet_manager.cc:1403] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.008s
I20260709 13:11:04.565795 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:04.566601 30184 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:04.568027 30228 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:04.568498 30228 ts_tablet_manager.cc:1403] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.002s
I20260709 13:11:04.566829 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:04.570173 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:04.573298 30151 leader_election.cc:343] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.571370 30327 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.573822 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.574246 30327 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.574777 30327 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.575436 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.576191 30113 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:04.571604 30002 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:04.577917 30326 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.578503 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:04.579144 30271 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.579532 30271 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.579913 30271 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.582669 30397 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.583072 30397 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.583429 30397 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.586464 30229 raft_consensus.cc:359] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.587019 30229 raft_consensus.cc:385] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.587260 30229 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.588387 30326 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.589792 30229 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.597754 30229 ts_tablet_manager.cc:1434] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:11:04.611140 30351 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.614507 30229 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:04.620498 30327 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.627142 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:04.630752 30181 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:04.623831 30228 raft_consensus.cc:359] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.632112 30228 raft_consensus.cc:385] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.632436 30228 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.628043 30271 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.619364 30227 raft_consensus.cc:359] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.627653 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.634017 30228 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.634595 30227 raft_consensus.cc:385] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.636701 30227 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.637996 30112 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:04.643700 30263 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.644338 30263 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.638006 30397 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.647791 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.649340 30151 leader_election.cc:343] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.650558 30263 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.650712 30228 ts_tablet_manager.cc:1434] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:11:04.652179 30351 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.652518 30228 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:04.649273 30327 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.657951 30227 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.657727 30397 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.667502 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.667059 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.673478 30227 ts_tablet_manager.cc:1434] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.002s
I20260709 13:11:04.674415 30227 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.678267 30229 tablet_bootstrap.cc:654] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.679157 29934 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:11:04.680001 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:04.680912 30113 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:04.694656 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:04.699102 30327 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.701496 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:04.707204 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:04.708042 30038 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:04.708976 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:04.710263 30036 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.719883 30077 leader_election.cc:343] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.733414 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:04.734426 30109 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:04.735242 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.735935 30110 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:04.726325 30271 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.742022 30228 tablet_bootstrap.cc:654] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.746510 30261 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.747061 30261 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.749967 30263 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.750231 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:04.750864 30112 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.750532 30263 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.751056 30261 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.752852 30263 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.753000 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.754606 30151 leader_election.cc:343] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.755230 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.756757 30151 leader_election.cc:343] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.758168 30112 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:04.759315 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:04.760035 30303 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.760567 30303 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:04.761384 30303 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.772394 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:04.773121 30184 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.769640 30036 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:04.774678 30229 tablet_bootstrap.cc:492] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:04.775147 30229 ts_tablet_manager.cc:1403] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 13:11:04.779053 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:04.779958 30327 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.780015 30229 raft_consensus.cc:359] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.780649 30327 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:04.781009 30229 raft_consensus.cc:385] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.781368 30229 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.782335 30229 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.784584 30229 ts_tablet_manager.cc:1434] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:04.785744 30229 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:04.791165 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.794934 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.795397 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:04.795944 30180 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:04.798550 30150 leader_election.cc:343] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.781675 30327 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.800472 30227 tablet_bootstrap.cc:654] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.814088 29935 catalog_manager.cc:5697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.819630 30229 tablet_bootstrap.cc:654] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.799546 30184 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:04.799057 30150 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.828330 30263 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:04.829543 30150 leader_election.cc:343] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.830247 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:04.833487 30150 leader_election.cc:343] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.834154 30150 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.835156 30261 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.835649 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.835807 30261 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.836464 30232 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.844276 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:04.846882 30263 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:04.846321 30150 leader_election.cc:343] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.847330 30263 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.847738 30263 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.847692 30150 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.850526 30227 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.851047 30227 ts_tablet_manager.cc:1403] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.000s
I20260709 13:11:04.852128 29936 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.857805 30289 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.859784 30227 raft_consensus.cc:359] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.860523 30227 raft_consensus.cc:385] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.860850 30227 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.860577 30263 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.861706 30227 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:04.862807 30150 leader_election.cc:343] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.866539 30228 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:04.866755 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.867025 30228 ts_tablet_manager.cc:1403] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.215s	user 0.019s	sys 0.018s
I20260709 13:11:04.866571 30227 ts_tablet_manager.cc:1434] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:04.867652 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:04.869019 30151 leader_election.cc:343] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.869215 30227 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.869678 30263 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.864528 30180 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:04.873633 30261 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.876197 30228 raft_consensus.cc:359] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.877015 30228 raft_consensus.cc:385] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.877295 30228 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.878077 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:04.878047 30228 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.879057 30184 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:04.880205 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:04.876188 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:04.880784 30184 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.881317 30180 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:04.882078 30228 ts_tablet_manager.cc:1434] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:04.883234 30228 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:04.887938 30184 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:04.889017 30229 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:04.889547 30229 ts_tablet_manager.cc:1403] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 13:11:04.892179 30229 raft_consensus.cc:359] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.901515 30229 raft_consensus.cc:385] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.902211 30229 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.895905 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:04.906064 30112 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.896037 30002 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.898768 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:04.909947 30303 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.910441 30303 raft_consensus.cc:697] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:04.910533 30327 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.911355 30303 consensus_queue.cc:237] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.899869 30261 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.913790 30261 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.904424 30228 tablet_bootstrap.cc:654] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.894778 30227 tablet_bootstrap.cc:654] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.917224 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:04.917646 30261 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.917984 30327 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.919202 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:04.920492 30112 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
W20260709 13:11:04.920605 30151 leader_election.cc:343] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.922401 30229 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.923506 30397 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.923962 30397 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.926034 30397 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:04.926601 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:04.931352 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.935956 30261 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.936512 30261 raft_consensus.cc:697] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:04.937667 30261 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.932878 30229 ts_tablet_manager.cc:1434] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:11:04.934860 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:04.945585 30229 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:04.946959 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:04.950877 30150 leader_election.cc:343] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.951377 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.952235 30263 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.953439 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:04.954418 30228 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:04.954941 30228 ts_tablet_manager.cc:1403] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.002s
I20260709 13:11:04.955078 30271 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.955574 30263 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.956033 30263 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.958091 30228 raft_consensus.cc:359] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.959028 30228 raft_consensus.cc:385] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.959378 30228 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.959949 30263 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:04.960124 30228 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.961191 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:04.963126 30151 leader_election.cc:343] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.966655 29935 catalog_manager.cc:5697] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.972257 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:04.974081 30150 leader_election.cc:343] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.974512 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:04.975507 30227 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:04.975989 30227 ts_tablet_manager.cc:1403] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.006s
I20260709 13:11:04.976948 30261 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.978708 30227 raft_consensus.cc:359] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.979409 30227 raft_consensus.cc:385] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.979682 30227 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.980387 30227 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.960807 30229 tablet_bootstrap.cc:654] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:04.983045 30227 ts_tablet_manager.cc:1434] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:04.984006 30227 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:04.993115 30229 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:04.993637 30229 ts_tablet_manager.cc:1403] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:11:04.994131 29935 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.996173 30229 raft_consensus.cc:359] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:04.996850 30229 raft_consensus.cc:385] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.997380 30229 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.998217 30228 ts_tablet_manager.cc:1434] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 13:11:04.990242 30227 tablet_bootstrap.cc:654] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.017390 30228 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.001896 30229 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.021857 30229 ts_tablet_manager.cc:1434] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:11:05.025796 30228 tablet_bootstrap.cc:654] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.034894 30229 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.035307 30227 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:05.035835 30227 ts_tablet_manager.cc:1403] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:11:05.038674 30227 raft_consensus.cc:359] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.039417 30227 raft_consensus.cc:385] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.039703 30227 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.040444 30227 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.042516 30227 ts_tablet_manager.cc:1434] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:11:05.044782 30229 tablet_bootstrap.cc:654] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.047791 30227 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:05.049634 30228 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.050096 30228 ts_tablet_manager.cc:1403] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:11:05.052723 30228 raft_consensus.cc:359] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.053359 30228 raft_consensus.cc:385] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.053627 30228 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.054011 30227 tablet_bootstrap.cc:654] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.105480 30263 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.106626 30263 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.112215 30229 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.114224 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.113188 30229 ts_tablet_manager.cc:1403] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.014s
W20260709 13:11:05.116966 30151 leader_election.cc:343] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.118400 30263 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:05.125243 30228 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.132807 30229 raft_consensus.cc:359] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.134119 30229 raft_consensus.cc:385] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.134585 30229 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.135915 30229 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.138684 30227 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:05.139554 30227 ts_tablet_manager.cc:1403] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.003s
I20260709 13:11:05.135058 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:05.164273 30150 leader_election.cc:343] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.164867 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:05.167254 30263 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.148782 30303 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.168332 30303 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.151609 30228 ts_tablet_manager.cc:1434] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.101s	user 0.003s	sys 0.006s
I20260709 13:11:05.151530 30036 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.170279 30377 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.156929 30227 raft_consensus.cc:359] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.189599 30227 raft_consensus.cc:385] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.190105 30227 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.189805 30377 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.191114 30227 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.193429 30377 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.195603 30228 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.177153 30229 ts_tablet_manager.cc:1434] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.002s
I20260709 13:11:05.197570 30229 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.175472 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.180372 30303 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.195519 30227 ts_tablet_manager.cc:1434] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.004s
I20260709 13:11:05.179404 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.204522 30184 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:05.205248 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.210574 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.211530 30180 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
W20260709 13:11:05.211771 30077 leader_election.cc:343] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.207162 30002 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:05.215636 30303 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.216204 30303 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.216683 30303 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.217885 30229 tablet_bootstrap.cc:654] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.213070 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.222946 30377 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.223475 30377 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.223889 30377 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.231623 30263 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.232323 30263 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.236783 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:05.238636 30151 leader_election.cc:343] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.239239 30227 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
W20260709 13:11:05.257249 30001 leader_election.cc:343] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.272897 30228 tablet_bootstrap.cc:654] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.280498 30232 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.280465 30351 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:05.281324 30232 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.284332 30232 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:05.285579 30263 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:05.287681 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.294454 30424 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.274351 30303 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:05.300472 30151 leader_election.cc:343] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.305878 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.299882 30398 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:05.302335 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.319366 30229 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.304788 30377 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.321106 30229 ts_tablet_manager.cc:1403] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.017s
I20260709 13:11:05.327721 30229 raft_consensus.cc:359] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.330706 30303 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.330487 30229 raft_consensus.cc:385] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.331553 30229 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.337780 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.338591 30185 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.333369 30229 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.341548 30303 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.342031 30303 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.344194 30303 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:05.354463 30150 leader_election.cc:343] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.355077 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:05.357223 30150 leader_election.cc:343] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.358117 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:05.359712 30289 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.360357 30261 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.360378 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:05.360653 30303 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.362200 30303 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.360291 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.364063 30181 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:05.364480 30303 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.365684 30377 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.368103 30002 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:05.376554 30377 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.368664 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.375458 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:05.380990 30181 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:05.382112 30377 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.382992 30228 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.383767 30228 ts_tablet_manager.cc:1403] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.189s	user 0.009s	sys 0.011s
I20260709 13:11:05.384955 30229 ts_tablet_manager.cc:1434] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:11:05.370604 30303 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.385326 30398 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.386204 30229 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.385951 30398 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.388209 30398 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.390872 30227 tablet_bootstrap.cc:654] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.391054 30228 raft_consensus.cc:359] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.389135 30303 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.392318 30228 raft_consensus.cc:385] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.392513 30303 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.392560 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.392866 30228 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.393232 30111 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:05.393672 30228 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.396078 30228 ts_tablet_manager.cc:1434] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:11:05.397181 30228 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.398290 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.402295 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.403247 30108 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:05.407768 30377 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:05.415772 30001 leader_election.cc:343] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.412386 30377 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.432144 30229 tablet_bootstrap.cc:654] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.423682 30001 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:05.429150 30228 tablet_bootstrap.cc:654] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.431939 30185 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:05.419407 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.423738 30374 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:11:05.422611 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.447291 30002 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:05.447598 30181 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.448452 30034 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.437616 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.448372 30424 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.449198 30184 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
W20260709 13:11:05.418427 30077 leader_election.cc:343] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.454820 30398 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:05.426270 30425 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:05.420499 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:05.460034 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:05.460959 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:05.465189 30351 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.465777 30351 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.455040 30374 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.466251 30351 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.466852 30374 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:05.443672 30377 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.467832 30374 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.435248 30303 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.475450 30377 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.478122 30377 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.478590 30181 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:05.484345 30303 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.485755 30038 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:05.486097 30227 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:05.490489 30263 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.490520 30227 ts_tablet_manager.cc:1403] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.266s	user 0.024s	sys 0.023s
I20260709 13:11:05.502825 30398 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.507767 30351 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.512583 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.513216 30185 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.523921 30185 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:05.526310 30002 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:05.529325 30303 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.531090 30303 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:05.517138 30227 raft_consensus.cc:359] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.531379 30351 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.532927 30227 raft_consensus.cc:385] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.533329 30227 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.534565 30227 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.532593 30303 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.551755 30227 ts_tablet_manager.cc:1434] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
W20260709 13:11:05.542732 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 78937.3us
I20260709 13:11:05.555239 30227 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:05.556531 30229 tablet_bootstrap.cc:492] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.557322 30229 ts_tablet_manager.cc:1403] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.171s	user 0.005s	sys 0.010s
I20260709 13:11:05.570549 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.576854 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.577116 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:05.578137 30435 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.578749 30435 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:05.580744 30077 leader_election.cc:343] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.566407 30261 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:05.581621 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.582434 30187 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:05.584165 30229 raft_consensus.cc:359] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.584854 30229 raft_consensus.cc:385] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.585135 30229 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.586362 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:05.591588 30327 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.575039 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.590472 30229 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.582660 30001 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:05.593532 30435 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.598006 30228 tablet_bootstrap.cc:492] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.597568 30184 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:05.598500 30228 ts_tablet_manager.cc:1403] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.202s	user 0.042s	sys 0.012s
I20260709 13:11:05.600102 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.601378 30229 ts_tablet_manager.cc:1434] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:11:05.601707 30303 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.602886 30351 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.603264 30351 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.603610 30351 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.604130 30228 raft_consensus.cc:359] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.604831 30228 raft_consensus.cc:385] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.605082 30228 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.605791 30228 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.605999 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:05.609083 30109 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:05.616303 29935 catalog_manager.cc:5697] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.626633 30228 ts_tablet_manager.cc:1434] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:11:05.647261 30229 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.666515 30228 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.664546 30351 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.676496 30351 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.681814 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.682552 30181 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.685081 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:05.690114 30077 leader_election.cc:343] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.694502 29934 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.705268 30181 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:05.705603 30228 tablet_bootstrap.cc:654] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.706471 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.707561 30327 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.708191 30327 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:05.710814 30229 tablet_bootstrap.cc:654] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.709882 30327 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.714655 30227 tablet_bootstrap.cc:654] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.739763 30228 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.740587 30228 ts_tablet_manager.cc:1403] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.006s
I20260709 13:11:05.753677 30303 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.754271 30303 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.744197 30228 raft_consensus.cc:359] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.756609 30303 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.757866 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.770164 30228 raft_consensus.cc:385] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.759163 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.770445 30181 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:05.771080 30229 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.772104 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:05.772396 30229 ts_tablet_manager.cc:1403] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.031s
I20260709 13:11:05.773463 30303 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.774818 29935 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.770488 30228 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.775552 30229 raft_consensus.cc:359] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.776523 30229 raft_consensus.cc:385] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.776918 30229 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.776763 30228 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.777978 30229 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.779580 30228 ts_tablet_manager.cc:1434] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.004s
I20260709 13:11:05.781061 30229 ts_tablet_manager.cc:1434] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:11:05.782294 30229 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.769510 30227 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:05.785588 30228 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.785960 30227 ts_tablet_manager.cc:1403] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.001s
I20260709 13:11:05.789659 30229 tablet_bootstrap.cc:654] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.791814 30303 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.789155 30227 raft_consensus.cc:359] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.792762 30228 tablet_bootstrap.cc:654] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.792833 30227 raft_consensus.cc:385] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.793329 30227 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.794373 30227 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.802744 30227 ts_tablet_manager.cc:1434] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:11:05.807924 30227 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:05.809679 29936 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.812178 30261 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.812747 30261 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.816574 30261 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:05.818311 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.821025 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:05.822696 30151 leader_election.cc:343] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:05.824167 30150 leader_election.cc:343] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.824674 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:05.825591 30261 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.830699 30229 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.831241 30228 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.831248 30229 ts_tablet_manager.cc:1403] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.016s
I20260709 13:11:05.831791 30228 ts_tablet_manager.cc:1403] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.007s
I20260709 13:11:05.834600 30227 tablet_bootstrap.cc:654] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.835044 30229 raft_consensus.cc:359] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.835114 30228 raft_consensus.cc:359] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.836036 30229 raft_consensus.cc:385] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.836071 30228 raft_consensus.cc:385] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.836535 30229 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.836789 30228 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.837682 30228 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.837615 30229 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.840245 30228 ts_tablet_manager.cc:1434] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:05.841423 30228 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:05.844424 30435 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.845475 30229 ts_tablet_manager.cc:1434] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:11:05.845041 30435 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.846491 30227 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:05.846601 30229 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:05.847029 30227 ts_tablet_manager.cc:1403] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.000s
I20260709 13:11:05.847645 30435 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.848941 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.850663 30228 tablet_bootstrap.cc:654] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.858407 30181 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:05.848963 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.860585 30077 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:05.861967 30077 leader_election.cc:343] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.864269 30327 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.871471 30327 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.871999 30327 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.882911 30435 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.883349 30351 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.883728 30435 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.883982 30351 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.886811 30377 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.887508 30377 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.890808 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.890758 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.893623 30181 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:05.891561 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.894361 30034 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:05.891556 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:05.891638 30184 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:05.898097 30377 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.888348 30351 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.898514 30327 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.895989 30227 raft_consensus.cc:359] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.900141 30227 raft_consensus.cc:385] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:05.900470 30227 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:05.901316 30227 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.903512 30227 ts_tablet_manager.cc:1434] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:11:05.899196 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:05.905740 30351 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.906734 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:05.906762 30351 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.908160 30351 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.908392 30227 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:05.909240 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:05.907572 30077 leader_election.cc:343] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.907725 30377 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:05.915403 30377 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.915793 30229 tablet_bootstrap.cc:654] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.915802 30377 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.916736 30327 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.886897 30435 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.914513 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:05.928222 30077 leader_election.cc:343] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.907073 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:05.930636 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.931473 30181 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:05.931631 30184 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.934545 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:05.934299 30374 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.937234 30227 tablet_bootstrap.cc:654] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:05.945570 30435 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.940678 30377 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.950675 30377 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.952414 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:05.954066 30077 leader_election.cc:343] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:05.955214 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.955829 30187 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.957727 30351 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.960632 30351 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.961585 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:05.964977 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:05.969875 30185 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.973601 30435 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:05.974248 30034 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:05.969101 30261 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.975658 30261 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.965619 30303 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.978077 30303 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.980651 30184 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:05.973809 30187 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:05.982985 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:05.984732 30077 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.986025 30228 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:05.986025 30229 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:05.987273 30229 ts_tablet_manager.cc:1403] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.141s	user 0.032s	sys 0.041s
I20260709 13:11:05.986547 30228 ts_tablet_manager.cc:1403] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.145s	user 0.020s	sys 0.026s
I20260709 13:11:05.986533 30303 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:05.988842 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:05.990110 30435 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.990876 30435 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:05.991676 30435 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:05.994654 30034 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:05.996413 30261 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:05.997118 30374 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.997470 30351 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:05.998027 30351 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:05.998849 30351 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.003510 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:06.049141 30229 raft_consensus.cc:359] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.050091 30229 raft_consensus.cc:385] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.051169 30229 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.013675 30377 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:06.056313 30459 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:06.036407 30185 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:06.056984 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:06.061161 30151 leader_election.cc:343] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.065910 30229 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.004462 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.056339 30377 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:06.004529 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:06.077178 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 73931.3us
I20260709 13:11:06.078115 30229 ts_tablet_manager.cc:1434] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.002s
I20260709 13:11:06.078015 30228 raft_consensus.cc:359] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.078778 30228 raft_consensus.cc:385] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.079061 30228 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.079214 30229 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.079677 30228 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.082626 30187 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:06.093112 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:06.094110 30271 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.097843 30377 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.110728 30227 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.111456 30227 ts_tablet_manager.cc:1403] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.203s	user 0.026s	sys 0.010s
I20260709 13:11:06.115118 30271 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.115370 30227 raft_consensus.cc:359] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.117220 30227 raft_consensus.cc:385] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.117600 30227 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.118610 30227 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.126601 30463 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:06.132269 30227 ts_tablet_manager.cc:1434] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:06.135046 29936 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.146122 30228 ts_tablet_manager.cc:1434] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.158s	user 0.005s	sys 0.023s
W20260709 13:11:06.145206 30150 leader_election.cc:343] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.133949 30227 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.147058 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.148910 30229 tablet_bootstrap.cc:654] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.152910 30228 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:06.149608 30232 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.173585 30468 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:11:06.174996 30303 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:06.179062 29933 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.183554 30232 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.180635 29933 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.184868 30228 tablet_bootstrap.cc:654] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.184224 30232 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.187885 30232 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.190086 30227 tablet_bootstrap.cc:654] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.191895 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.193521 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:06.195027 30150 leader_election.cc:343] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:06.196661 30151 leader_election.cc:343] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.197177 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.198892 30289 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.201802 30229 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.202345 30229 ts_tablet_manager.cc:1403] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.006s
I20260709 13:11:06.205986 30271 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:06.208377 30463 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:06.208287 30229 raft_consensus.cc:359] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.209306 30229 raft_consensus.cc:385] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.209733 30229 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.210532 30229 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.213482 30229 ts_tablet_manager.cc:1434] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:06.216367 30229 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.221587 30468 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:11:06.280550 30229 tablet_bootstrap.cc:654] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.296367 30228 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:06.296887 30228 ts_tablet_manager.cc:1403] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.144s	user 0.031s	sys 0.014s
I20260709 13:11:06.307267 30228 raft_consensus.cc:359] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.308331 30228 raft_consensus.cc:385] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.308725 30228 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.309756 30228 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.314519 30229 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.315241 30227 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.315194 30229 ts_tablet_manager.cc:1403] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.000s
I20260709 13:11:06.315698 30227 ts_tablet_manager.cc:1403] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.008s
I20260709 13:11:06.317600 30227 raft_consensus.cc:359] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.318260 30227 raft_consensus.cc:385] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.318512 30227 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.319299 30227 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.318531 30228 ts_tablet_manager.cc:1434] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:11:06.319342 30229 raft_consensus.cc:359] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.321731 30229 raft_consensus.cc:385] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.322260 30229 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.321302 30228 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:06.329732 30229 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.332356 30229 ts_tablet_manager.cc:1434] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:11:06.334228 30229 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.337675 30227 ts_tablet_manager.cc:1434] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:11:06.338493 30228 tablet_bootstrap.cc:654] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.341996 30271 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.342319 30227 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.342574 30271 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.345139 30271 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.348344 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.349270 30185 raft_consensus.cc:2393] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:06.353969 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.356730 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:06.358707 30397 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.362687 30229 tablet_bootstrap.cc:654] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.373654 30467 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.374967 30467 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.377383 30227 tablet_bootstrap.cc:654] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.379316 30467 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.382843 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.384205 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.384907 30185 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:06.386237 30397 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:06.386957 30077 leader_election.cc:343] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.387754 30229 tablet_bootstrap.cc:492] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.388263 30229 ts_tablet_manager.cc:1403] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.007s
I20260709 13:11:06.388607 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:06.389576 30467 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.390013 30467 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.390450 30467 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.391129 30229 raft_consensus.cc:359] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.391912 30229 raft_consensus.cc:385] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.392212 30229 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.395002 30229 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.397217 30229 ts_tablet_manager.cc:1434] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:11:06.398136 30227 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.398603 30229 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.398650 30227 ts_tablet_manager.cc:1403] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.008s
I20260709 13:11:06.401929 30227 raft_consensus.cc:359] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.402627 30227 raft_consensus.cc:385] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.402863 30424 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.402911 30227 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.403539 30424 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.404129 30227 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.406491 30229 tablet_bootstrap.cc:654] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.410810 30227 ts_tablet_manager.cc:1434] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:11:06.411971 30227 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.414500 30424 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.415282 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.415987 30185 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:06.422806 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.425019 30397 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.425524 30397 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.425905 30397 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.426206 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:06.428818 30001 leader_election.cc:343] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.430227 30229 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.430720 30229 ts_tablet_manager.cc:1403] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 13:11:06.433893 30229 raft_consensus.cc:359] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.434593 30229 raft_consensus.cc:385] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.434875 30229 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.435532 30229 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.436084 30227 tablet_bootstrap.cc:654] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.437774 30229 ts_tablet_manager.cc:1434] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:06.438809 30229 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.440119 30228 tablet_bootstrap.cc:492] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:06.440542 30228 ts_tablet_manager.cc:1403] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.026s
I20260709 13:11:06.436255 30467 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.446861 30271 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.447647 30271 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.459910 30229 tablet_bootstrap.cc:654] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.462213 30227 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.462754 30227 ts_tablet_manager.cc:1403] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 13:11:06.462549 30228 raft_consensus.cc:359] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.463250 30228 raft_consensus.cc:385] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.463531 30228 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.464062 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.464799 30185 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:06.459903 30397 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.466349 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.467834 30424 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.468246 30467 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.468247 30424 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.469584 30424 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.470633 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:06.471298 30185 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.476179 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.477486 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:06.478785 30001 leader_election.cc:343] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.478648 30227 raft_consensus.cc:359] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.479439 30227 raft_consensus.cc:385] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.479882 30227 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.480553 30397 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.480625 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:06.481328 30187 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.484182 30185 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:06.485472 30227 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.488497 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.493112 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:06.494716 30036 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.498160 30303 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.498677 30303 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:06.499253 30077 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:06.499476 30303 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.501633 30261 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.502151 30261 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.503548 30187 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:06.505440 30232 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.505951 30468 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:06.505905 30232 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.507256 30261 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.507969 30232 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.504987 30271 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.504237 30228 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.508980 30104 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.509994 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.510715 30037 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:06.511837 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.513763 30151 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:06.514820 30151 leader_election.cc:343] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.515537 30232 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.515959 30232 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:06.516247 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:06.516314 30232 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.520169 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.521561 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.522087 30468 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.522439 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.522579 30468 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:06.523507 30468 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.526172 30232 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.526770 30106 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:06.527253 30289 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.533437 30289 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.540964 30289 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.542788 30232 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.543625 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:06.544346 30037 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.544230 30424 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.545588 30467 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:06.531273 30104 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:06.550702 30228 ts_tablet_manager.cc:1434] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.005s
I20260709 13:11:06.551759 30228 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:06.560058 30036 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
W20260709 13:11:06.569363 30150 leader_election.cc:343] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.561038 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.573297 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:06.574152 30151 leader_election.cc:343] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.571776 30150 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.574728 29935 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.576337 30227 ts_tablet_manager.cc:1434] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.002s
W20260709 13:11:06.578325 30150 leader_election.cc:343] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.578647 30150 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.580741 30289 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.582585 30289 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.585706 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:06.593889 30424 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.589543 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:06.620760 30001 leader_election.cc:343] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.621520 30228 tablet_bootstrap.cc:654] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.625252 30108 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.633044 30229 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.633778 30229 ts_tablet_manager.cc:1403] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.195s	user 0.064s	sys 0.025s
I20260709 13:11:06.636883 30037 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:06.642514 30229 raft_consensus.cc:359] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.643162 30229 raft_consensus.cc:385] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.646591 30227 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.643428 30229 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.652787 30229 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.666914 30229 ts_tablet_manager.cc:1434] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:11:06.668370 30229 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.669867 30227 tablet_bootstrap.cc:654] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:06.688539 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 110222us
I20260709 13:11:06.697263 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:06.699203 30184 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.708251 30377 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:06.694837 30468 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:11:06.721555 30289 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.722054 30289 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.724061 30289 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.732468 29935 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.734794 30232 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.735358 30232 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.737805 30232 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:06.738668 30151 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.740911 30490 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.741494 30490 raft_consensus.cc:697] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:06.741506 30227 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.742300 30227 ts_tablet_manager.cc:1403] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.012s
I20260709 13:11:06.742426 30108 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:06.742476 30490 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.745029 30227 raft_consensus.cc:359] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.751698 30227 raft_consensus.cc:385] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.751982 30227 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.750541 30228 tablet_bootstrap.cc:492] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:06.753602 30228 ts_tablet_manager.cc:1403] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.202s	user 0.024s	sys 0.008s
I20260709 13:11:06.755894 30229 tablet_bootstrap.cc:654] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.752655 30227 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.760131 30227 ts_tablet_manager.cc:1434] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:11:06.761152 30227 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.762323 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.761404 30463 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:11:06.763500 30435 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.763983 30435 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.765205 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.766036 30435 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.765890 30228 raft_consensus.cc:359] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.766544 30228 raft_consensus.cc:385] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.766841 30228 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.767489 30228 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.770411 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:06.772363 30077 leader_election.cc:343] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.773198 30228 ts_tablet_manager.cc:1434] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:11:06.770244 30184 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
W20260709 13:11:06.780373 30150 leader_election.cc:343] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:06.781468 30150 leader_election.cc:343] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.778389 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.794879 30228 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:06.798833 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.800195 30397 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.800716 30397 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:06.801687 30229 tablet_bootstrap.cc:492] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.802307 30229 ts_tablet_manager.cc:1403] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.006s
I20260709 13:11:06.794626 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:06.796301 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.816560 30179 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:06.818843 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:06.823691 30435 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.824316 30435 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.824887 30435 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:06.825680 30151 leader_election.cc:343] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.826280 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.827241 30490 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:06.827490 30151 leader_election.cc:343] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.828096 30151 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.829960 30490 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.831889 30228 tablet_bootstrap.cc:654] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.801648 30397 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.843340 30424 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.843919 30424 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.856959 30435 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.861846 30435 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.862502 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:06.864475 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:06.865484 30187 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.865500 29936 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 2, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:06.873132 30187 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:06.874614 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:06.875497 30435 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.876241 30435 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:06.877177 30435 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.887285 30229 raft_consensus.cc:359] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.887892 30229 raft_consensus.cc:385] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.888253 30229 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.888927 30229 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.890239 30229 ts_tablet_manager.cc:1434] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:11:06.891192 30229 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:06.892913 29936 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.896251 30424 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.898232 30034 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.911836 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:06.913604 30001 leader_election.cc:343] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:06.913918 30227 tablet_bootstrap.cc:654] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.923607 30034 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:06.927922 30229 tablet_bootstrap.cc:654] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:06.931010 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.951467 29936 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.953531 30228 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:06.937161 30186 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:06.954430 30228 ts_tablet_manager.cc:1403] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.018s
I20260709 13:11:06.955531 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:06.956383 30303 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:06.956727 30303 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.957036 30303 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.963539 30424 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.964102 30424 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.965945 30228 raft_consensus.cc:359] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.966617 30424 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.966921 30228 raft_consensus.cc:385] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.967338 30228 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.963966 30303 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.969637 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:06.970772 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:06.971802 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:06.973555 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:06.975657 30397 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:06.976794 30303 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:06.977380 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:06.978086 30180 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.977777 30228 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.978430 30227 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:06.980054 30110 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:06.981935 30227 ts_tablet_manager.cc:1403] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.221s	user 0.025s	sys 0.003s
I20260709 13:11:06.984671 30227 raft_consensus.cc:359] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.985422 30227 raft_consensus.cc:385] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.985729 30227 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.986245 30435 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:06.986388 30227 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.988732 30227 ts_tablet_manager.cc:1434] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:06.988626 30110 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:06.981220 30229 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:06.989853 30229 ts_tablet_manager.cc:1403] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.099s	user 0.005s	sys 0.019s
I20260709 13:11:06.992518 30229 raft_consensus.cc:359] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.992583 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:06.993229 30229 raft_consensus.cc:385] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:06.993585 30229 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:06.994144 30397 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:06.994246 30229 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.994910 30397 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:06.995918 30397 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:06.997103 30227 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:06.996465 30229 ts_tablet_manager.cc:1434] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:06.999867 30229 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.005630 30229 tablet_bootstrap.cc:654] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.007957 30228 ts_tablet_manager.cc:1434] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.001s
I20260709 13:11:07.016284 30228 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.021044 30180 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.038805 30227 tablet_bootstrap.cc:654] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.031080 29934 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.044848 30228 tablet_bootstrap.cc:654] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.058768 30397 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.070755 30463 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.071133 30034 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.061192 30227 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.074040 30227 ts_tablet_manager.cc:1403] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.006s
I20260709 13:11:07.075297 30463 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.078220 30463 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.081089 30463 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.086143 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.086269 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.098691 30186 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:07.093577 30397 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.102867 30227 raft_consensus.cc:359] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.111549 30227 raft_consensus.cc:385] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.109524 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:07.112128 30227 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.118202 30227 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.116557 30463 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.140789 30227 ts_tablet_manager.cc:1434] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:11:07.142395 30227 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.143042 30463 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.195856 30289 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.196424 30289 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.198997 30227 tablet_bootstrap.cc:654] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.200470 30289 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.207615 30229 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.208133 30229 ts_tablet_manager.cc:1403] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.007s
I20260709 13:11:07.201191 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.201356 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:07.213306 30150 leader_election.cc:343] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.216287 30229 raft_consensus.cc:359] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.217016 30229 raft_consensus.cc:385] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:07.217178 30151 leader_election.cc:343] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.217716 30151 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.219128 30289 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.222899 30228 tablet_bootstrap.cc:492] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.223404 30228 ts_tablet_manager.cc:1403] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.212s	user 0.067s	sys 0.080s
I20260709 13:11:07.217308 30229 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.225426 30227 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.225970 30227 ts_tablet_manager.cc:1403] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.008s
I20260709 13:11:07.226027 30229 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.229147 30227 raft_consensus.cc:359] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.229943 30229 ts_tablet_manager.cc:1434] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:11:07.230062 30227 raft_consensus.cc:385] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.230499 30227 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.230974 30229 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.231242 30227 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.232791 30227 ts_tablet_manager.cc:1434] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:07.233705 30227 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.239054 30106 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:07.240756 30289 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.242501 30228 raft_consensus.cc:359] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.243204 30228 raft_consensus.cc:385] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.243462 30228 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.237216 30229 tablet_bootstrap.cc:654] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.244127 30228 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.266891 30227 tablet_bootstrap.cc:654] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.274467 30232 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.269282 30228 ts_tablet_manager.cc:1434] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:11:07.275228 30232 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.277056 30228 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.277797 30034 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:07.279277 30232 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.280167 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.280360 30491 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.281760 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:07.283205 30150 leader_election.cc:343] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.280158 30490 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.283871 30490 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.284978 30228 tablet_bootstrap.cc:654] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.286134 30490 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:07.286427 30151 leader_election.cc:343] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.287781 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:07.289251 30150 leader_election.cc:343] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.291350 30151 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.294584 30232 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.295814 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:07.297986 30151 leader_election.cc:343] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.298437 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.300077 30232 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.305065 30228 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.305598 30228 ts_tablet_manager.cc:1403] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 13:11:07.308106 30228 raft_consensus.cc:359] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.308756 30228 raft_consensus.cc:385] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.309002 30228 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.317477 30228 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.319075 30228 ts_tablet_manager.cc:1434] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:11:07.320019 30228 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.325762 30397 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.335585 30228 tablet_bootstrap.cc:654] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.346732 30397 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.350312 30227 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.350831 30227 ts_tablet_manager.cc:1403] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.002s
I20260709 13:11:07.351071 30229 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.351579 30229 ts_tablet_manager.cc:1403] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.121s	user 0.045s	sys 0.045s
I20260709 13:11:07.361768 30229 raft_consensus.cc:359] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.362875 30229 raft_consensus.cc:385] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.363189 30229 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.363958 30229 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.365598 30228 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.366398 30228 ts_tablet_manager.cc:1403] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.002s
I20260709 13:11:07.367156 30229 ts_tablet_manager.cc:1434] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:07.369225 30227 raft_consensus.cc:359] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.370430 30227 raft_consensus.cc:385] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.370734 30227 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.371529 30227 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.375165 30229 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.375701 30227 ts_tablet_manager.cc:1434] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:11:07.393582 30229 tablet_bootstrap.cc:654] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.369622 30228 raft_consensus.cc:359] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.394850 30228 raft_consensus.cc:385] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.394871 30227 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.395264 30228 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.396128 30491 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.396766 30491 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.399164 30491 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.399858 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.400532 30228 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.400792 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:07.401564 30151 leader_election.cc:343] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:07.402731 30150 leader_election.cc:343] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.402834 30228 ts_tablet_manager.cc:1434] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:11:07.403157 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.404444 30228 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.404461 30491 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.410616 30227 tablet_bootstrap.cc:654] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.413590 30228 tablet_bootstrap.cc:654] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.419114 30229 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.419696 30229 ts_tablet_manager.cc:1403] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.007s
I20260709 13:11:07.423791 30229 raft_consensus.cc:359] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.424542 30229 raft_consensus.cc:385] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.424753 30397 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.426306 30229 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.425918 30463 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.427176 30397 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.427480 30229 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.429185 30397 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.429636 30229 ts_tablet_manager.cc:1434] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:11:07.430624 30229 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.430969 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.431563 30184 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.434070 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.436663 30002 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:07.437716 30397 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.438191 30397 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.438601 30397 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:07.441316 30001 leader_election.cc:343] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.469653 30227 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.470144 30227 ts_tablet_manager.cc:1403] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.029s
I20260709 13:11:07.477068 30232 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.477846 30232 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.484360 30229 tablet_bootstrap.cc:654] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.482340 30232 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.484025 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.484090 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.485913 30397 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.487385 30227 raft_consensus.cc:359] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:07.490581 30151 leader_election.cc:343] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:07.492367 30150 leader_election.cc:343] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.493307 30150 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.494323 30374 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.494798 30374 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.495896 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:07.496467 30232 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:07.497663 30001 leader_election.cc:343] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.498400 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.499009 30104 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.501260 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:07.501828 30227 raft_consensus.cc:385] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.501705 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:07.502146 30186 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.502532 30424 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.502888 30424 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.503189 30424 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.512442 30227 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.509574 30303 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:07.518494 30227 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.521522 30228 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.512252 30377 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:11:07.522249 30228 ts_tablet_manager.cc:1403] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.017s
I20260709 13:11:07.522722 30374 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.512336 30424 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.497352 30397 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.532991 30228 raft_consensus.cc:359] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.533710 30228 raft_consensus.cc:385] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.533371 30227 ts_tablet_manager.cc:1434] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.005s
I20260709 13:11:07.532554 30397 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.532338 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:07.536038 30104 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.534008 30228 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.535513 30397 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.537222 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.538065 30184 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.539301 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.539902 30110 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.541148 30001 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:07.544072 30397 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.545816 30529 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.545743 30397 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:07.547705 30227 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.544909 30104 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.546265 30529 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.550048 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:07.549103 30228 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.565214 30229 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.565678 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:07.567610 30228 ts_tablet_manager.cc:1434] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:11:07.551378 30424 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.553426 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.568789 30374 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.580543 30374 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:07.581597 30374 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.584369 30187 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.553575 30184 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.551898 30529 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.598398 30228 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.618598 30229 ts_tablet_manager.cc:1403] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.188s	user 0.025s	sys 0.011s
I20260709 13:11:07.638500 30186 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.642078 30529 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.644326 30529 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.651599 30184 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
W20260709 13:11:07.651937 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:07.656606 30002 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:07.657308 30228 tablet_bootstrap.cc:654] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.659281 30424 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.659824 30424 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:07.660640 30424 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.667508 30227 tablet_bootstrap.cc:654] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.678748 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:07.687999 30184 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.700501 30229 raft_consensus.cc:359] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.701141 30229 raft_consensus.cc:385] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.701413 30229 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.702138 30229 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.703375 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:07.703953 30110 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.706288 30184 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.708250 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:07.709920 30537 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.710594 30537 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.712416 30227 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.712893 30227 ts_tablet_manager.cc:1403] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.001s
I20260709 13:11:07.711220 30397 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.713655 30229 ts_tablet_manager.cc:1434] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 13:11:07.713806 30397 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:07.719831 30397 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.720938 30110 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.722515 30229 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.738394 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.739054 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.739661 30185 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:07.725930 30228 tablet_bootstrap.cc:492] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.741252 30228 ts_tablet_manager.cc:1403] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.151s	user 0.022s	sys 0.010s
I20260709 13:11:07.741187 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:07.742197 30077 leader_election.cc:343] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.742828 30377 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.743162 30377 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.743449 30377 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.727288 30227 raft_consensus.cc:359] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.730533 29936 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.744822 30227 raft_consensus.cc:385] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.745105 30227 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.735332 30537 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.746543 30227 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.748837 30227 ts_tablet_manager.cc:1434] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.000s
I20260709 13:11:07.751672 30377 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.751873 30228 raft_consensus.cc:359] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.755205 30228 raft_consensus.cc:385] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.755607 30228 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.755837 30227 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.756021 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:07.757486 30228 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.759109 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:07.763986 30185 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:07.762578 30077 leader_election.cc:343] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.765057 30228 ts_tablet_manager.cc:1434] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:11:07.763005 30377 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.767388 30228 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.774240 30185 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:07.775642 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:07.780892 30227 tablet_bootstrap.cc:654] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.786509 30377 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.787111 30229 tablet_bootstrap.cc:654] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.787351 30377 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:07.788681 30377 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.793421 30227 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.793928 30227 ts_tablet_manager.cc:1403] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.038s	user 0.002s	sys 0.022s
I20260709 13:11:07.795420 30228 tablet_bootstrap.cc:654] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.796725 30227 raft_consensus.cc:359] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.797448 30227 raft_consensus.cc:385] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.797698 30227 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.798466 30227 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.801379 30227 ts_tablet_manager.cc:1434] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:07.802372 30537 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.802549 30227 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.802912 30537 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.804997 30537 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.809638 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.810359 30184 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:07.809327 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.811285 30033 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:07.812388 30227 tablet_bootstrap.cc:654] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.814817 30229 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.815608 30229 ts_tablet_manager.cc:1403] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.002s
I20260709 13:11:07.816145 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:07.817834 30541 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.818226 30541 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.818612 30541 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.821560 30397 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.822036 30397 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.820891 29933 catalog_manager.cc:5697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.823817 30228 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:07.824285 30228 ts_tablet_manager.cc:1403] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.008s
I20260709 13:11:07.823856 29933 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.826747 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:07.827422 30185 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.828111 30229 raft_consensus.cc:359] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.828750 30229 raft_consensus.cc:385] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.829005 30229 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.829221 30002 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:07.829679 30229 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.830165 30271 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:07.830539 30271 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.830868 30271 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.831722 30229 ts_tablet_manager.cc:1434] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:11:07.832676 30229 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:07.837489 30228 raft_consensus.cc:359] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.838145 30228 raft_consensus.cc:385] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.838413 30228 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.839062 30228 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.841514 30228 ts_tablet_manager.cc:1434] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:07.842329 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.842895 30104 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:07.843619 30227 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:07.844084 30227 ts_tablet_manager.cc:1403] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.005s
I20260709 13:11:07.824198 30397 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.845472 30228 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:07.839576 30271 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.850811 30541 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.852654 30227 raft_consensus.cc:359] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.853207 30227 raft_consensus.cc:385] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.853441 30227 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.854319 29936 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.855715 30227 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.864812 30229 tablet_bootstrap.cc:654] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.873631 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:07.874377 30034 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.876857 30271 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.878296 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:07.878957 30110 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.879453 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:07.880203 30185 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.889936 30227 ts_tablet_manager.cc:1434] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:11:07.895540 30541 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:07.902408 30034 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:07.900818 30110 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.909619 30491 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.913568 30491 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.914618 30185 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:07.911602 30227 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:07.916535 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.917577 30491 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.917795 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:07.917999 30151 leader_election.cc:343] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.918440 30184 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:07.919610 30232 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.920044 30232 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.905525 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:07.929584 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:07.931624 30374 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.933158 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.933355 30374 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:07.934329 30374 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.934567 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:07.937937 30228 tablet_bootstrap.cc:654] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:07.938709 30151 leader_election.cc:343] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.940084 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:07.930001 30541 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:07.945022 30184 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:07.948668 30232 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:07.949450 30541 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:07.950736 30541 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.960500 30229 tablet_bootstrap.cc:492] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:07.961270 30229 ts_tablet_manager.cc:1403] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.006s
I20260709 13:11:07.965263 30229 raft_consensus.cc:359] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.966343 30229 raft_consensus.cc:385] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:07.966647 30227 tablet_bootstrap.cc:654] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:07.966714 30229 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:07.968448 30229 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:07.973264 30271 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:07.973732 30229 ts_tablet_manager.cc:1434] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
W20260709 13:11:07.979363 30150 leader_election.cc:343] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.980005 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:07.981498 30150 leader_election.cc:343] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:07.982090 30150 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:07.986461 30064 tablet.cc:2406] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:07.983280 30551 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.982560 29936 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.990363 30491 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:07.996157 30229 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.000869 30553 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.012321 30227 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.013808 30227 ts_tablet_manager.cc:1403] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.000s
I20260709 13:11:08.017663 30553 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.021992 30553 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.024271 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:08.025703 30151 leader_election.cc:343] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.026964 30271 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.039218 30228 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.039681 30228 ts_tablet_manager.cc:1403] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.196s	user 0.027s	sys 0.001s
I20260709 13:11:08.049235 30229 tablet_bootstrap.cc:654] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.041761 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:08.053694 30150 leader_election.cc:343] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.054250 30150 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:08.053037 30537 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.054948 30228 raft_consensus.cc:359] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.055682 30228 raft_consensus.cc:385] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.055465 30537 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.056064 30228 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.056788 30228 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.058905 30228 ts_tablet_manager.cc:1434] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:11:08.059437 30553 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.059845 30228 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.064137 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.064949 30184 raft_consensus.cc:2393] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:08.057968 30537 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.061043 30374 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.061830 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.062011 30227 raft_consensus.cc:359] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.068902 30227 raft_consensus.cc:385] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.069247 30227 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.069978 30227 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.074906 30228 tablet_bootstrap.cc:654] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.076198 30227 ts_tablet_manager.cc:1434] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:11:08.086237 30227 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.087736 30229 tablet_bootstrap.cc:492] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.088187 30229 ts_tablet_manager.cc:1403] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.001s
I20260709 13:11:08.077091 29936 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.082770 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:08.083035 30104 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.102504 30227 tablet_bootstrap.cc:654] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.111017 30229 raft_consensus.cc:359] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.112020 30229 raft_consensus.cc:385] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.112386 30229 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.112668 30541 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.113375 30229 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.116364 30229 ts_tablet_manager.cc:1434] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:11:08.119694 30228 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.117794 30424 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.122426 30529 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:11:08.139958 30228 ts_tablet_manager.cc:1403] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.023s
I20260709 13:11:08.140053 30424 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.142520 30424 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.142995 30228 raft_consensus.cc:359] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.143736 30228 raft_consensus.cc:385] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.144003 30228 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.117451 30229 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.144672 30228 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.145977 30227 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.146450 30227 ts_tablet_manager.cc:1403] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.003s
I20260709 13:11:08.146528 30228 ts_tablet_manager.cc:1434] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:08.147650 30228 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.153298 30228 tablet_bootstrap.cc:654] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.152812 30229 tablet_bootstrap.cc:654] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.154675 30227 raft_consensus.cc:359] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.161108 30227 raft_consensus.cc:385] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.161521 30227 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.162247 30227 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.165203 30227 ts_tablet_manager.cc:1434] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:11:08.166251 30227 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.169585 30551 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.170077 30551 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.172637 30551 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.174750 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.175769 30229 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.176432 30229 ts_tablet_manager.cc:1403] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.010s
I20260709 13:11:08.181635 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.182588 30185 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:08.186118 30229 raft_consensus.cc:359] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.187245 30229 raft_consensus.cc:385] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.187606 30229 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.188946 30229 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.189587 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.191192 30397 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.192795 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.195386 30227 tablet_bootstrap.cc:654] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.197270 30551 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.195865 30151 leader_election.cc:343] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.197929 30551 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.198380 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:08.198678 30150 leader_election.cc:343] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.199250 30537 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.199437 30303 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.199723 30537 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.207060 30551 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.207352 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:08.209079 30151 leader_election.cc:343] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.211174 30229 ts_tablet_manager.cc:1434] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 13:11:08.216431 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:08.217531 30551 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.217988 30303 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.218819 30537 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.220682 30229 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.226893 30228 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.229355 30228 ts_tablet_manager.cc:1403] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.082s	user 0.025s	sys 0.012s
I20260709 13:11:08.232548 30228 raft_consensus.cc:359] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.233541 30228 raft_consensus.cc:385] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.233951 30228 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.234875 30228 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.237211 30229 tablet_bootstrap.cc:654] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.238245 30228 ts_tablet_manager.cc:1434] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:11:08.239555 30228 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.240859 30303 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.241753 30303 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.244058 30303 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.259757 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.260167 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.275936 30228 tablet_bootstrap.cc:654] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.285993 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.287050 30185 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:08.290117 30228 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.292341 30228 ts_tablet_manager.cc:1403] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:11:08.295291 30228 raft_consensus.cc:359] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.297168 30228 raft_consensus.cc:385] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.297577 30228 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.298333 30228 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.302078 30228 ts_tablet_manager.cc:1434] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:08.301813 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.303216 30303 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.303597 30303 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.303905 30303 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.303949 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.304945 30185 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
W20260709 13:11:08.310079 30001 leader_election.cc:343] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.312927 30303 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.323830 30228 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.324242 30303 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.332712 30228 tablet_bootstrap.cc:654] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.333778 30229 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.334504 30229 ts_tablet_manager.cc:1403] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.003s
I20260709 13:11:08.339888 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.341104 30537 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.341601 30537 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.342121 30537 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.346542 30228 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.347180 30228 ts_tablet_manager.cc:1403] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.002s
I20260709 13:11:08.350884 30537 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.352644 30537 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.346066 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:08.353924 30185 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.355705 30227 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.356364 30227 ts_tablet_manager.cc:1403] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.190s	user 0.047s	sys 0.086s
I20260709 13:11:08.360718 30227 raft_consensus.cc:359] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.361665 30227 raft_consensus.cc:385] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.362052 30227 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.362978 30227 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.364918 30227 ts_tablet_manager.cc:1434] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:11:08.366154 30227 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.368836 30228 raft_consensus.cc:359] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.369643 30228 raft_consensus.cc:385] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.369936 30228 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.370591 30228 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.371522 30303 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.374508 30227 tablet_bootstrap.cc:654] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.375067 30228 ts_tablet_manager.cc:1434] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.001s
I20260709 13:11:08.374922 30229 raft_consensus.cc:359] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.375658 30229 raft_consensus.cc:385] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.375926 30229 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.376441 30228 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.376536 30229 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.379359 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:08.383534 30077 leader_election.cc:343] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.389582 30227 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.390194 30227 ts_tablet_manager.cc:1403] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:11:08.391211 30228 tablet_bootstrap.cc:654] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.395354 30227 raft_consensus.cc:359] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.396318 30227 raft_consensus.cc:385] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.395392 30185 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:08.397125 30227 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.398886 30227 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.401636 30227 ts_tablet_manager.cc:1434] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:08.402761 30227 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.409013 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:08.409698 30033 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.427815 30227 tablet_bootstrap.cc:654] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.414427 30529 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:11:08.409617 30229 ts_tablet_manager.cc:1434] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:11:08.433879 30229 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.434742 30033 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:08.440423 30229 tablet_bootstrap.cc:654] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.440994 30227 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.441577 30227 ts_tablet_manager.cc:1403] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.016s
I20260709 13:11:08.442631 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:08.421594 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:08.441715 30551 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.445269 30551 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.446324 30227 raft_consensus.cc:359] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.447170 30227 raft_consensus.cc:385] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.444602 30180 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.447738 30227 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.448598 30227 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.442081 30553 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.450340 30553 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.451048 30227 ts_tablet_manager.cc:1434] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:08.452104 30227 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.452411 30553 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.453482 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:08.455699 30151 leader_election.cc:343] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.414855 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.457592 30424 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.458204 30424 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:08.459208 30424 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.447307 30551 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.418766 30228 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.462422 30228 ts_tablet_manager.cc:1403] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.006s
I20260709 13:11:08.465252 30228 raft_consensus.cc:359] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.465593 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.473481 30227 tablet_bootstrap.cc:654] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.466001 30228 raft_consensus.cc:385] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.474499 30228 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
W20260709 13:11:08.474943 30151 leader_election.cc:343] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.475234 30228 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.477550 30228 ts_tablet_manager.cc:1434] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:08.478663 30228 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.470074 30271 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.486124 30271 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.488459 30271 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.489603 30227 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.490236 30227 ts_tablet_manager.cc:1403] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.014s
W20260709 13:11:08.441744 30150 leader_election.cc:343] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.492179 30150 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:08.493680 30227 raft_consensus.cc:359] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.494581 30227 raft_consensus.cc:385] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.472419 30180 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:08.494975 30227 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.495862 30227 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.497942 30228 tablet_bootstrap.cc:654] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.500802 29936 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.504360 30553 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:08.506712 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65000.5us
I20260709 13:11:08.507408 30227 ts_tablet_manager.cc:1434] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:08.508513 30227 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
W20260709 13:11:08.509045 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64330.6us
I20260709 13:11:08.517623 30227 tablet_bootstrap.cc:654] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:08.546494 30001 leader_election.cc:343] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.549664 30271 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:08.551224 30574 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.551990 30574 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.555063 30574 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.561002 30227 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.561743 30227 ts_tablet_manager.cc:1403] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.018s
I20260709 13:11:08.564970 30227 raft_consensus.cc:359] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.567202 30228 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.567147 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.569514 30227 raft_consensus.cc:385] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.569646 30228 ts_tablet_manager.cc:1403] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.010s
I20260709 13:11:08.569646 30184 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:08.570062 30227 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.571306 30227 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.573333 30377 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.573915 30377 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.574258 30227 ts_tablet_manager.cc:1434] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:08.575253 30229 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.575683 30227 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.575714 30229 ts_tablet_manager.cc:1403] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.142s	user 0.026s	sys 0.017s
I20260709 13:11:08.576830 30228 raft_consensus.cc:359] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.575937 30377 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.577596 30228 raft_consensus.cc:385] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.577894 30228 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.578354 30573 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.578500 30228 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.580554 30228 ts_tablet_manager.cc:1434] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.000s
I20260709 13:11:08.582751 30228 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.582747 30229 raft_consensus.cc:359] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.587884 30229 raft_consensus.cc:385] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.588181 30229 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.588717 30227 tablet_bootstrap.cc:654] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.588837 30229 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.592247 30228 tablet_bootstrap.cc:654] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.596765 30229 ts_tablet_manager.cc:1434] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:08.598881 30229 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.603541 30424 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.604103 30424 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.605024 30229 tablet_bootstrap.cc:654] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.606359 30424 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.607553 30227 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.608618 30227 ts_tablet_manager.cc:1403] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.009s
I20260709 13:11:08.609640 30228 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.610114 30228 ts_tablet_manager.cc:1403] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.006s
I20260709 13:11:08.611848 30227 raft_consensus.cc:359] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.612715 30227 raft_consensus.cc:385] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.613065 30227 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.615223 30227 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.612794 30228 raft_consensus.cc:359] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.618309 30228 raft_consensus.cc:385] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.618616 30228 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.619259 30228 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.619756 30227 ts_tablet_manager.cc:1434] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 13:11:08.621079 30227 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Bootstrap starting.
I20260709 13:11:08.621677 30228 ts_tablet_manager.cc:1434] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:08.622587 30228 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.626644 30573 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.627257 30573 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.629216 30573 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.629922 30227 tablet_bootstrap.cc:654] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.631376 30228 tablet_bootstrap.cc:654] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:08.632553 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55571us
I20260709 13:11:08.633515 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:08.642985 30572 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:08.640439 30002 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.645358 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.645998 30185 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:08.637116 30553 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.647909 30553 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.644553 30574 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:08.663450 30574 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:08.664321 30574 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.673768 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.674513 30105 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:08.650229 30397 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.697116 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.700150 30303 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.700709 30303 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.701190 30303 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:08.712584 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44197.9us
I20260709 13:11:08.713989 30574 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:08.717324 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.718293 30186 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:08.673846 30573 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.719027 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.738492 30553 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.777597 30185 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:08.776783 30229 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.779805 30229 ts_tablet_manager.cc:1403] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.181s	user 0.020s	sys 0.050s
I20260709 13:11:08.779870 30573 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.737607 30541 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.780913 30541 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.782013 30573 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.779032 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.784816 30541 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.785903 30541 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.787151 30541 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.790328 30229 raft_consensus.cc:359] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.812577 30229 raft_consensus.cc:385] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.812845 30229 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.813444 30229 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.803124 29936 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.815148 30229 ts_tablet_manager.cc:1434] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:11:08.815999 30229 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.688891 30397 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.816493 30397 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:08.806880 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:08.692664 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.822468 30110 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:08.822825 30229 tablet_bootstrap.cc:654] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:08.808584 30151 leader_election.cc:343] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.811949 30228 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.823786 30228 ts_tablet_manager.cc:1403] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.201s	user 0.027s	sys 0.021s
I20260709 13:11:08.830284 30228 raft_consensus.cc:359] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.831073 30228 raft_consensus.cc:385] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.831368 30228 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.834088 30553 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.834707 30553 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.832077 30228 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.837358 30553 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:08.837987 30589 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:08.839103 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.748292 30303 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:08.840766 30151 leader_election.cc:343] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.841362 30303 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.851837 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:08.852551 30181 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:08.841885 30541 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.846041 30553 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.853210 30553 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.855531 30553 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:08.849730 30229 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:08.856665 30229 ts_tablet_manager.cc:1403] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 13:11:08.843511 30228 ts_tablet_manager.cc:1434] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:08.857239 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:08.858384 30228 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
W20260709 13:11:08.858880 30151 leader_election.cc:343] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.860159 30229 raft_consensus.cc:359] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.860867 30229 raft_consensus.cc:385] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.861122 30229 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.861917 30229 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.864109 30229 ts_tablet_manager.cc:1434] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:08.866585 30227 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: No bootstrap required, opened a new log
I20260709 13:11:08.867077 30227 ts_tablet_manager.cc:1403] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.005s
W20260709 13:11:08.868075 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 162990us
I20260709 13:11:08.869818 30227 raft_consensus.cc:359] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.870536 30227 raft_consensus.cc:385] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.870853 30227 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.871524 30227 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.873608 30227 ts_tablet_manager.cc:1434] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:11:08.865185 30228 tablet_bootstrap.cc:654] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.874590 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.875344 30110 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:08.876648 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.883594 30397 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.884485 30228 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:08.884951 30228 ts_tablet_manager.cc:1403] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:11:08.885856 30397 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.887751 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.888579 30109 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 0.
I20260709 13:11:08.865109 30229 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:08.893666 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.893740 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:08.895190 30228 raft_consensus.cc:359] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.895963 30228 raft_consensus.cc:385] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:08.896236 30228 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:08.897132 30228 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.899888 30228 ts_tablet_manager.cc:1434] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:08.900180 30229 tablet_bootstrap.cc:654] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:08.907981 30541 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.908517 30541 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.910383 30228 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:08.910523 30541 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.910796 30150 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:08.911742 30491 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.912215 30491 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.912585 30491 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.913496 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:08.914100 30104 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:08.918475 30150 leader_election.cc:343] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:08.919013 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:08.919844 30553 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:08.921109 30104 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:08.923377 30077 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.925803 30541 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.926205 30541 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.926580 30541 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.929075 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:08.933635 30108 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.933723 30541 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:08.938318 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68593.9us
I20260709 13:11:08.940856 30541 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.942934 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.943797 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:08.944444 30572 raft_consensus.cc:2764] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:08.945107 30572 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.945480 30572 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.945823 30572 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.947932 30150 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:08.972366 30553 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:08.972848 30553 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.973518 30553 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:08.975584 30271 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.976238 30271 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:08.985292 30271 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:08.982244 30572 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:09.017059 30150 leader_election.cc:343] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.017928 30150 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:09.018822 30232 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:09.019403 30150 leader_election.cc:343] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.019985 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:09.020833 30232 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.017207 30572 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.029675 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.030373 30104 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:09.031944 30229 tablet_bootstrap.cc:492] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:09.032599 30229 ts_tablet_manager.cc:1403] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.168s	user 0.031s	sys 0.024s
I20260709 13:11:09.033243 30303 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.033725 30303 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.027684 30553 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.064675 30232 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.065372 30232 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.020881 30491 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.062566 30108 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:09.070885 30232 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:09.071077 30491 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:09.071449 30232 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.071946 30232 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.078797 30553 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:09.078876 30232 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:09.080448 30303 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.081156 30228 tablet_bootstrap.cc:654] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:09.082156 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 55875.4us
I20260709 13:11:09.082940 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:09.084072 30303 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.085784 30229 raft_consensus.cc:359] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.086795 30229 raft_consensus.cc:385] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.087162 30229 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.088322 30303 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:09.088732 30229 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.089143 30303 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.091198 30229 ts_tablet_manager.cc:1434] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:11:09.091495 30001 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:09.094707 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:09.095948 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74775us
I20260709 13:11:09.107767 30229 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:09.113504 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.114850 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.115516 30181 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.117956 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.118587 30034 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.109193 30424 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.111493 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.131676 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.129763 30187 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.132941 30179 raft_consensus.cc:2393] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:09.134003 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.134737 30185 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.126025 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.131168 30424 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:09.149308 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.151332 30184 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:09.151424 30107 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:09.172417 30185 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:09.176863 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:09.180163 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.182319 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.182977 30031 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.183012 30424 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.183929 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:09.184554 30108 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.184713 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.180807 30603 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.194448 30603 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.198621 30603 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.192556 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.195008 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:09.195406 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.180218 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.201061 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:09.206490 30179 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.188761 30541 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.208047 30077 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:09.193704 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.209479 30541 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.211586 30537 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.211652 30541 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.212188 30537 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:09.212576 30228 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:09.212525 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.213165 30228 ts_tablet_manager.cc:1403] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.303s	user 0.020s	sys 0.004s
I20260709 13:11:09.213371 30035 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.206468 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.205533 30572 raft_consensus.cc:2764] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:09.213078 30537 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.214444 30377 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:09.214730 30180 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.210533 30105 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.219511 30187 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.210796 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.223397 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:09.232483 30033 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.239777 30108 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:09.241250 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:09.241931 30032 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.242780 30105 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:09.248339 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.249279 30228 raft_consensus.cc:359] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.249902 30228 raft_consensus.cc:385] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.250137 30228 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.251298 30228 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.248605 30541 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.248545 30603 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.257999 30228 ts_tablet_manager.cc:1434] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:11:09.258764 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.259060 30228 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:09.259531 30185 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
W20260709 13:11:09.310635 30606 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:09.314122 30229 tablet_bootstrap.cc:654] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.314954 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.316051 30184 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:09.317209 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 109237us
I20260709 13:11:09.318681 30303 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.312108 30033 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:09.314102 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:09.327385 30036 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.330215 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:09.319483 30180 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:09.329558 29933 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.336372 30077 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:09.338281 30574 raft_consensus.cc:2764] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:11:09.342650 30077 leader_election.cc:343] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.344485 30077 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:09.345889 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.350478 30537 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.362891 30599 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.363409 30599 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.364830 30187 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:09.367096 30599 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:09.362133 30541 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.371960 30541 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.376600 30002 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:09.374500 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:09.386366 30228 tablet_bootstrap.cc:654] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.387503 30109 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:09.388399 30608 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:09.375077 30537 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.392881 30036 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:09.378840 30529 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.393307 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:09.395838 30603 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.399876 30179 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
W20260709 13:11:09.410926 30077 leader_election.cc:343] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.410784 30032 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:09.415941 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.419427 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:09.420428 30611 log.cc:927] Time spent T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:09.423758 30109 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
W20260709 13:11:09.424635 30609 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:11:09.438447 30151 leader_election.cc:343] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:09.439378 30151 leader_election.cc:343] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:09.440039 30151 leader_election.cc:343] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.443674 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:09.444808 30232 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.445286 30232 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:09.446684 30232 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:09.451001 30151 leader_election.cc:343] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.452065 29936 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.459452 30229 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:09.463519 30001 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:09.465950 30603 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.465898 30303 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.466686 30603 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:09.467586 30603 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.473716 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:09.458240 29936 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.461257 30229 ts_tablet_manager.cc:1403] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.358s	user 0.015s	sys 0.010s
W20260709 13:11:09.479575 30150 leader_election.cc:343] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.481649 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:09.482698 30612 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:09.489547 30150 leader_election.cc:343] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.486994 30612 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:09.491067 30553 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.490978 30612 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.490288 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:09.480423 30229 raft_consensus.cc:359] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.499207 30229 raft_consensus.cc:385] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.499666 30229 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.502662 30553 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.504680 30150 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:09.506153 30553 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.506500 30229 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.507972 30553 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:11:09.510897 30610 log.cc:927] Time spent T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
I20260709 13:11:09.533993 30228 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:09.537681 30228 ts_tablet_manager.cc:1403] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.279s	user 0.018s	sys 0.000s
I20260709 13:11:09.539584 30553 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.543488 30229 ts_tablet_manager.cc:1434] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.004s
W20260709 13:11:09.536599 30150 leader_election.cc:343] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.547899 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:09.549731 30232 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.570156 30229 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:09.571082 30228 raft_consensus.cc:359] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.571688 30228 raft_consensus.cc:385] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.571862 30228 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.569211 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.574450 30228 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.573002 30180 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.583143 30377 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.583619 30228 ts_tablet_manager.cc:1434] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:11:09.584666 30228 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:09.586294 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.586932 30181 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.599330 30180 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:09.638685 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:09.659168 30228 tablet_bootstrap.cc:654] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.654968 30537 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.663417 30537 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:09.664677 30537 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:09.693472 30627 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:09.713884 30602 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.716320 30397 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.714682 30602 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.718501 30593 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:09.718813 30572 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.724504 30572 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.737969 30181 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:09.744511 30602 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.746553 30229 tablet_bootstrap.cc:654] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.741513 29933 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.750473 29933 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.757834 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.758498 30183 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:09.749466 30572 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.759675 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:09.757063 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:09.757093 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:09.772019 30180 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:09.778121 30002 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:09.778426 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:09.791319 30077 leader_election.cc:343] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.792865 30572 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.780725 30374 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.791713 30612 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:09.798215 30612 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.798625 30612 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.819027 30600 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.831379 30228 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:09.831853 30228 ts_tablet_manager.cc:1403] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.017s
I20260709 13:11:09.833855 30228 raft_consensus.cc:359] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.834455 30228 raft_consensus.cc:385] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.834674 30228 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.835317 30228 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.837591 30228 ts_tablet_manager.cc:1434] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:09.837706 30593 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.838532 30228 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:09.833134 30374 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:09.843461 30229 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:09.843945 30229 ts_tablet_manager.cc:1403] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.277s	user 0.015s	sys 0.009s
I20260709 13:11:09.849052 30612 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.864509 30612 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:09.867586 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:09.869267 30077 leader_election.cc:343] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:09.889899 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:09.890609 30183 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:09.902287 30228 tablet_bootstrap.cc:654] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:09.904064 30229 raft_consensus.cc:359] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.904840 30229 raft_consensus.cc:385] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:09.905112 30229 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:09.905983 30229 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:09.919226 29984 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:09.921281 30574 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.928910 29933 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.930143 30602 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:09.926535 30183 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:09.933634 29933 catalog_manager.cc:5697] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.938887 30229 ts_tablet_manager.cc:1434] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.002s
I20260709 13:11:09.940606 30229 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:09.947861 30602 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:09.951792 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:09.959443 30573 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:09.963382 30573 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:09.964324 30573 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:09.992798 30574 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.013231 29936 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.032263 30602 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.033119 30602 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.036799 30537 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.037535 30537 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.039529 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:10.042222 30151 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:10.050251 30602 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.051901 30537 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:10.054374 30001 leader_election.cc:343] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.056288 30551 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.058640 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.059417 30228 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:10.059659 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.059949 30228 ts_tablet_manager.cc:1403] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.006s
I20260709 13:11:10.060312 30181 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.063177 30228 raft_consensus.cc:359] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.063750 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:10.059333 30180 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 0.
I20260709 13:11:10.065351 30002 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:10.067420 30601 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.067956 30601 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.068421 30601 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.072798 30551 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.079381 30574 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.079988 30574 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:10.082196 30077 leader_election.cc:343] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.083410 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.085860 30574 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.087800 30229 tablet_bootstrap.cc:654] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.063977 30228 raft_consensus.cc:385] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.088616 30228 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.088363 30612 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.090350 30612 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.091020 30612 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.090857 30228 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.091889 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.092504 30180 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.095082 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:10.102458 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:10.099731 30574 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.104506 30574 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.104873 30574 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.105480 30601 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.090342 30537 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:11:10.104918 30228 ts_tablet_manager.cc:1434] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
W20260709 13:11:10.115077 30077 leader_election.cc:343] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.115401 30228 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:10.131807 30601 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.111999 30574 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.133463 30612 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.136057 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.136722 30181 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.137215 30228 tablet_bootstrap.cc:654] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.137079 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:10.159606 30574 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.164428 30612 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.181023 30181 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:10.184232 30229 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.184815 30228 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:10.185354 30228 ts_tablet_manager.cc:1403] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.072s	user 0.032s	sys 0.012s
I20260709 13:11:10.187968 30228 raft_consensus.cc:359] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.188827 30228 raft_consensus.cc:385] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.189148 30228 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.189836 30228 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.191934 30228 ts_tablet_manager.cc:1434] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:11:10.192919 30228 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:10.184862 30229 ts_tablet_manager.cc:1403] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.007s
I20260709 13:11:10.196445 30229 raft_consensus.cc:359] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.200769 30228 tablet_bootstrap.cc:654] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.200528 29933 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:10.206121 30001 leader_election.cc:343] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.206205 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.206910 30181 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.197379 30229 raft_consensus.cc:385] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.211006 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:10.212361 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.212966 30180 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.215638 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:10.215829 30181 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.209082 30229 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.226950 30228 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:10.229431 30228 ts_tablet_manager.cc:1403] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:11:10.227843 30180 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.228410 30002 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:10.231623 30229 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.233284 30228 raft_consensus.cc:359] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.235556 30600 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.241015 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:10.241122 30228 raft_consensus.cc:385] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.243433 30228 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.244215 30228 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.244921 30229 ts_tablet_manager.cc:1434] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:11:10.245339 30600 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:10.245935 30229 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.246711 30600 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.251185 30574 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.251263 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:10.251824 30574 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:10.252628 30612 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.253153 30612 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:10.252640 30574 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.253964 30612 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.254416 30551 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:10.256050 30077 leader_election.cc:343] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:10.258441 30077 leader_election.cc:343] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.259454 30377 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.260874 30228 ts_tablet_manager.cc:1434] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:11:10.262159 30228 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:10.286244 30574 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.287197 30574 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.289893 30228 tablet_bootstrap.cc:654] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.292486 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:10.293143 30574 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:10.305866 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52210.6us
I20260709 13:11:10.309546 29933 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.311774 30377 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.312300 30377 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.313586 30229 tablet_bootstrap.cc:654] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.310462 29935 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.314443 30377 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.314630 29935 catalog_manager.cc:5697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.316200 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:10.317723 30077 leader_election.cc:343] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.358777 30574 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.359059 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.359292 30574 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.359721 30183 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.365656 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.366482 30184 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 1: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:10.370476 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.370630 30228 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:10.361457 30574 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.372578 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:10.373281 30228 ts_tablet_manager.cc:1403] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.111s	user 0.023s	sys 0.024s
I20260709 13:11:10.375464 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.376107 30184 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.376403 30574 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:10.381274 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:10.372447 30612 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.382576 30612 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.371892 30377 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:10.382972 30612 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.373571 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:10.391057 30077 leader_election.cc:343] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.393031 30229 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.393043 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.395985 30612 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.396461 30591 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.397001 30591 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.397423 30591 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.402027 30229 ts_tablet_manager.cc:1403] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.007s
I20260709 13:11:10.404145 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:10.406268 30077 leader_election.cc:343] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.409693 30600 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.409791 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.411974 30183 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.412876 30591 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.410517 30600 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.424129 30600 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.428448 30574 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.430892 30591 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.399827 30612 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.432801 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.434912 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:10.435034 30228 raft_consensus.cc:359] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.437680 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:10.435813 30228 raft_consensus.cc:385] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:10.439692 30077 leader_election.cc:343] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.439785 30228 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.441188 30001 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:10.441915 30228 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.443114 30593 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.445096 30183 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.445219 30229 raft_consensus.cc:359] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.445984 30229 raft_consensus.cc:385] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.447783 30229 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.447995 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.448786 30180 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.449358 30229 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.451927 30229 ts_tablet_manager.cc:1434] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:11:10.452860 30229 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.453091 30228 ts_tablet_manager.cc:1434] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.003s
I20260709 13:11:10.454115 30228 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Bootstrap starting.
I20260709 13:11:10.470531 30180 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.472779 30228 tablet_bootstrap.cc:654] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.485108 30229 tablet_bootstrap.cc:654] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.488461 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.492777 30574 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.493322 30574 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:10.493367 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.494493 30612 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.494333 30574 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.495187 30612 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:10.496320 30612 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.506306 30228 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: No bootstrap required, opened a new log
I20260709 13:11:10.506819 30228 ts_tablet_manager.cc:1403] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.008s
I20260709 13:11:10.512245 30228 raft_consensus.cc:359] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.513235 30228 raft_consensus.cc:385] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.513569 30228 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.514268 30228 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.516058 30574 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.516537 30574 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.519117 30574 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.525744 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.526618 30179 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.527031 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:10.527719 30032 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.528910 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:10.529825 30612 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.530192 30612 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.530541 30612 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.537645 30612 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.539861 30612 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.541199 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.542205 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:10.542408 30179 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.542788 30036 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.542301 29933 catalog_manager.cc:5697] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.544276 30228 ts_tablet_manager.cc:1434] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:11:10.544243 29933 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.546461 30229 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.546937 30229 ts_tablet_manager.cc:1403] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.008s
I20260709 13:11:10.549705 30229 raft_consensus.cc:359] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.551048 30229 raft_consensus.cc:385] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.551326 30229 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.553252 30179 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.555402 30229 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.557657 30229 ts_tablet_manager.cc:1434] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:10.557757 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:10.558780 30574 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.559265 30574 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:10.559232 30612 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.560331 30574 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.566045 30229 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.563381 30036 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.581166 30229 tablet_bootstrap.cc:654] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.584066 30036 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.593472 30229 tablet_bootstrap.cc:492] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.593978 30229 ts_tablet_manager.cc:1403] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:11:10.596622 30229 raft_consensus.cc:359] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.597342 30229 raft_consensus.cc:385] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.597636 30229 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.610199 29936 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.624115 30612 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.625031 30612 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.627476 30612 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.632426 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:10.647617 30229 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.635586 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.653306 30593 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.653954 30180 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 0.
I20260709 13:11:10.653918 30593 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.658731 30593 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:10.659022 30077 leader_election.cc:343] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.660290 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.661224 30183 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:10.663017 30229 ts_tablet_manager.cc:1434] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:11:10.666152 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:10.668198 30229 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.671120 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.672031 30377 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:10.672499 30377 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.672924 30377 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.680557 30377 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.685174 30032 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.685815 30229 tablet_bootstrap.cc:654] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.698693 30377 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.687915 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:10.713490 30593 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.716845 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:10.717337 30229 tablet_bootstrap.cc:492] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.717833 30229 ts_tablet_manager.cc:1403] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.014s
I20260709 13:11:10.720683 30229 raft_consensus.cc:359] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.721374 30229 raft_consensus.cc:385] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.721839 30229 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.722534 30229 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.723804 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:10.724362 30180 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.724892 30229 ts_tablet_manager.cc:1434] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:11:10.725921 30229 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.730918 30180 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:10.733242 30601 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.736789 30229 tablet_bootstrap.cc:654] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:10.740656 30077 leader_election.cc:343] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:10.742376 30573 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.753976 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:10.754890 30377 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:10.755398 30377 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:10.766578 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:10.770290 30377 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.769220 30593 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.798018 30574 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.827395 29936 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.833957 30036 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.849426 30229 tablet_bootstrap.cc:492] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.849956 30229 ts_tablet_manager.cc:1403] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.010s
I20260709 13:11:10.855988 30229 raft_consensus.cc:359] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.858152 30229 raft_consensus.cc:385] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.858479 30229 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.859592 30229 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.860215 30591 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.862461 30229 ts_tablet_manager.cc:1434] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:11:10.863423 30229 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:10.870260 30593 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.870841 30593 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.872968 30593 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:10.874169 30229 tablet_bootstrap.cc:654] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:10.882828 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:10.884119 30183 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 1: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:10.889300 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:10.894979 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:10.903645 30377 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:10.918643 30600 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.928282 30600 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:10.938432 30377 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:10.967048 30032 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:10.974282 30229 tablet_bootstrap.cc:492] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:10.974938 30229 ts_tablet_manager.cc:1403] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.031s
I20260709 13:11:10.977690 30377 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:10.984253 30229 raft_consensus.cc:359] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.985304 30229 raft_consensus.cc:385] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:10.989880 30229 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:10.991036 30229 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:10.993618 30229 ts_tablet_manager.cc:1434] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:11:10.995524 30229 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Bootstrap starting.
I20260709 13:11:11.015877 30229 tablet_bootstrap.cc:654] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:11.048419 30612 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.056371 30574 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.057310 30229 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: No bootstrap required, opened a new log
I20260709 13:11:11.057816 30229 ts_tablet_manager.cc:1403] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 13:11:11.061381 30229 raft_consensus.cc:359] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:11.062067 30229 raft_consensus.cc:385] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:11.062311 30229 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Initialized, Role: FOLLOWER
I20260709 13:11:11.062894 30229 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:11.071085 30229 ts_tablet_manager.cc:1434] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:11.121524 30377 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.163262 30032 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:11.184971 30591 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:11.186072 30377 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:11.247906 30593 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.248512 30593 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:11.251933 30593 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:11.254581 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:11.258087 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:11.259820 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:11.260550 30374 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:11.330049 30037 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:12.005334 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:12.036151 30694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.036742 30695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:12.042498 30697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:12.043675 28922 server_base.cc:1061] running on GCE node
I20260709 13:11:12.047406 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:12.047736 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:12.048043 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602672048022 us; error 0 us; skew 500 ppm
I20260709 13:11:12.049211 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:12.058109 28922 webserver.cc:533] Webserver started at http://127.28.62.132:37405/ using document root <none> and password file <none>
I20260709 13:11:12.058965 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:12.059267 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:12.059866 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:12.061802 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-3-root/instance:
uuid: "8d2f11cccca04a7683da4080ab797bd7"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-50cs"
I20260709 13:11:12.117637 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.055s	user 0.004s	sys 0.011s
I20260709 13:11:12.131865 30703 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.137827 28922 fs_manager.cc:730] Time spent opening block manager: real 0.016s	user 0.002s	sys 0.005s
I20260709 13:11:12.140235 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
uuid: "8d2f11cccca04a7683da4080ab797bd7"
format_stamp: "Formatted at 2026-07-09 13:11:12 on dist-test-slave-50cs"
I20260709 13:11:12.140769 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:12.190482 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:12.192615 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:12.219515 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:12.235150 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:12.235570 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:12.235948 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:12.236249 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:12.425812 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.132:36585
I20260709 13:11:12.426004 30765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.132:36585 every 8 connection(s)
I20260709 13:11:12.439656 28922 auto_leader_rebalancer-test.cc:384] add a tserver: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:12.462947 30766 heartbeater.cc:344] Connected to a master server at 127.28.62.190:37953
I20260709 13:11:12.463455 30766 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:12.464448 30766 heartbeater.cc:507] Master 127.28.62.190:37953 requested a full tablet report, sending...
I20260709 13:11:12.467017 29933 ts_manager.cc:194] Registered new tserver with Master: 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:12.468603 29933 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34648
I20260709 13:11:13.471771 30037 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:13.472993 30766 heartbeater.cc:499] Master 127.28.62.190:37953 was elected leader, sending a full tablet report...
I20260709 13:11:13.488620 30186 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:13.490609 30109 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:13.490890 30770 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.494824 30693 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:13.618094 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 113284us
W20260709 13:11:13.729533 30004 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef9600254f4d48368aff10ed883134fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:13.744380 30374 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.766774 30107 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.767750 30179 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.788115 29936 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.851773 30105 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:13.870199 30032 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:13.872546 30187 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:13.872694 30572 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.874621 30572 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.893185 30777 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.895236 30179 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:13.904203 30079 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74c6f7e90c624b64bdbb67860d561418. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:13.914921 30032 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.921469 29934 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:13.929160 30107 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:13.952636 30179 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:13.953153 30079 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0bc2d269504461f9c5ae0cdf5385b9b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:13.954691 30776 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.959728 30032 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:13.962540 30776 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:13.973280 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002df200 after lost signal to thread 28925
W20260709 13:11:13.974472 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002df8e0 after lost signal to thread 29970
W20260709 13:11:13.975720 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002606a0 after lost signal to thread 30062
W20260709 13:11:13.976819 30762 debug-util.cc:398] Leaking SignalData structure 0x7b080028b5c0 after lost signal to thread 30137
W20260709 13:11:13.978050 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002266e0 after lost signal to thread 30211
I20260709 13:11:13.974496 30804 ts_tablet_manager.cc:933] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:13.999984 30787 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.005520 30032 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.015708 30804 tablet_copy_client.cc:323] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:14.033483 30036 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.040303 30187 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.042532 29936 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:14.114727 30004 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b108c73739d43d89aafdc212aae9d1b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.116961 30105 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:14.123837 30180 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:14.120078 30786 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:11:14.148548 30770 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:14.167176 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet ef9600254f4d48368aff10ed883134fd from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:14.167835 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet ef9600254f4d48368aff10ed883134fd from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-ef9600254f4d48368aff10ed883134fd
I20260709 13:11:14.175886 30048 tablet_copy_source_session.cc:215] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:14.180377 30771 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.186878 30105 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.193766 30804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef9600254f4d48368aff10ed883134fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.195539 30187 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.213172 29934 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:14.324574 30804 tablet_copy_client.cc:806] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
W20260709 13:11:14.332414 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74308.6us
I20260709 13:11:14.325223 30804 tablet_copy_client.cc:670] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:14.375172 30804 tablet_copy_client.cc:538] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:14.380386 30818 ts_tablet_manager.cc:933] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:14.388370 30804 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:14.389683 30818 tablet_copy_client.cc:323] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
W20260709 13:11:14.407919 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 52802.7us
I20260709 13:11:14.435950 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet c0bc2d269504461f9c5ae0cdf5385b9b from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:14.436590 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet c0bc2d269504461f9c5ae0cdf5385b9b from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-c0bc2d269504461f9c5ae0cdf5385b9b
I20260709 13:11:14.448988 30123 tablet_copy_source_session.cc:215] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:14.457070 30818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0bc2d269504461f9c5ae0cdf5385b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.472286 30822 ts_tablet_manager.cc:933] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:14.481438 30818 tablet_copy_client.cc:806] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:14.482862 30818 tablet_copy_client.cc:670] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:14.476024 30804 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:14.489565 30804 tablet_bootstrap.cc:492] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:14.490415 30804 ts_tablet_manager.cc:1403] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.009s
I20260709 13:11:14.491681 30818 tablet_copy_client.cc:538] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:14.495452 30822 tablet_copy_client.cc:323] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:14.497833 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 74c6f7e90c624b64bdbb67860d561418 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:14.498445 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 74c6f7e90c624b64bdbb67860d561418 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-74c6f7e90c624b64bdbb67860d561418
I20260709 13:11:14.506835 30818 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:14.508616 30123 tablet_copy_source_session.cc:215] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:14.510758 30804 raft_consensus.cc:359] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.513782 30804 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:14.514739 30822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c6f7e90c624b64bdbb67860d561418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.514806 30804 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.536245 30804 ts_tablet_manager.cc:1434] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.005s
I20260709 13:11:14.539086 30741 raft_consensus.cc:1217] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:14.554530 30822 tablet_copy_client.cc:806] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:14.555258 30822 tablet_copy_client.cc:670] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:14.555460 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-ef9600254f4d48368aff10ed883134fd received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:14.565995 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-ef9600254f4d48368aff10ed883134fd on tablet ef9600254f4d48368aff10ed883134fd with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:14.569990 30822 tablet_copy_client.cc:538] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:14.579295 30822 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:14.586548 30818 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:14.607226 30822 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:14.608237 30822 tablet_bootstrap.cc:492] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:14.608914 30822 ts_tablet_manager.cc:1403] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.030s	user 0.029s	sys 0.000s
I20260709 13:11:14.611927 30822 raft_consensus.cc:359] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.620394 30822 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:14.621122 30822 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.623399 30822 ts_tablet_manager.cc:1434] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 13:11:14.626528 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-74c6f7e90c624b64bdbb67860d561418 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:14.587551 30818 tablet_bootstrap.cc:492] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:14.627094 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-74c6f7e90c624b64bdbb67860d561418 on tablet 74c6f7e90c624b64bdbb67860d561418 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:14.628623 30818 ts_tablet_manager.cc:1403] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.012s
I20260709 13:11:14.662922 30818 raft_consensus.cc:359] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.678292 30818 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:14.681833 30818 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:14.684229 30818 ts_tablet_manager.cc:1434] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.007s
I20260709 13:11:14.685972 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-c0bc2d269504461f9c5ae0cdf5385b9b received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:14.687608 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-c0bc2d269504461f9c5ae0cdf5385b9b on tablet c0bc2d269504461f9c5ae0cdf5385b9b with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:14.692859 30822 ts_tablet_manager.cc:933] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:14.705377 30822 tablet_copy_client.cc:323] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:14.709023 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 9b108c73739d43d89aafdc212aae9d1b from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:14.709756 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 9b108c73739d43d89aafdc212aae9d1b from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-9b108c73739d43d89aafdc212aae9d1b
I20260709 13:11:14.719651 30048 tablet_copy_source_session.cc:215] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:14.732448 30822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b108c73739d43d89aafdc212aae9d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.781381 30822 tablet_copy_client.cc:806] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:14.782140 30822 tablet_copy_client.cc:670] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:14.795212 30741 raft_consensus.cc:1217] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:14.806064 30822 tablet_copy_client.cc:538] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:14.821063 30822 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
W20260709 13:11:15.159494 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 69507.8us
I20260709 13:11:15.166812 30741 raft_consensus.cc:1217] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:15.182471 30822 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:15.183696 30822 tablet_bootstrap.cc:492] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:15.184638 30822 ts_tablet_manager.cc:1403] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.364s	user 0.031s	sys 0.005s
I20260709 13:11:15.188446 30822 raft_consensus.cc:359] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:15.189519 30822 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:15.306957 30693 raft_consensus.cc:1064] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:15.267926 30822 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:15.363653 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 96497.5us
I20260709 13:11:15.372171 30741 raft_consensus.cc:1217] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:15.374126 30789 raft_consensus.cc:1064] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:15.375633 30822 ts_tablet_manager.cc:1434] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.191s	user 0.009s	sys 0.004s
I20260709 13:11:15.378417 30693 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:15.395918 30789 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:15.415833 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.418727 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 99772.1us
W20260709 13:11:15.461131 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 217379us
I20260709 13:11:15.482601 30741 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.486445 30845 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.516004 30110 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.518394 30740 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.520547 30831 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.602864 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9b108c73739d43d89aafdc212aae9d1b received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:15.603643 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9b108c73739d43d89aafdc212aae9d1b on tablet 9b108c73739d43d89aafdc212aae9d1b with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:15.605806 30837 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.623070 30187 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.626466 30789 raft_consensus.cc:1064] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:15.632324 30789 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:15.659027 30036 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.668860 30741 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.671108 30787 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.693626 30845 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.725039 30787 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.734611 30770 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.741945 30183 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.746670 30036 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.747072 30112 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.750377 30183 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.759865 30787 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.762683 30741 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.767122 29934 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.774093 30789 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.815203 30572 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:11:15.817560 30186 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:15.854194 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57869.9us
I20260709 13:11:15.871673 30787 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.874285 30831 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.879712 30036 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.899190 30032 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.922251 30833 raft_consensus.cc:1064] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:15.925108 30833 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:15.961715 30741 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.969101 30740 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.971923 30187 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.986044 29935 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.988289 29935 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:15.996536 30739 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:16.000921 30106 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:15.998032 30180 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.003026 30842 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:16.004127 30833 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.035211 30187 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:16.042932 30844 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:16.064152 30033 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:16.073907 30112 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:16.072777 30110 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:16.090330 30036 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.099606 30183 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.101480 30831 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:16.109359 30789 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:16.117139 30858 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.133970 30736 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.159209 30837 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:11:16.170851 30738 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.172184 30737 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.173942 30789 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:16.177220 30832 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:16.183027 30845 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.186057 30741 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.185918 30789 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.191967 30737 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.210098 30738 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.219520 30842 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.224500 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0bc2d269504461f9c5ae0cdf5385b9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:16.226075 30036 raft_consensus.cc:2955] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.230099 30106 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.236169 29933 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.256433 30186 raft_consensus.cc:2955] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.266481 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74c6f7e90c624b64bdbb67860d561418 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:16.281004 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef9600254f4d48368aff10ed883134fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:16.285917 30741 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.301563 30180 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.310258 29935 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.310966 30837 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:16.312083 29935 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.328279 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet c0bc2d269504461f9c5ae0cdf5385b9b with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:16.332620 30180 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.341200 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 74c6f7e90c624b64bdbb67860d561418 with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:16.341835 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet ef9600254f4d48368aff10ed883134fd with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:16.347463 30183 raft_consensus.cc:2955] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.369656 30868 tablet_replica.cc:333] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:16.376689 30868 raft_consensus.cc:2243] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.370800 29935 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.380712 30868 raft_consensus.cc:2272] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.384400 30870 tablet_replica.cc:333] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:16.385347 30870 raft_consensus.cc:2243] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.386292 30870 raft_consensus.cc:2272] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.391129 30869 tablet_replica.cc:333] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:16.392385 30869 raft_consensus.cc:2243] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.394286 30868 ts_tablet_manager.cc:1916] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:16.396175 30870 ts_tablet_manager.cc:1916] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:16.393328 30869 raft_consensus.cc:2272] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.403689 30869 ts_tablet_manager.cc:1916] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:16.420540 30033 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:16.427690 30741 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.428601 30106 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:16.429463 30837 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:16.430306 30842 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:16.451951 30738 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.454223 30110 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.467779 29935 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.470547 30837 raft_consensus.cc:2955] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:16.509539 30868 ts_tablet_manager.cc:1929] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:16.510319 30868 log.cc:1199] T c0bc2d269504461f9c5ae0cdf5385b9b P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/c0bc2d269504461f9c5ae0cdf5385b9b
I20260709 13:11:16.515972 30870 ts_tablet_manager.cc:1929] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:16.518265 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet c0bc2d269504461f9c5ae0cdf5385b9b (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:16.518567 30870 log.cc:1199] T ef9600254f4d48368aff10ed883134fd P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/ef9600254f4d48368aff10ed883134fd
I20260709 13:11:16.524003 30869 ts_tablet_manager.cc:1929] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:16.538583 30869 log.cc:1199] T 74c6f7e90c624b64bdbb67860d561418 P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/74c6f7e90c624b64bdbb67860d561418
I20260709 13:11:16.532546 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b108c73739d43d89aafdc212aae9d1b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:16.530325 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b108c73739d43d89aafdc212aae9d1b with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:16.542855 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 74c6f7e90c624b64bdbb67860d561418 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:16.544507 30868 tablet_replica.cc:333] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:16.546697 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet ef9600254f4d48368aff10ed883134fd (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:16.601888 30868 raft_consensus.cc:2243] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.602912 30868 raft_consensus.cc:2272] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.607278 30868 ts_tablet_manager.cc:1916] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:16.632375 30868 ts_tablet_manager.cc:1929] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:16.632889 30868 log.cc:1199] T 9b108c73739d43d89aafdc212aae9d1b P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/9b108c73739d43d89aafdc212aae9d1b
I20260709 13:11:16.634845 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet 9b108c73739d43d89aafdc212aae9d1b (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:17.616394 30106 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:17.627182 30079 consensus_peers.cc:597] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 535e413e4f2b46fe966812acbf31570a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.627876 30033 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:17.628871 30183 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:17.637940 30858 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.639901 30858 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:17.720902 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 81330.5us
I20260709 13:11:17.736680 30878 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.754360 30036 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:17.765126 30183 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.771307 30033 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.775842 29935 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:17.788653 30004 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3d5b014e8a54181ad5978055b4514b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.799520 30186 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:17.802050 30881 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:17.811049 30106 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:17.842151 30845 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.846922 30837 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:17.854575 30179 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.873984 30112 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:17.884799 29933 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.959672 30179 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.012264 30033 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:18.014106 30829 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.032989 30112 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:18.042768 30829 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.056305 30889 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.062364 30032 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.079226 30110 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.088644 29933 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.098376 30032 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:18.101894 30153 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0285ca89cc9843cab1c6899c6f83dd16. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:18.103981 30186 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:18.106904 30858 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:18.108827 30079 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d99bf410d55b470d8191aa69458330db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:18.119385 30878 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:18.138485 30898 ts_tablet_manager.cc:933] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:18.156574 30898 tablet_copy_client.cc:323] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:18.158870 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 535e413e4f2b46fe966812acbf31570a from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:18.159443 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 535e413e4f2b46fe966812acbf31570a from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-535e413e4f2b46fe966812acbf31570a
I20260709 13:11:18.157581 30858 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.169261 30123 tablet_copy_source_session.cc:215] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.174472 30898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535e413e4f2b46fe966812acbf31570a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.188222 30112 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.192050 30186 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.198258 30032 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.202927 30898 tablet_copy_client.cc:806] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.203709 30898 tablet_copy_client.cc:670] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.210295 30898 tablet_copy_client.cc:538] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.225155 29933 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:18.258661 30902 ts_tablet_manager.cc:933] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:18.301666 30902 tablet_copy_client.cc:323] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:18.303450 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet f3d5b014e8a54181ad5978055b4514b4 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:18.304068 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet f3d5b014e8a54181ad5978055b4514b4 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-f3d5b014e8a54181ad5978055b4514b4
I20260709 13:11:18.324447 30048 tablet_copy_source_session.cc:215] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.335357 30902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d5b014e8a54181ad5978055b4514b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.344339 30898 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:18.386976 30902 tablet_copy_client.cc:806] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.387682 30902 tablet_copy_client.cc:670] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.388545 30898 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.389839 30898 tablet_bootstrap.cc:492] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:18.393847 30902 tablet_copy_client.cc:538] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.400326 30898 ts_tablet_manager.cc:1403] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.015s
I20260709 13:11:18.405047 30898 raft_consensus.cc:359] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.406333 30898 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:18.407280 30898 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.413498 30902 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:18.474555 30907 ts_tablet_manager.cc:933] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:18.477434 30898 ts_tablet_manager.cc:1434] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.016s
I20260709 13:11:18.485446 30902 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.486686 30902 tablet_bootstrap.cc:492] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:18.487658 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-535e413e4f2b46fe966812acbf31570a received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:18.488217 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-535e413e4f2b46fe966812acbf31570a on tablet 535e413e4f2b46fe966812acbf31570a with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:18.490268 30902 ts_tablet_manager.cc:1403] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.013s
I20260709 13:11:18.495023 30902 raft_consensus.cc:359] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.496145 30902 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:18.496985 30902 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.499984 30902 ts_tablet_manager.cc:1434] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:11:18.502440 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-f3d5b014e8a54181ad5978055b4514b4 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:18.502897 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-f3d5b014e8a54181ad5978055b4514b4 on tablet f3d5b014e8a54181ad5978055b4514b4 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:18.524384 30907 tablet_copy_client.cc:323] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:18.557569 30902 ts_tablet_manager.cc:933] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:18.576109 30902 tablet_copy_client.cc:323] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:18.578616 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet d99bf410d55b470d8191aa69458330db from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:18.579440 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet d99bf410d55b470d8191aa69458330db from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-d99bf410d55b470d8191aa69458330db
I20260709 13:11:18.600189 30123 tablet_copy_source_session.cc:215] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.605917 30902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99bf410d55b470d8191aa69458330db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.696867 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 0285ca89cc9843cab1c6899c6f83dd16 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:18.697500 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 0285ca89cc9843cab1c6899c6f83dd16 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-0285ca89cc9843cab1c6899c6f83dd16
I20260709 13:11:18.708206 30738 raft_consensus.cc:1217] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:18.721851 30197 tablet_copy_source_session.cc:215] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.743456 30907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0285ca89cc9843cab1c6899c6f83dd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.757650 30902 tablet_copy_client.cc:806] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.758486 30902 tablet_copy_client.cc:670] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.763064 30902 tablet_copy_client.cc:538] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.777721 30902 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:18.829999 30738 raft_consensus.cc:1217] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:18.864904 30907 tablet_copy_client.cc:806] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.865770 30907 tablet_copy_client.cc:670] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.874501 30907 tablet_copy_client.cc:538] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.890115 30902 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.891172 30902 tablet_bootstrap.cc:492] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:18.896382 30902 ts_tablet_manager.cc:1403] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.119s	user 0.026s	sys 0.001s
I20260709 13:11:18.900068 30902 raft_consensus.cc:359] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.913692 30902 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:18.914644 30902 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:18.921180 30902 ts_tablet_manager.cc:1434] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 13:11:18.924376 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-d99bf410d55b470d8191aa69458330db received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:18.924883 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-d99bf410d55b470d8191aa69458330db on tablet d99bf410d55b470d8191aa69458330db with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:18.958330 30907 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:19.024398 30738 raft_consensus.cc:1217] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:19.073800 30907 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.075003 30907 tablet_bootstrap.cc:492] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:19.080484 30907 ts_tablet_manager.cc:1403] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.008s
I20260709 13:11:19.095582 30907 raft_consensus.cc:359] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:19.101831 30907 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:19.109722 30907 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:19.117092 30907 ts_tablet_manager.cc:1434] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:11:19.120476 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-0285ca89cc9843cab1c6899c6f83dd16 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:19.120980 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-0285ca89cc9843cab1c6899c6f83dd16 on tablet 0285ca89cc9843cab1c6899c6f83dd16 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:19.184904 30858 raft_consensus.cc:1064] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:19.187270 30858 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:19.254593 30183 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.254769 30738 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.257237 30872 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.259325 30878 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.270957 30032 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.276824 30878 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:19.305475 30872 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.308095 30183 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.309847 30036 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.322325 30738 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.336485 29936 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.392649 30112 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:19.399971 30738 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.407186 30858 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.408320 30186 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.411747 30872 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.417469 30878 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.421614 30738 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.424808 30837 raft_consensus.cc:1064] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:19.427207 30837 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:19.432181 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 535e413e4f2b46fe966812acbf31570a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:19.432020 30183 raft_consensus.cc:2955] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.441637 29933 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.447439 30741 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.449800 30881 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.453238 30112 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.457331 30837 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.458794 30186 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.466017 30881 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.486538 30741 raft_consensus.cc:1217] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:19.510293 30881 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.511989 30107 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.526993 30876 raft_consensus.cc:1064] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:19.534145 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 535e413e4f2b46fe966812acbf31570a with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:19.532814 30738 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.537457 30876 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:19.551393 29936 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.562259 30187 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.592706 30929 tablet_replica.cc:333] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:19.600490 30929 raft_consensus.cc:2243] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:19.603858 30929 raft_consensus.cc:2272] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:19.608609 30929 ts_tablet_manager.cc:1916] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:19.613417 30738 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.615440 30033 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:19.625649 30738 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.627943 30914 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:19.636426 30186 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.638316 30917 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.640816 30872 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.644359 30837 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.654386 30929 ts_tablet_manager.cc:1929] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:19.656831 30929 log.cc:1199] T 535e413e4f2b46fe966812acbf31570a P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/535e413e4f2b46fe966812acbf31570a
I20260709 13:11:19.659106 30180 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.661293 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 535e413e4f2b46fe966812acbf31570a (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:19.662626 30036 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.653191 30186 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.683220 30741 raft_consensus.cc:2955] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.690148 30878 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.701123 30878 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:19.721421 30858 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:19.749819 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51642us
W20260709 13:11:19.818830 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67807.7us
I20260709 13:11:19.831125 29936 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.837581 30741 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:19.845374 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 47754.7us
I20260709 13:11:19.882390 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d5b014e8a54181ad5978055b4514b4 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
W20260709 13:11:19.882714 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 83772.4us
I20260709 13:11:19.898550 30942 tablet_replica.cc:333] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:19.899523 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3d5b014e8a54181ad5978055b4514b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:19.898702 29933 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.898638 30186 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.950433 30036 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:19.980898 30942 raft_consensus.cc:2243] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:19.982048 30942 raft_consensus.cc:2272] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:19.986582 30942 ts_tablet_manager.cc:1916] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:20.007051 30107 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:20.014942 30741 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:20.016644 30943 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:20.020399 30032 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:20.024240 30942 ts_tablet_manager.cc:1929] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:20.029644 30942 log.cc:1199] T f3d5b014e8a54181ad5978055b4514b4 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/f3d5b014e8a54181ad5978055b4514b4
I20260709 13:11:20.025296 30943 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:20.032186 30938 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.038211 30032 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.040736 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet f3d5b014e8a54181ad5978055b4514b4 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:20.037523 30741 raft_consensus.cc:2955] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.044899 30843 raft_consensus.cc:1064] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:20.052386 30843 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:20.066978 29933 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.069211 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d99bf410d55b470d8191aa69458330db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:20.093129 30032 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:20.094923 30889 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:20.096909 30741 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:20.106490 30843 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:20.122466 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet d99bf410d55b470d8191aa69458330db with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:20.135846 30112 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:20.149649 30946 tablet_replica.cc:333] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:20.151742 30946 raft_consensus.cc:2243] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.152634 30946 raft_consensus.cc:2272] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.155529 30889 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.158747 30741 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.166128 30903 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:20.185736 30036 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.196589 30946 ts_tablet_manager.cc:1916] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:20.201004 29933 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.251111 30112 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.256309 30946 ts_tablet_manager.cc:1929] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:20.256803 30946 log.cc:1199] T d99bf410d55b470d8191aa69458330db P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/d99bf410d55b470d8191aa69458330db
I20260709 13:11:20.260601 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet d99bf410d55b470d8191aa69458330db (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:20.279269 30180 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:20.290422 30741 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:20.293306 30889 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:20.305584 30903 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.317711 30738 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.317710 30036 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:20.344769 30940 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:20.351377 29933 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.360765 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0285ca89cc9843cab1c6899c6f83dd16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:20.362329 30036 raft_consensus.cc:2955] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:20.369251 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 0285ca89cc9843cab1c6899c6f83dd16 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:20.370451 30942 tablet_replica.cc:333] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:20.371737 30942 raft_consensus.cc:2243] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:20.372423 30942 raft_consensus.cc:2272] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:20.381276 30942 ts_tablet_manager.cc:1916] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:20.417719 30942 ts_tablet_manager.cc:1929] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:20.418236 30942 log.cc:1199] T 0285ca89cc9843cab1c6899c6f83dd16 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/0285ca89cc9843cab1c6899c6f83dd16
I20260709 13:11:20.420002 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 0285ca89cc9843cab1c6899c6f83dd16 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:21.471026 30112 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:21.479664 30180 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:21.480894 30079 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa63b06fc4f446c8b2e800abeaaeabce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.484714 30036 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.484889 30858 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.489877 30858 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.522722 30939 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.529896 30031 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.546537 30032 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:21.547971 30183 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.554792 29933 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:21.599606 30004 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d12004749df410ea5dcce097780c358. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:21.610682 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 43777.6us
I20260709 13:11:21.622263 30186 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.623965 30881 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.677556 30112 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.682073 30958 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:21.686715 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44863.1us
I20260709 13:11:21.698259 30955 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.709805 30186 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.726511 30110 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.729728 30187 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:21.740125 30110 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:21.743988 30959 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.747335 30031 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:21.747525 30153 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a61c48865d1417593366ed1611c2836. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.749801 30940 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.776500 29936 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.785612 30940 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.792635 30031 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.795202 30110 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.816236 30110 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:21.826050 29934 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.827527 30187 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.830500 30858 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:21.840154 30079 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd9e5e8f77524a8e8e19542c915fb343. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.842846 30031 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.846002 30952 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.866279 30952 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.869035 30031 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.882081 30187 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.924515 29934 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:21.968397 30972 ts_tablet_manager.cc:933] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:21.981554 30972 tablet_copy_client.cc:323] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:21.983341 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet fa63b06fc4f446c8b2e800abeaaeabce from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:21.984045 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet fa63b06fc4f446c8b2e800abeaaeabce from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-fa63b06fc4f446c8b2e800abeaaeabce
I20260709 13:11:21.990185 30123 tablet_copy_source_session.cc:215] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:21.993530 30972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa63b06fc4f446c8b2e800abeaaeabce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.008667 30972 tablet_copy_client.cc:806] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.009284 30972 tablet_copy_client.cc:670] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.013072 30972 tablet_copy_client.cc:538] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.022634 30972 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:22.044414 30972 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.046226 30972 tablet_bootstrap.cc:492] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:22.046857 30972 ts_tablet_manager.cc:1403] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.002s
I20260709 13:11:22.050148 30972 raft_consensus.cc:359] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.050885 30972 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:22.051481 30972 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.054862 30972 ts_tablet_manager.cc:1434] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:22.057765 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-fa63b06fc4f446c8b2e800abeaaeabce received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:22.058284 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-fa63b06fc4f446c8b2e800abeaaeabce on tablet fa63b06fc4f446c8b2e800abeaaeabce with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:22.147339 30972 ts_tablet_manager.cc:933] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:22.151397 30972 tablet_copy_client.cc:323] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:22.154441 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 9d12004749df410ea5dcce097780c358 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:22.155085 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 9d12004749df410ea5dcce097780c358 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-9d12004749df410ea5dcce097780c358
I20260709 13:11:22.162137 30048 tablet_copy_source_session.cc:215] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:22.165683 30972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d12004749df410ea5dcce097780c358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.196167 30972 tablet_copy_client.cc:806] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.196856 30972 tablet_copy_client.cc:670] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.201620 30972 tablet_copy_client.cc:538] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.214224 30972 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:22.238166 30972 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.239079 30972 tablet_bootstrap.cc:492] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:22.239653 30972 ts_tablet_manager.cc:1403] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:11:22.242619 30972 raft_consensus.cc:359] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.243254 30972 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:22.243983 30972 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.246134 30972 ts_tablet_manager.cc:1434] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:22.248113 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9d12004749df410ea5dcce097780c358 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:22.248586 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9d12004749df410ea5dcce097780c358 on tablet 9d12004749df410ea5dcce097780c358 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:22.309079 30972 ts_tablet_manager.cc:933] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:22.311072 30978 ts_tablet_manager.cc:933] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:22.314292 30972 tablet_copy_client.cc:323] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:22.316298 30978 tablet_copy_client.cc:323] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:22.316506 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet fd9e5e8f77524a8e8e19542c915fb343 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:22.317016 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet fd9e5e8f77524a8e8e19542c915fb343 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-fd9e5e8f77524a8e8e19542c915fb343
I20260709 13:11:22.318121 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 9a61c48865d1417593366ed1611c2836 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:22.318678 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 9a61c48865d1417593366ed1611c2836 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-9a61c48865d1417593366ed1611c2836
I20260709 13:11:22.324734 30123 tablet_copy_source_session.cc:215] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:22.326772 30197 tablet_copy_source_session.cc:215] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:22.328404 30972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9e5e8f77524a8e8e19542c915fb343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.340381 30978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a61c48865d1417593366ed1611c2836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.348048 30972 tablet_copy_client.cc:806] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.349022 30972 tablet_copy_client.cc:670] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.358471 30972 tablet_copy_client.cc:538] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.364120 30978 tablet_copy_client.cc:806] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.365013 30978 tablet_copy_client.cc:670] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.370539 30978 tablet_copy_client.cc:538] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.370577 30972 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:22.386974 30978 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:22.409430 30972 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.411384 30972 tablet_bootstrap.cc:492] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:22.412441 30972 ts_tablet_manager.cc:1403] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.004s
I20260709 13:11:22.416330 30972 raft_consensus.cc:359] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.418567 30972 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:22.419181 30972 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.421953 30972 ts_tablet_manager.cc:1434] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:22.430912 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-fd9e5e8f77524a8e8e19542c915fb343 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:22.431409 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-fd9e5e8f77524a8e8e19542c915fb343 on tablet fd9e5e8f77524a8e8e19542c915fb343 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:22.431694 30978 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.432708 30978 tablet_bootstrap.cc:492] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:22.433951 30978 ts_tablet_manager.cc:1403] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.020s
I20260709 13:11:22.439522 30978 raft_consensus.cc:359] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.440608 30978 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:22.441639 30978 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:22.445804 30978 ts_tablet_manager.cc:1434] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:11:22.459601 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9a61c48865d1417593366ed1611c2836 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:22.460124 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9a61c48865d1417593366ed1611c2836 on tablet 9a61c48865d1417593366ed1611c2836 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:22.482837 30741 raft_consensus.cc:1217] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:22.695048 30741 raft_consensus.cc:1217] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:22.731964 30741 raft_consensus.cc:1217] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:22.884882 30986 raft_consensus.cc:1064] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:22.887813 30986 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:22.894328 30741 raft_consensus.cc:1217] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:11:22.900188 30741 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:22.901889 30984 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:22.907045 30187 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:22.908581 30032 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:22.910629 30984 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:22.913710 30984 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:22.934942 30943 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:22.943792 30741 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:22.957170 29934 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.958670 30181 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:22.956585 30032 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.030354 30107 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.034888 30741 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.040129 30943 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.052774 30985 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.060536 30741 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.062769 30187 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.071292 30943 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.074075 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa63b06fc4f446c8b2e800abeaaeabce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:23.076525 30187 raft_consensus.cc:2955] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.079916 29933 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.087438 30943 raft_consensus.cc:1064] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:23.089784 30943 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.101764 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet fa63b06fc4f446c8b2e800abeaaeabce with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:23.105052 30741 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.107402 30943 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:23.117900 30186 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.120814 30031 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.122818 30998 tablet_replica.cc:333] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:23.124361 30998 raft_consensus.cc:2243] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.125903 30998 raft_consensus.cc:2272] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.129588 30998 ts_tablet_manager.cc:1916] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.132697 30943 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.142469 30984 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.145782 30998 ts_tablet_manager.cc:1929] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:23.146358 30998 log.cc:1199] T fa63b06fc4f446c8b2e800abeaaeabce P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/fa63b06fc4f446c8b2e800abeaaeabce
I20260709 13:11:23.148489 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet fa63b06fc4f446c8b2e800abeaaeabce (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:23.161968 30943 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.163973 30186 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.180806 30741 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.193460 30031 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.196071 29936 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.222325 30106 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.227289 30036 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.227746 30741 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.228564 30943 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.229750 30984 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.236234 30943 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.238008 30741 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.247460 30036 raft_consensus.cc:2955] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.249356 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd9e5e8f77524a8e8e19542c915fb343 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:23.258466 29931 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.270943 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet fd9e5e8f77524a8e8e19542c915fb343 with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:23.275208 31002 tablet_replica.cc:333] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:23.293238 31002 raft_consensus.cc:2243] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.294297 31002 raft_consensus.cc:2272] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.298374 31002 ts_tablet_manager.cc:1916] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.317039 31002 ts_tablet_manager.cc:1929] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:23.317188 30981 raft_consensus.cc:1064] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:23.317585 31002 log.cc:1199] T fd9e5e8f77524a8e8e19542c915fb343 P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/fd9e5e8f77524a8e8e19542c915fb343
I20260709 13:11:23.320295 30981 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.328061 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet fd9e5e8f77524a8e8e19542c915fb343 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:23.348618 30741 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.349553 30187 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.351383 30106 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.351244 30958 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.352713 31004 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:23.355245 30881 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.376767 30981 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.380323 30187 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.388082 30107 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.403079 30741 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.416363 29933 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.439399 30036 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.448096 30186 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.449888 30738 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:23.451628 31008 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.453510 31008 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.462913 30981 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.465452 30738 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.467006 30186 raft_consensus.cc:2955] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.472788 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d12004749df410ea5dcce097780c358 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:23.487390 29934 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.501808 30940 raft_consensus.cc:1064] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:23.504514 30940 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.507100 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d12004749df410ea5dcce097780c358 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:23.509009 31009 tablet_replica.cc:333] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:23.510977 31009 raft_consensus.cc:2243] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.511924 31009 raft_consensus.cc:2272] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.519304 31009 ts_tablet_manager.cc:1916] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.521822 30107 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:23.522737 30738 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:23.523396 30940 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.524415 30036 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:23.524729 30994 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.526654 30994 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.568133 31009 ts_tablet_manager.cc:1929] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:23.568717 31009 log.cc:1199] T 9d12004749df410ea5dcce097780c358 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/9d12004749df410ea5dcce097780c358
I20260709 13:11:23.570601 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 9d12004749df410ea5dcce097780c358 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:23.571485 31011 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.572607 30032 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.600744 30741 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.605479 30107 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.614611 29936 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.648244 30186 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:23.653992 30107 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:23.655417 30741 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:23.655316 30994 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.656785 31011 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.667232 30940 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.670979 30741 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.687243 30107 raft_consensus.cc:2955] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:23.693774 29934 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.710610 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a61c48865d1417593366ed1611c2836 with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:23.723325 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a61c48865d1417593366ed1611c2836 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:23.723946 31016 tablet_replica.cc:333] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:23.726655 31016 raft_consensus.cc:2243] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.727437 31016 raft_consensus.cc:2272] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.732555 31016 ts_tablet_manager.cc:1916] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.750631 31016 ts_tablet_manager.cc:1929] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:11:23.750916 31016 log.cc:1199] T 9a61c48865d1417593366ed1611c2836 P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/9a61c48865d1417593366ed1611c2836
I20260709 13:11:23.752008 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 9a61c48865d1417593366ed1611c2836 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:24.786026 30036 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:24.794001 30107 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:24.794651 30004 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6920367ae7ee4f54a639b9db0e071e84. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.795037 30187 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:24.795266 30981 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.796413 31018 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.808372 31021 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.810503 30187 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.812988 30107 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.826993 30106 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:24.835671 29934 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.847450 30181 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:24.853538 30079 consensus_peers.cc:597] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 155d3e6034f842759244a283f46a67b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.856175 30971 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:24.858964 30032 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:24.866004 30971 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:24.883724 30984 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.886032 30036 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.932250 30187 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.932857 29931 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.931109 30036 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:24.980578 30004 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6d7dd6e303964f99bd9728c2f53891af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.980934 30187 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:24.982668 30981 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.984962 30106 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:24.986819 31021 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.995785 30981 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:24.997207 30181 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:25.006531 30106 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:25.007866 30107 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.014299 29934 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:25.017246 30079 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6065fdc6916b4a589b781d16204e51c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.018903 30036 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:25.020150 30181 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:25.021471 30971 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.022769 31027 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:25.032017 30971 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:25.038653 30036 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:25.050948 30181 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:25.059420 29936 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.290165 31040 ts_tablet_manager.cc:933] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:25.294293 31040 tablet_copy_client.cc:323] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:25.296231 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 6920367ae7ee4f54a639b9db0e071e84 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:25.296857 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 6920367ae7ee4f54a639b9db0e071e84 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-6920367ae7ee4f54a639b9db0e071e84
I20260709 13:11:25.302706 30048 tablet_copy_source_session.cc:215] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.306988 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6920367ae7ee4f54a639b9db0e071e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.308189 31042 ts_tablet_manager.cc:933] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:25.318822 31042 tablet_copy_client.cc:323] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:25.320739 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 155d3e6034f842759244a283f46a67b9 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:25.321265 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 155d3e6034f842759244a283f46a67b9 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-155d3e6034f842759244a283f46a67b9
I20260709 13:11:25.330827 30123 tablet_copy_source_session.cc:215] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.334421 31042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d3e6034f842759244a283f46a67b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.335778 31040 tablet_copy_client.cc:806] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.336457 31040 tablet_copy_client.cc:670] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.345081 31040 tablet_copy_client.cc:538] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.351625 31042 tablet_copy_client.cc:806] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.352243 31042 tablet_copy_client.cc:670] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.356233 31040 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:25.407531 31042 tablet_copy_client.cc:538] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.445345 31042 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:25.507687 31040 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.510309 31050 ts_tablet_manager.cc:933] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:25.523648 31042 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.524988 31042 tablet_bootstrap.cc:492] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:25.527489 31040 tablet_bootstrap.cc:492] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:25.525995 31042 ts_tablet_manager.cc:1403] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.018s
I20260709 13:11:25.537714 31040 ts_tablet_manager.cc:1403] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.182s	user 0.024s	sys 0.019s
I20260709 13:11:25.556396 31042 raft_consensus.cc:359] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.563587 31042 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:25.564435 31042 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.565315 31050 tablet_copy_client.cc:323] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:25.553329 31040 raft_consensus.cc:359] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.566510 31040 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:25.562973 31053 ts_tablet_manager.cc:933] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:25.569453 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 6d7dd6e303964f99bd9728c2f53891af from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:25.570266 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 6d7dd6e303964f99bd9728c2f53891af from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-6d7dd6e303964f99bd9728c2f53891af
I20260709 13:11:25.591670 31042 ts_tablet_manager.cc:1434] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.005s
I20260709 13:11:25.597193 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-155d3e6034f842759244a283f46a67b9 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:25.597836 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-155d3e6034f842759244a283f46a67b9 on tablet 155d3e6034f842759244a283f46a67b9 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:25.605933 30048 tablet_copy_source_session.cc:215] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.610327 31050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7dd6e303964f99bd9728c2f53891af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.567385 31040 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.616550 31040 ts_tablet_manager.cc:1434] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.004s
I20260709 13:11:25.618983 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6920367ae7ee4f54a639b9db0e071e84 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:25.619494 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6920367ae7ee4f54a639b9db0e071e84 on tablet 6920367ae7ee4f54a639b9db0e071e84 with peer 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:11:25.628126 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51174.9us
I20260709 13:11:25.628901 31053 tablet_copy_client.cc:323] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:25.633116 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 6065fdc6916b4a589b781d16204e51c6 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:25.633723 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 6065fdc6916b4a589b781d16204e51c6 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-6065fdc6916b4a589b781d16204e51c6
I20260709 13:11:25.645018 31050 tablet_copy_client.cc:806] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.645941 31050 tablet_copy_client.cc:670] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.649729 30123 tablet_copy_source_session.cc:215] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.653208 31053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6065fdc6916b4a589b781d16204e51c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.656968 31050 tablet_copy_client.cc:538] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.669072 31050 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:25.671289 31053 tablet_copy_client.cc:806] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.671908 31053 tablet_copy_client.cc:670] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.679323 31053 tablet_copy_client.cc:538] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.692727 31053 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:25.720606 31050 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.721747 31050 tablet_bootstrap.cc:492] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:25.722484 31050 ts_tablet_manager.cc:1403] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.022s
I20260709 13:11:25.728477 31050 raft_consensus.cc:359] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.729449 31050 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:25.730194 31050 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.734493 31050 ts_tablet_manager.cc:1434] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:11:25.736565 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6d7dd6e303964f99bd9728c2f53891af received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:25.737066 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6d7dd6e303964f99bd9728c2f53891af on tablet 6d7dd6e303964f99bd9728c2f53891af with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:25.743965 30738 raft_consensus.cc:1217] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:25.748649 31053 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.749742 31053 tablet_bootstrap.cc:492] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:25.750516 31053 ts_tablet_manager.cc:1403] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.017s
I20260709 13:11:25.754011 31053 raft_consensus.cc:359] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.755537 31053 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:25.756362 31053 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:25.759333 31053 ts_tablet_manager.cc:1434] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:11:25.761813 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6065fdc6916b4a589b781d16204e51c6 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:25.762337 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-6065fdc6916b4a589b781d16204e51c6 on tablet 6065fdc6916b4a589b781d16204e51c6 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:25.765663 30738 raft_consensus.cc:1217] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:25.926249 30738 raft_consensus.cc:1217] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:25.999441 30738 raft_consensus.cc:1217] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:26.227873 31056 raft_consensus.cc:1064] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:26.231751 31056 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.240533 30738 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.242012 31025 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.243481 30036 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.244273 30186 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.245504 31056 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:26.247442 31047 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.275259 30971 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.280036 30186 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.289628 30738 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.296185 30036 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.300532 29934 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.316520 30971 raft_consensus.cc:1064] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:26.318446 31018 raft_consensus.cc:1064] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:26.319190 30971 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.321306 31018 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.334637 30738 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.336740 30186 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.340569 31025 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.342387 30036 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.345525 31056 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.350725 30737 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.350626 31056 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.353590 30981 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.367591 30186 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.372051 31004 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.413519 30106 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.422260 31021 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.458238 31047 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.459048 30981 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.461374 30738 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.471364 30187 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.472100 30036 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.481269 30106 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.491231 30186 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.498170 30738 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.536054 30106 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.553699 30738 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.554776 30187 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.555341 31056 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:26.565929 31056 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:26.573743 30971 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.575266 30187 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.570703 29934 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.580770 29934 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.612416 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 155d3e6034f842759244a283f46a67b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:26.611755 30738 raft_consensus.cc:2955] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.614609 31004 raft_consensus.cc:1064] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:26.622748 31004 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.626766 30110 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.630962 30036 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.634774 30737 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.642143 29933 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.642948 30032 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.652235 31047 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:26.654035 31025 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:26.657513 30737 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.659936 30187 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.660559 31071 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:11:26.663908 31018 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:26.673218 31056 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.676339 30737 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.683320 30981 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.686532 30036 raft_consensus.cc:2955] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.693792 30187 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.698894 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 155d3e6034f842759244a283f46a67b9 with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:26.702967 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6920367ae7ee4f54a639b9db0e071e84 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:26.706198 29931 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.710279 29936 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.734829 30738 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.737114 30981 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:26.752841 31078 tablet_replica.cc:333] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:26.765722 30737 raft_consensus.cc:2955] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.767282 31078 raft_consensus.cc:2243] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:26.776261 31077 log.cc:927] Time spent T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:11:26.778995 31078 raft_consensus.cc:2272] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.785249 31078 ts_tablet_manager.cc:1916] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:26.800902 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6065fdc6916b4a589b781d16204e51c6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:11:26.811765 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63075.8us
I20260709 13:11:26.834887 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 6920367ae7ee4f54a639b9db0e071e84 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:26.845381 31078 ts_tablet_manager.cc:1929] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:26.846005 30187 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.846004 31078 log.cc:1199] T 155d3e6034f842759244a283f46a67b9 P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/155d3e6034f842759244a283f46a67b9
I20260709 13:11:26.848872 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 155d3e6034f842759244a283f46a67b9 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:26.851985 30981 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:26.856907 30106 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:26.859239 31018 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:26.875615 31085 tablet_replica.cc:333] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:26.893839 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet 6065fdc6916b4a589b781d16204e51c6 with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:26.894573 31085 raft_consensus.cc:2243] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.899341 31088 tablet_replica.cc:333] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:26.902115 31088 raft_consensus.cc:2243] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.902002 31085 raft_consensus.cc:2272] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.900997 30981 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.904102 30186 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.911198 31085 ts_tablet_manager.cc:1916] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:26.925818 30110 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.928661 29933 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.929523 30737 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:26.920054 31088 raft_consensus.cc:2272] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.943264 31088 ts_tablet_manager.cc:1916] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:26.961333 30032 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:26.974113 31088 ts_tablet_manager.cc:1929] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:26.974761 31088 log.cc:1199] T 6065fdc6916b4a589b781d16204e51c6 P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/6065fdc6916b4a589b781d16204e51c6
I20260709 13:11:26.976751 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet 6065fdc6916b4a589b781d16204e51c6 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:26.984531 31085 ts_tablet_manager.cc:1929] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:26.985145 31085 log.cc:1199] T 6920367ae7ee4f54a639b9db0e071e84 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/6920367ae7ee4f54a639b9db0e071e84
I20260709 13:11:26.986104 30106 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.993253 30737 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:26.997838 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 6920367ae7ee4f54a639b9db0e071e84 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:26.996893 31004 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:27.001511 31004 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:27.013939 31021 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:27.031302 30737 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:27.037982 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6d7dd6e303964f99bd9728c2f53891af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:27.042506 29933 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.044718 30106 raft_consensus.cc:2955] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:27.064674 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d7dd6e303964f99bd9728c2f53891af with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:27.065879 31088 tablet_replica.cc:333] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:27.067016 31088 raft_consensus.cc:2243] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.067838 31088 raft_consensus.cc:2272] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.078619 31088 ts_tablet_manager.cc:1916] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:27.107944 31088 ts_tablet_manager.cc:1929] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:27.108394 31088 log.cc:1199] T 6d7dd6e303964f99bd9728c2f53891af P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/6d7dd6e303964f99bd9728c2f53891af
I20260709 13:11:27.110232 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet 6d7dd6e303964f99bd9728c2f53891af (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:28.146624 30106 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.154978 30186 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:28.155490 30079 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82bd288ed43e47fbabdbcfbfaca06dfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.156622 31056 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.157946 30036 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.159219 31056 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.164819 31091 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.167013 30186 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.174054 30031 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.179279 30187 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.189523 29933 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:28.203645 30153 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 838f13bafde24742a950e2e4d62e21e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.204248 30031 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.205886 30106 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.205950 31015 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:28.211040 31082 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.263613 31015 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.276078 30031 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.277459 30106 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.295007 30181 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.300719 29934 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:28.305016 30153 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34df6751216d4ac584919e5640b25bc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.306471 30107 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.306699 30036 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.308328 31082 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.309702 31015 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.321592 31015 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.323292 30036 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.329955 30107 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.337990 29933 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.343499 30036 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:28.360733 30004 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db55e372a60b4a1a9c52676be275cf56. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.360813 30181 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.362257 31021 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.363305 30107 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.364656 31021 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.371531 31018 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.374925 30181 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.378695 30107 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:28.396378 29934 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.559695 31109 ts_tablet_manager.cc:933] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:28.561796 31109 tablet_copy_client.cc:323] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:28.563553 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 82bd288ed43e47fbabdbcfbfaca06dfb from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:28.564095 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 82bd288ed43e47fbabdbcfbfaca06dfb from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-82bd288ed43e47fbabdbcfbfaca06dfb
I20260709 13:11:28.574954 30123 tablet_copy_source_session.cc:215] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:28.577958 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bd288ed43e47fbabdbcfbfaca06dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.598348 31109 tablet_copy_client.cc:806] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:28.598973 31109 tablet_copy_client.cc:670] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:28.604566 31109 tablet_copy_client.cc:538] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:28.621830 31109 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:28.644400 31109 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:28.645478 31109 tablet_bootstrap.cc:492] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:28.646260 31109 ts_tablet_manager.cc:1403] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:11:28.649367 31109 raft_consensus.cc:359] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.650342 31109 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:28.651062 31109 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.654464 31109 ts_tablet_manager.cc:1434] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:11:28.656996 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-82bd288ed43e47fbabdbcfbfaca06dfb received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:28.657464 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-82bd288ed43e47fbabdbcfbfaca06dfb on tablet 82bd288ed43e47fbabdbcfbfaca06dfb with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:28.721240 31109 ts_tablet_manager.cc:933] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:28.724772 31109 tablet_copy_client.cc:323] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:28.726802 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 838f13bafde24742a950e2e4d62e21e9 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:28.727363 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 838f13bafde24742a950e2e4d62e21e9 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-838f13bafde24742a950e2e4d62e21e9
I20260709 13:11:28.732856 30197 tablet_copy_source_session.cc:215] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:28.736035 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838f13bafde24742a950e2e4d62e21e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.746215 31114 ts_tablet_manager.cc:933] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:28.748340 31114 tablet_copy_client.cc:323] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:28.750296 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet db55e372a60b4a1a9c52676be275cf56 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:28.750900 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet db55e372a60b4a1a9c52676be275cf56 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-db55e372a60b4a1a9c52676be275cf56
I20260709 13:11:28.754980 31109 tablet_copy_client.cc:806] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:28.755620 31109 tablet_copy_client.cc:670] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:28.760267 30048 tablet_copy_source_session.cc:215] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:28.761497 31109 tablet_copy_client.cc:538] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:28.766044 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db55e372a60b4a1a9c52676be275cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.774151 31109 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:28.790038 31114 tablet_copy_client.cc:806] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:28.790791 31114 tablet_copy_client.cc:670] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:28.806284 31114 tablet_copy_client.cc:538] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:28.824321 31114 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:28.829667 31109 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:28.830788 31109 tablet_bootstrap.cc:492] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:28.831769 31109 ts_tablet_manager.cc:1403] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.021s
I20260709 13:11:28.835026 31109 raft_consensus.cc:359] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.836135 31109 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:28.837145 31109 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.840349 31109 ts_tablet_manager.cc:1434] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:28.842756 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-838f13bafde24742a950e2e4d62e21e9 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:28.843237 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-838f13bafde24742a950e2e4d62e21e9 on tablet 838f13bafde24742a950e2e4d62e21e9 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:28.846060 31117 ts_tablet_manager.cc:933] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:28.850337 31117 tablet_copy_client.cc:323] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:28.852227 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 34df6751216d4ac584919e5640b25bc4 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:28.852885 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 34df6751216d4ac584919e5640b25bc4 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-34df6751216d4ac584919e5640b25bc4
I20260709 13:11:28.857818 31114 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:28.858974 31114 tablet_bootstrap.cc:492] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:28.859763 31114 ts_tablet_manager.cc:1403] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.006s
I20260709 13:11:28.862699 31114 raft_consensus.cc:359] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.863559 31114 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:28.864213 31114 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.866995 31114 ts_tablet_manager.cc:1434] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:28.868654 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-db55e372a60b4a1a9c52676be275cf56 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:28.869108 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-db55e372a60b4a1a9c52676be275cf56 on tablet db55e372a60b4a1a9c52676be275cf56 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:28.868438 30197 tablet_copy_source_session.cc:215] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:28.874210 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df6751216d4ac584919e5640b25bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:28.891779 31117 tablet_copy_client.cc:806] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:28.892385 31117 tablet_copy_client.cc:670] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:28.897794 31117 tablet_copy_client.cc:538] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:28.911381 31117 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:28.931659 31117 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:28.932446 31117 tablet_bootstrap.cc:492] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:28.933097 31117 ts_tablet_manager.cc:1403] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:11:28.935782 31117 raft_consensus.cc:359] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.936621 31117 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:28.937263 31117 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:28.939273 31117 ts_tablet_manager.cc:1434] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:28.941576 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-34df6751216d4ac584919e5640b25bc4 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:28.942034 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-34df6751216d4ac584919e5640b25bc4 on tablet 34df6751216d4ac584919e5640b25bc4 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:28.989043 30738 raft_consensus.cc:1217] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:29.251492 30738 raft_consensus.cc:1217] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:29.285615 30738 raft_consensus.cc:1217] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:29.387436 30738 raft_consensus.cc:1217] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:29.565342 31056 raft_consensus.cc:1064] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:29.567188 31056 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:29.580106 30181 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.582129 31091 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.582890 30738 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.584656 31090 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.608917 30031 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.615171 31091 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.636544 31090 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.639542 30181 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.643669 30031 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.656457 30737 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.662328 29934 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.701874 30106 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:29.708334 30737 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:29.708842 30181 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:29.710765 31091 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.712558 31090 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.726495 31056 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.734197 30737 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.735345 31122 raft_consensus.cc:1064] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:29.738545 31122 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:29.738379 30181 raft_consensus.cc:2955] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.746066 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82bd288ed43e47fbabdbcfbfaca06dfb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:29.761469 30106 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.765576 31082 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.775323 29931 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.788239 30031 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.791412 30737 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.793304 31082 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.794757 31015 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.795939 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 82bd288ed43e47fbabdbcfbfaca06dfb with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:29.815881 31133 raft_consensus.cc:1064] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:29.818620 31121 raft_consensus.cc:1064] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:29.819051 31133 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:29.821246 31121 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:29.839184 31135 tablet_replica.cc:333] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:29.840520 31135 raft_consensus.cc:2243] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:29.841499 31135 raft_consensus.cc:2272] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:29.845963 31135 ts_tablet_manager.cc:1916] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:29.848832 31082 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.863792 30110 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.864681 30737 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:29.882869 31122 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:29.897801 31135 ts_tablet_manager.cc:1929] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:29.898535 31135 log.cc:1199] T 82bd288ed43e47fbabdbcfbfaca06dfb P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/82bd288ed43e47fbabdbcfbfaca06dfb
I20260709 13:11:29.905666 31015 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:29.938602 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 72006.4us
I20260709 13:11:29.942834 30738 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:29.958992 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 103799us
I20260709 13:11:29.960239 30106 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:29.963953 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 82bd288ed43e47fbabdbcfbfaca06dfb (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:29.978271 29936 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.055253 30031 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.057180 31133 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:30.064003 30033 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.073572 30741 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.082109 30737 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.084930 31021 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.087355 30181 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.096661 31082 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.101775 31021 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:30.131270 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64293.8us
I20260709 13:11:30.144613 31144 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.153479 30104 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.156205 30737 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.161023 30033 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.164425 30181 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.169783 31142 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.173878 30104 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.200098 29933 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.209116 30106 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.209532 30179 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:30.226280 30737 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.230679 31141 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:30.230993 29936 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.238497 31122 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.240139 30741 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.249702 30033 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.251492 31082 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.256502 30030 raft_consensus.cc:2955] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.262390 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 838f13bafde24742a950e2e4d62e21e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:30.266656 30179 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:30.271536 29936 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.278901 30741 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.280493 31082 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.284649 30104 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.289088 31082 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.293944 31141 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.295841 30741 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.298942 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 838f13bafde24742a950e2e4d62e21e9 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:30.304041 30104 raft_consensus.cc:2955] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.313603 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34df6751216d4ac584919e5640b25bc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:30.326570 29934 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.341650 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 34df6751216d4ac584919e5640b25bc4 with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:30.342653 31135 tablet_replica.cc:333] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:30.343632 31135 raft_consensus.cc:2243] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.344417 31135 raft_consensus.cc:2272] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.345187 31156 tablet_replica.cc:333] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:30.346252 31156 raft_consensus.cc:2243] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.347049 31156 raft_consensus.cc:2272] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.350536 31135 ts_tablet_manager.cc:1916] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:30.353093 31156 ts_tablet_manager.cc:1916] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:30.368984 31135 ts_tablet_manager.cc:1929] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:30.369499 31135 log.cc:1199] T 34df6751216d4ac584919e5640b25bc4 P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/34df6751216d4ac584919e5640b25bc4
I20260709 13:11:30.372561 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 34df6751216d4ac584919e5640b25bc4 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:30.389981 31156 ts_tablet_manager.cc:1929] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:30.390643 31156 log.cc:1199] T 838f13bafde24742a950e2e4d62e21e9 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/838f13bafde24742a950e2e4d62e21e9
I20260709 13:11:30.394728 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 838f13bafde24742a950e2e4d62e21e9 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:30.583711 30031 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:30.595650 30741 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.596025 30104 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:30.597774 31144 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.598834 31150 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:30.606805 31018 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.608345 30741 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.611188 30104 raft_consensus.cc:2955] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:30.618846 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db55e372a60b4a1a9c52676be275cf56 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:30.626875 29934 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.646792 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet db55e372a60b4a1a9c52676be275cf56 with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:30.672168 31157 tablet_replica.cc:333] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:30.673055 31157 raft_consensus.cc:2243] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.673826 31157 raft_consensus.cc:2272] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.677117 31157 ts_tablet_manager.cc:1916] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:30.691010 31157 ts_tablet_manager.cc:1929] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:30.691425 31157 log.cc:1199] T db55e372a60b4a1a9c52676be275cf56 P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/db55e372a60b4a1a9c52676be275cf56
I20260709 13:11:30.693138 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet db55e372a60b4a1a9c52676be275cf56 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:31.761260 30187 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:31.767671 30106 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:31.768594 30153 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d16b5c6cb31b4fa0bba89be17ed2c0c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.769131 31141 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.769584 30030 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.771054 31133 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.778347 31141 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.780265 30104 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.796330 30030 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.797729 30104 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:31.804731 29936 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.817886 30187 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:31.818733 30079 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb153e5e2ed243b6a7741de46f707450. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.820793 31056 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.821259 30031 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.828744 31091 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.837234 31158 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.844058 30181 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.852798 30104 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:31.858877 30179 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:31.859820 30079 consensus_peers.cc:597] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f18f2a27f1f4c5d8d0af8abe0f87bf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.863173 31158 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.877843 30030 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.884151 31091 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.883489 30030 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.901194 31056 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.904599 30179 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.918953 29934 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.935145 30030 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.936879 30031 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:31.948190 29934 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.960624 30179 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:31.961089 30004 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 813e1f3ea7f7411c9c6061753e927dfe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.962381 31170 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.963116 30104 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.965010 31170 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.971855 31021 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.974053 30179 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.975114 30104 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:31.998337 29931 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.203470 31179 ts_tablet_manager.cc:933] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:32.205884 31179 tablet_copy_client.cc:323] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:32.207590 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:32.208124 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-d16b5c6cb31b4fa0bba89be17ed2c0c3
I20260709 13:11:32.216109 30197 tablet_copy_source_session.cc:215] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.219360 31179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.234751 31179 tablet_copy_client.cc:806] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.235306 31179 tablet_copy_client.cc:670] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.239434 31179 tablet_copy_client.cc:538] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.248129 31179 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:32.300480 31179 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.301542 31179 tablet_bootstrap.cc:492] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:32.302286 31179 ts_tablet_manager.cc:1403] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.033s
I20260709 13:11:32.307299 31179 raft_consensus.cc:359] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.308221 31179 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:32.309991 31179 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.321334 31179 ts_tablet_manager.cc:1434] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 13:11:32.326020 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-d16b5c6cb31b4fa0bba89be17ed2c0c3 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:32.326463 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-d16b5c6cb31b4fa0bba89be17ed2c0c3 on tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:32.334434 31179 ts_tablet_manager.cc:933] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:32.336855 31179 tablet_copy_client.cc:323] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:32.338447 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet cb153e5e2ed243b6a7741de46f707450 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:32.339191 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet cb153e5e2ed243b6a7741de46f707450 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-cb153e5e2ed243b6a7741de46f707450
I20260709 13:11:32.345674 30123 tablet_copy_source_session.cc:215] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.349172 31179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb153e5e2ed243b6a7741de46f707450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.362347 31179 tablet_copy_client.cc:806] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.362934 31179 tablet_copy_client.cc:670] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.366650 31179 tablet_copy_client.cc:538] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.373165 31179 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:32.388790 31185 ts_tablet_manager.cc:933] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:32.390830 31185 tablet_copy_client.cc:323] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:32.392264 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 813e1f3ea7f7411c9c6061753e927dfe from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:32.392745 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 813e1f3ea7f7411c9c6061753e927dfe from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-813e1f3ea7f7411c9c6061753e927dfe
I20260709 13:11:32.395604 31179 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.396564 31179 tablet_bootstrap.cc:492] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:32.397233 31179 ts_tablet_manager.cc:1403] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:11:32.398471 30048 tablet_copy_source_session.cc:215] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.400274 31179 raft_consensus.cc:359] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.401135 31179 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:32.401587 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813e1f3ea7f7411c9c6061753e927dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.401811 31179 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.404435 31179 ts_tablet_manager.cc:1434] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:32.406179 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-cb153e5e2ed243b6a7741de46f707450 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:32.406601 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-cb153e5e2ed243b6a7741de46f707450 on tablet cb153e5e2ed243b6a7741de46f707450 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:32.426501 31185 tablet_copy_client.cc:806] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.427208 31185 tablet_copy_client.cc:670] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.427634 31179 ts_tablet_manager.cc:933] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:32.429818 31179 tablet_copy_client.cc:323] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:11:32.431457 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:11:32.431980 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-3f18f2a27f1f4c5d8d0af8abe0f87bf7
I20260709 13:11:32.432940 31185 tablet_copy_client.cc:538] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.438832 30123 tablet_copy_source_session.cc:215] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.443176 31179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.443197 31185 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:32.455916 31179 tablet_copy_client.cc:806] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.456452 31179 tablet_copy_client.cc:670] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.461829 31179 tablet_copy_client.cc:538] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.469532 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.470916 31179 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:32.493880 31185 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.494872 31185 tablet_bootstrap.cc:492] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:32.495579 31185 ts_tablet_manager.cc:1403] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.053s	user 0.031s	sys 0.014s
I20260709 13:11:32.500064 31185 raft_consensus.cc:359] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.500936 31185 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:32.501680 31185 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.504081 31185 ts_tablet_manager.cc:1434] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:32.511583 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-813e1f3ea7f7411c9c6061753e927dfe received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:32.512075 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-813e1f3ea7f7411c9c6061753e927dfe on tablet 813e1f3ea7f7411c9c6061753e927dfe with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:32.530987 31179 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.531838 31179 tablet_bootstrap.cc:492] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:32.532505 31179 ts_tablet_manager.cc:1403] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.009s
I20260709 13:11:32.535176 31179 raft_consensus.cc:359] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.535910 31179 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:32.536705 31179 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:32.538815 31179 ts_tablet_manager.cc:1434] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:32.544979 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-3f18f2a27f1f4c5d8d0af8abe0f87bf7 received from {username='slave'} at 127.0.0.1:36342
I20260709 13:11:32.545499 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-3f18f2a27f1f4c5d8d0af8abe0f87bf7 on tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:32.589978 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "396297d3a2474246b40507f61f59858c"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:32.590790 30104 raft_consensus.cc:606] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:32.620514 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:32.621209 30030 raft_consensus.cc:606] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:32.630412 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a672a61589048279810adba842422a0"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:32.631174 30030 raft_consensus.cc:606] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:32.635749 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:32.636453 30030 raft_consensus.cc:606] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:32.644338 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:32.645076 30030 raft_consensus.cc:606] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:32.649694 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:32.650461 30030 raft_consensus.cc:606] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:32.652251 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:32.654384 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:32.659934 31170 raft_consensus.cc:993] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:32.660482 31021 raft_consensus.cc:1081] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:32.662333 30738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:32.662940 30738 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.663286 30738 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.672384 30738 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:32.677533 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:32.678210 30033 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.678483 30033 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:32.679191 30033 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:32.679903 30738 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:32.680315 30033 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.680433 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:32.681018 30181 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.686951 30033 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:32.688098 30181 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:32.689028 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:32.689867 31182 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.696038 31182 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:32.698494 31182 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:32.709602 29931 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.815085 30738 raft_consensus.cc:1217] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:32.823236 30741 raft_consensus.cc:1217] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:32.839097 31021 raft_consensus.cc:993] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.840360 31021 raft_consensus.cc:1081] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.844754 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:32.845367 30179 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.845738 30179 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.853890 30179 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.856688 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:32.857293 30030 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.861163 30030 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:32.861994 30030 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.864698 30030 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.870036 30179 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:32.870476 30030 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.871464 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:32.872013 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:32.872225 31198 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.872535 30104 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.872824 31198 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:32.873833 31198 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.878561 30104 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.886040 31170 raft_consensus.cc:993] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.886546 31170 raft_consensus.cc:1081] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.888756 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:32.889360 30179 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.890133 30179 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.893658 29931 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.896216 30179 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.898918 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:32.899493 30030 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.899770 30030 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:32.900514 30030 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.902602 30030 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.901361 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:32.904881 30104 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.900415 30179 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:32.909116 30030 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.910256 30151 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:32.911319 30104 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.911988 31163 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.912514 31163 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:32.913453 31163 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.922611 31056 raft_consensus.cc:993] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.923094 31158 raft_consensus.cc:1081] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:32.925438 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "396297d3a2474246b40507f61f59858c"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:11:32.924701 29931 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.925972 30179 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.926353 30179 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.932271 30179 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.934571 30179 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:32.934746 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:32.935304 30030 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.938504 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:32.939098 30104 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:32.939354 30104 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:32.940011 30104 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.940729 30030 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.941076 30104 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.942112 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:32.945107 31163 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.945338 30738 raft_consensus.cc:1217] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:32.946455 31163 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:32.947476 31163 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:32.949520 30104 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:32.969489 29934 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.982302 30738 raft_consensus.cc:1217] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:33.042306 31170 raft_consensus.cc:993] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:33.042868 31021 raft_consensus.cc:1081] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:33.044974 30179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a672a61589048279810adba842422a0"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:33.045627 30179 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.045934 30179 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.050688 30179 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.053469 30179 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:33.054311 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:33.054895 30030 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.055212 30030 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:33.056008 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:33.056489 30104 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.056183 30030 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.057511 30030 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.065284 30104 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:33.065873 30030 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:33.066522 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:33.067324 31198 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.067792 31198 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:33.068646 31198 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.078796 29934 catalog_manager.cc:5697] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.089484 30181 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:33.091264 31182 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:33.145880 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 43937.5us
I20260709 13:11:33.198559 30030 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:33.200508 31193 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:33.254865 31154 raft_consensus.cc:993] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:33.255409 31154 raft_consensus.cc:1081] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:33.262176 31091 raft_consensus.cc:1064] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:33.265031 31091 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:33.267654 30030 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.270327 31206 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.271960 30187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:33.272558 30187 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:33.272928 30187 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.282137 30741 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.284305 31091 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.314474 30030 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.312717 30181 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.318040 30187 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.325369 30187 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:33.335839 31205 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.342762 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:33.343571 30033 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:33.344058 30033 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:33.344981 30033 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.346417 30033 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.352759 31205 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.353721 31163 raft_consensus.cc:1064] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:33.361654 31163 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:33.368034 30033 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:33.386783 30151 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:33.387701 31206 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:33.388221 31206 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:33.389072 31206 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:33.391160 31056 raft_consensus.cc:1064] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:33.392409 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:33.392985 30104 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.393710 31056 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:33.403522 30106 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.404001 30110 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.403522 30107 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.406827 30104 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:33.415390 30033 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.420140 31198 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.421563 30741 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.430017 31091 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.438088 29934 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.441653 31158 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.443899 30031 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.451419 30183 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.451468 31199 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.453797 31199 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:33.455368 31199 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:33.456403 30031 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.458667 31206 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.471603 31213 raft_consensus.cc:1064] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:33.483736 30104 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.486886 30741 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:33.497833 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46384.8us
I20260709 13:11:33.499980 31091 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.525328 31206 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.481614 31213 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:33.583217 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79338.5us
I20260709 13:11:33.591673 30032 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.594102 30187 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.655112 31225 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.671820 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.700380 31221 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:11:33.777768 30031 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.778380 30032 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.808561 29934 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:33.821044 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 160250us
W20260709 13:11:33.825959 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48590.4us
I20260709 13:11:33.834705 30738 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:33.835220 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 240105us
I20260709 13:11:33.862036 30187 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.871685 31245 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.876019 30107 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.890550 31091 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.892179 30110 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.903030 30740 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.918560 31225 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.926327 31213 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.948772 30031 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:33.948688 30737 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.958500 30030 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:33.964345 31021 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:11:33.959772 31234 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:11:34.002336 30106 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:33.940843 31198 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:11:34.040513 30032 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.047859 30038 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:34.083961 31226 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:11:34.056478 31158 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:34.123800 31223 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:34.157706 30741 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:34.154970 30738 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.212317 29936 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.233731 31236 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:11:34.368070 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 49708.7us
I20260709 13:11:34.377291 30737 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:34.395062 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 443600us
I20260709 13:11:34.406270 31229 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.424247 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:34.456260 29931 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.468113 30104 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:34.481299 30104 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.483348 31212 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.499140 30741 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.498221 30181 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.859705 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb153e5e2ed243b6a7741de46f707450 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:34.866591 31205 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:34.885294 30185 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.926806 31226 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:34.943186 29933 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:34.945597 31205 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:34.957165 30181 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:35.005823 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 47735.8us
W20260709 13:11:35.023766 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 65837us
I20260709 13:11:35.060390 31205 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:35.073663 30031 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.075477 30739 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.081044 30035 raft_consensus.cc:2955] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.104745 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet cb153e5e2ed243b6a7741de46f707450 with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33114
I20260709 13:11:35.099758 31226 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:35.115031 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.137351 29933 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:35.141079 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64687.3us
I20260709 13:11:35.146704 31274 tablet_replica.cc:333] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:11:35.164419 31270 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.178954 31274 raft_consensus.cc:2243] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.180069 31274 raft_consensus.cc:2272] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.191413 30736 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.197642 31235 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:35.210099 31274 ts_tablet_manager.cc:1916] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:35.213958 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:35.215237 30036 raft_consensus.cc:2955] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.243628 30183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:11:35.244333 30183 raft_consensus.cc:606] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:35.219504 30035 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.253630 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:35.254320 30104 raft_consensus.cc:606] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:35.257193 30033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:35.257798 30033 raft_consensus.cc:606] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:35.262161 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:35.262872 30104 raft_consensus.cc:606] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:35.265897 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:35.266538 30036 raft_consensus.cc:606] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:35.269556 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:35.269940 29934 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.271039 30739 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.272648 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:35.272761 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:35.273358 30036 raft_consensus.cc:606] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:35.274459 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:35.274348 31254 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:35.276237 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:35.279054 30181 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.286911 31247 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.289005 30739 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.306226 31272 raft_consensus.cc:993] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.306800 31154 raft_consensus.cc:1081] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.310084 30735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:35.310667 30735 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.311054 30735 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.314951 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 813e1f3ea7f7411c9c6061753e927dfe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:35.320317 30735 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.332648 31021 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:35.339159 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:35.360235 31236 raft_consensus.cc:993] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:35.360371 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:35.363870 30036 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.340510 30106 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.364185 30036 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:35.364892 30036 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.366127 30036 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.341010 31266 raft_consensus.cc:993] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:35.365008 30183 raft_consensus.cc:2955] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.368079 31266 raft_consensus.cc:1081] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:35.360371 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:35.369719 30110 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.359376 30735 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:35.375705 30185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:35.376469 30185 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.376855 30185 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.380673 30110 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.382521 31280 tablet_replica.cc:333] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:35.384677 30185 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.384975 31280 raft_consensus.cc:2243] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.333760 29936 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index 3 to 4, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.390007 30036 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.392594 30185 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:35.399276 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:35.401616 31193 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.402285 31193 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:35.402915 31274 ts_tablet_manager.cc:1929] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:35.393735 31205 raft_consensus.cc:1081] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:35.394724 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:35.404019 30033 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.401726 31280 raft_consensus.cc:2272] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.404353 30033 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:35.403406 31193 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.405253 30033 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.406291 30033 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.412580 31280 ts_tablet_manager.cc:1916] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:35.403388 31274 log.cc:1199] T cb153e5e2ed243b6a7741de46f707450 P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/cb153e5e2ed243b6a7741de46f707450
I20260709 13:11:35.420006 30033 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:35.429260 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:35.436501 31230 raft_consensus.cc:993] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.437124 31230 raft_consensus.cc:1081] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.436770 29933 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.441943 31240 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.451834 31240 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:35.453001 31240 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.448745 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43022
I20260709 13:11:35.454499 30736 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.454923 30736 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.463651 30077 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:35.464272 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:35.464965 30104 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.444686 30739 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.474596 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 813e1f3ea7f7411c9c6061753e927dfe with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50288
I20260709 13:11:35.474995 30104 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:35.464982 31236 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:35.489518 31229 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:35.492568 30182 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:35.489552 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet cb153e5e2ed243b6a7741de46f707450 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:35.502377 31235 raft_consensus.cc:993] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.502938 31235 raft_consensus.cc:1081] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.504673 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:35.505268 30036 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.505638 30036 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.507329 30735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:11:35.507989 30735 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.508380 30735 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.516091 30736 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.529099 30735 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.535055 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:35.535725 30035 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.537563 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:35.523022 30036 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.537736 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:35.538322 30182 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.525099 31266 raft_consensus.cc:993] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.538761 30182 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:35.539175 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:35.540216 30104 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.538766 30033 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.540884 30104 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:35.539343 31266 raft_consensus.cc:1081] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:35.543095 30734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:35.543717 30035 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.543781 30734 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:35.544425 30734 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.542026 30104 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.545770 30104 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.540082 30182 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.548162 30036 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:35.548398 30182 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.550414 30736 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:35.551859 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:35.555658 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:35.556493 30734 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.561040 30183 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.561581 31193 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.562124 31193 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:35.562831 30734 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:35.562994 31193 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.563562 30182 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.557730 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:35.566927 30110 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.567127 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:35.567845 30107 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.568115 31229 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:35.569360 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:35.558308 30033 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.567282 30110 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:35.570290 30183 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:35.571012 30110 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.571533 31261 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.572294 30110 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.571282 31236 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.573848 30739 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.540700 30735 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:35.593820 31280 ts_tablet_manager.cc:1929] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:35.594380 31280 log.cc:1199] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/d16b5c6cb31b4fa0bba89be17ed2c0c3
I20260709 13:11:35.595800 30107 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.595991 30110 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:35.599789 31261 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:35.596252 30183 raft_consensus.cc:2955] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:35.598122 31280 tablet_replica.cc:333] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:11:35.601732 31280 raft_consensus.cc:2243] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.602506 31280 pending_rounds.cc:70] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Trying to abort 1 pending ops.
I20260709 13:11:35.602268 31261 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.602905 31280 pending_rounds.cc:77] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636632494227456 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } } }
I20260709 13:11:35.604377 31280 raft_consensus.cc:2917] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:11:35.604877 31280 raft_consensus.cc:2889] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:11:35.605274 31280 raft_consensus.cc:2272] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.608891 31280 ts_tablet_manager.cc:1916] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:35.644068 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:35.648291 30704 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:35.658179 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:35.660550 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet d16b5c6cb31b4fa0bba89be17ed2c0c3 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:35.656703 30104 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.689821 31021 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.694880 31286 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.695688 31286 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:11:35.696173 30762 debug-util.cc:398] Leaking SignalData structure 0x7b0800276140 after lost signal to thread 28925
I20260709 13:11:35.693904 31021 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:35.697669 31288 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:11:35.703827 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002858a0 after lost signal to thread 29970
I20260709 13:11:35.698398 31286 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:35.715914 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:35.717114 30033 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.717473 30033 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:35.719125 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfc20 after lost signal to thread 30062
I20260709 13:11:35.718719 30033 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:35.720827 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002df3c0 after lost signal to thread 30137
W20260709 13:11:35.726078 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002f44a0 after lost signal to thread 30765
I20260709 13:11:35.729585 31021 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:35.734886 30033 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.767863 29936 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 3 to 4, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 1 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.770460 29934 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:35.798636 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 150735us
I20260709 13:11:35.821864 29933 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.833048 30033 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:35.847283 30033 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:35.848214 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54298
I20260709 13:11:35.850329 31267 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:35.907392 29934 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.911259 29934 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:35.981056 31292 tablet_replica.cc:333] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:11:35.983136 31292 raft_consensus.cc:2243] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.985702 31292 raft_consensus.cc:2272] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.998759 30035 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:35.999951 31292 ts_tablet_manager.cc:1916] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:36.000495 31286 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.004209 30104 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.007012 31261 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:36.013633 30031 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.015916 31286 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.046928 31280 ts_tablet_manager.cc:1929] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:36.047539 31280 log.cc:1199] T 813e1f3ea7f7411c9c6061753e927dfe P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/813e1f3ea7f7411c9c6061753e927dfe
I20260709 13:11:36.050825 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 813e1f3ea7f7411c9c6061753e927dfe (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:36.040352 29933 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.064846 30107 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:36.099321 30107 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.101871 31261 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.078608 31267 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:36.130431 30185 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.137894 31193 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:36.150132 30033 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.181676 31292 ts_tablet_manager.cc:1929] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:36.206907 31292 log.cc:1199] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/3f18f2a27f1f4c5d8d0af8abe0f87bf7
I20260709 13:11:36.216508 30030 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.223033 31286 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:36.244144 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 3f18f2a27f1f4c5d8d0af8abe0f87bf7 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:11:36.227015 31193 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:11:36.257197 30183 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:36.278251 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:36.279140 31247 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:36.297621 30104 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:36.342114 31247 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:36.393747 30107 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.439334 31193 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:36.483011 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78554.8us
I20260709 13:11:36.557170 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:36.612810 30033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:36.613761 30033 raft_consensus.cc:606] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:36.618517 30182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:11:36.619311 30182 raft_consensus.cc:606] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:36.624851 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:36.625547 30104 raft_consensus.cc:606] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:36.630908 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:36.631521 30104 raft_consensus.cc:606] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:36.634894 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:36.635439 30104 raft_consensus.cc:606] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:36.638701 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f86541372f8c463da3fe465d9c571876"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:36.639499 30104 raft_consensus.cc:606] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:36.641346 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:36.643067 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:36.683662 31271 raft_consensus.cc:993] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:11:36.684370 31235 raft_consensus.cc:1081] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:11:36.686106 30110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:11:36.686817 30110 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.687161 30110 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.699173 30110 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.702471 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:36.703248 30031 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.705691 30110 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:36.707180 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:36.707907 30182 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.708207 30182 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:36.709022 30182 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.709913 30182 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.711840 30031 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:36.712684 30033 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.721019 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:36.722072 31237 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:36.722656 31237 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:36.724421 30182 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:36.724419 31237 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.736645 29931 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.742162 31242 raft_consensus.cc:993] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:36.742934 31239 raft_consensus.cc:1081] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:36.744691 30182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f86541372f8c463da3fe465d9c571876"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:11:36.745347 30182 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.745795 30182 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.763427 30182 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.771642 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:36.772327 30110 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.772639 30110 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:36.773524 30110 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.776403 30110 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.780252 30182 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:36.787048 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:36.787983 30033 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.814260 30033 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:36.815887 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:36.816802 31271 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.817432 31271 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:36.818538 31271 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.819326 30110 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:36.836424 31239 raft_consensus.cc:993] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:36.836971 31239 raft_consensus.cc:1081] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:36.839010 30033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:36.839550 30033 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.839956 30033 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.839257 29931 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.848873 30033 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.851819 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:36.852445 30110 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.852771 30110 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:36.853704 30110 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.854790 30110 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.857719 30033 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:36.860204 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:36.860994 30182 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.872731 30182 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:36.874614 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:36.875722 31266 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.876183 30110 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:36.877506 31266 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:36.878736 31266 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.904599 29931 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.972800 31242 raft_consensus.cc:993] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:36.973534 31237 raft_consensus.cc:1081] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:36.976112 30033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:36.977013 30033 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.977502 30033 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.978443 31266 raft_consensus.cc:993] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:36.978998 31266 raft_consensus.cc:1081] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:36.981490 30739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:36.982081 30739 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.982429 30739 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.988253 30033 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.994879 30033 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:36.996379 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:36.997133 30110 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.997473 30110 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:36.998548 30110 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:36.999039 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:37.000480 30182 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.999759 30110 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.020186 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:37.021864 30739 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:37.028787 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:37.030272 31266 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.030864 31266 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:37.031563 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:37.032213 30033 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.031836 31266 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:37.032549 30033 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:37.033435 30033 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:37.034539 30033 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.037665 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:37.038630 30182 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.040180 31242 raft_consensus.cc:993] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:37.040693 31242 raft_consensus.cc:1081] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:37.037578 30110 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:37.040761 30739 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:37.042454 30031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:37.043066 30031 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:37.043449 30031 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.052433 30031 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:37.053038 30182 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:37.054533 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:37.055203 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:37.055624 31301 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.055809 30110 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:37.056162 31301 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:37.056201 30110 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:37.056839 30033 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:37.057358 31301 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:37.057309 30110 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:37.063706 30110 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.066880 30031 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:37.074975 29931 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.090456 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:37.091305 30182 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:37.104826 30031 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:37.114579 30182 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:37.087523 29936 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.117274 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:37.118611 31304 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:37.119099 31304 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:37.119938 31304 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:37.082171 30110 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
W20260709 13:11:37.145148 30004 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76d91f22e2654dd1ae5451605e7a3b23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.146996 30110 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:37.148250 31305 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.152134 30182 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:37.154214 31305 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.159626 31304 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.166994 30107 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.169520 29936 catalog_manager.cc:5697] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.196079 30183 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:37.196862 29931 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.224720 30107 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:37.227443 30153 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c1b7d91eea54fb4990789f41041df86. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.229890 31271 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:37.237625 30031 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:37.239005 30183 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:37.239252 31271 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.240974 31237 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:37.273092 30036 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:37.277525 31237 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:37.280273 31240 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.283376 30036 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.288789 30182 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.291890 30107 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.293658 31304 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.304149 30181 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.315516 31305 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.319041 30110 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.335510 30181 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:37.382345 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 56140.6us
I20260709 13:11:37.402415 29936 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.409176 30031 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:37.412595 31338 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:37.508000 30153 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3facd19034dd44899de7471297d45bbc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.528158 30104 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:37.582168 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57911.8us
I20260709 13:11:37.604990 30030 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.607803 30036 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.665535 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.679602 30110 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.665618 31350 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
W20260709 13:11:37.725911 31346 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:37.707131 31342 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:11:37.733270 30107 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.736424 30110 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.748034 31339 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:11:37.753458 31271 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:37.757141 31342 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.775554 31352 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:37.775333 31266 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:37.823037 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 119897us
W20260709 13:11:37.830891 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 107520us
I20260709 13:11:37.837162 30182 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.838836 31301 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.841557 31371 ts_tablet_manager.cc:933] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:37.842028 30033 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:37.852169 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 43722.6us
I20260709 13:11:37.865090 31373 ts_tablet_manager.cc:933] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:37.891628 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.896692 29933 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:37.913743 31373 tablet_copy_client.cc:323] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:37.923684 31371 tablet_copy_client.cc:323] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:37.926005 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 2c1b7d91eea54fb4990789f41041df86 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:37.926596 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 2c1b7d91eea54fb4990789f41041df86 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-2c1b7d91eea54fb4990789f41041df86
I20260709 13:11:37.935524 30197 tablet_copy_source_session.cc:215] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:37.943724 31371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b7d91eea54fb4990789f41041df86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:37.950529 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 76d91f22e2654dd1ae5451605e7a3b23 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:37.951144 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 76d91f22e2654dd1ae5451605e7a3b23 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-76d91f22e2654dd1ae5451605e7a3b23
I20260709 13:11:37.958264 30185 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.960204 30048 tablet_copy_source_session.cc:215] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:37.973559 30183 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:37.976260 31383 ts_tablet_manager.cc:933] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:37.987221 31373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d91f22e2654dd1ae5451605e7a3b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.004357 30035 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.027074 31359 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:38.049255 31272 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:11:38.061863 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:38.062793 30031 raft_consensus.cc:606] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:38.076506 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:38.077093 30031 raft_consensus.cc:606] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:38.080312 30107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:38.080871 30107 raft_consensus.cc:606] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:38.083814 30107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:38.084347 30107 raft_consensus.cc:606] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:38.087363 30185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:11:38.088145 30185 raft_consensus.cc:606] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:38.091904 30035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:38.094143 30035 raft_consensus.cc:606] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:38.095667 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:38.097342 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:38.105253 31371 tablet_copy_client.cc:806] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:38.105938 31371 tablet_copy_client.cc:670] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:38.106043 31383 tablet_copy_client.cc:323] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:11:38.106523 31373 tablet_copy_client.cc:806] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:38.107107 31373 tablet_copy_client.cc:670] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:38.109349 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet 3facd19034dd44899de7471297d45bbc from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:11:38.109995 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet 3facd19034dd44899de7471297d45bbc from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-3facd19034dd44899de7471297d45bbc
I20260709 13:11:38.117432 30104 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:11:38.119326 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 80291.6us
W20260709 13:11:38.119517 30004 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbc08410209249758a644676ff99841d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:38.127278 31371 tablet_copy_client.cc:538] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:38.164218 30186 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:38.172278 31373 tablet_copy_client.cc:538] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:38.185043 31247 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:38.189054 30197 tablet_copy_source_session.cc:215] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:38.192739 31364 raft_consensus.cc:993] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: : Instructing follower ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:38.193339 31266 raft_consensus.cc:1081] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer ef9ab4d665234a799376bf42ef5d058c to start an election
I20260709 13:11:38.195442 31365 raft_consensus.cc:993] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:38.195923 31365 raft_consensus.cc:1081] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:38.201618 30185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:11:38.202315 30185 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.202734 30185 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.210469 31272 raft_consensus.cc:993] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:38.211120 31272 raft_consensus.cc:1081] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:38.212978 31383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3facd19034dd44899de7471297d45bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.223814 31240 raft_consensus.cc:993] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:11:38.224360 31240 raft_consensus.cc:1081] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:11:38.228607 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:38.229197 30736 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.229605 30736 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.218196 31371 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:38.243098 30104 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:38.238763 30185 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.245782 30030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:38.246434 30030 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.246842 30030 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.240520 31373 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:38.246932 31390 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:38.252270 30183 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:38.258455 30185 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:38.261955 31305 raft_consensus.cc:993] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: : Instructing follower 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:38.262544 31272 raft_consensus.cc:1081] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Signalling peer 8d2f11cccca04a7683da4080ab797bd7 to start an election
I20260709 13:11:38.263231 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:38.263983 30035 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.264325 30035 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:38.265074 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:11:38.265933 30104 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.266348 30104 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.265211 30035 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.267756 30035 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.270437 30734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:43012
I20260709 13:11:38.271071 30734 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.271484 30734 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.271229 31361 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:38.278308 30104 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.280222 30104 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:38.288520 30030 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.294241 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:38.295045 30110 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.295045 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:38.295740 30033 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.295608 30734 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.299345 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:38.299964 30185 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.300285 30185 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:38.302495 30185 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.303728 30185 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.303845 30110 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:38.304193 30033 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:38.306864 30030 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:38.308254 30736 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.309132 31237 raft_consensus.cc:993] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:38.309764 31237 raft_consensus.cc:1081] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:38.311236 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:38.311825 30739 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.313056 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:38.313697 30110 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.317384 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:38.312386 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:38.318104 30734 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:38.326153 30035 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:38.326267 31368 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.328258 31368 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:38.330480 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:38.329954 31368 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.331060 30033 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.331444 30033 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:38.332113 30033 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.327294 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:38.333716 31367 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.337131 31367 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:38.338039 31367 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:38.334059 30038 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.339531 30038 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:38.339908 30110 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:38.340301 30038 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.333372 30033 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.347451 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:38.348870 31301 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.334105 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:38.350464 30107 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.350780 30107 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:38.351559 30107 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.349362 31301 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:38.352798 30107 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.353487 31301 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.361037 30107 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:38.336509 30185 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:38.361686 30038 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.368340 30035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:38.373207 30739 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:38.374328 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:38.398046 30038 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:38.379473 30033 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:38.399782 31352 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.400291 31352 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:38.401124 31352 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.388340 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:38.376698 30035 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.404655 30183 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.404893 30035 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.388461 30736 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:38.409987 29933 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 1 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.411154 30183 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:38.412482 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:38.413311 31301 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.413836 31301 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:38.414727 31301 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.414573 29930 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.419226 29931 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.420312 30035 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.422288 30035 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:38.422642 30104 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:11:38.430302 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:38.431157 30736 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.435858 29932 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.452293 30736 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:38.453732 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:38.454617 31352 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:38.455356 31352 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:38.456324 31352 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.474809 31383 tablet_copy_client.cc:806] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:38.476186 31383 tablet_copy_client.cc:670] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:38.481419 31383 tablet_copy_client.cc:538] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:38.485194 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:38.485993 30107 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:38.486304 30107 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:38.488816 30107 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:38.492214 30107 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:38.515587 30107 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:38.517280 31373 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:38.518602 31373 tablet_bootstrap.cc:492] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:38.519438 31373 ts_tablet_manager.cc:1403] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.286s	user 0.026s	sys 0.002s
I20260709 13:11:38.533545 31373 raft_consensus.cc:359] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.534523 31373 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:38.536676 31373 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.540619 31373 ts_tablet_manager.cc:1434] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:11:38.542941 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-76d91f22e2654dd1ae5451605e7a3b23 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:38.543447 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-76d91f22e2654dd1ae5451605e7a3b23 on tablet 76d91f22e2654dd1ae5451605e7a3b23 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:38.547129 31371 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:38.552968 31371 tablet_bootstrap.cc:492] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:38.553695 31371 ts_tablet_manager.cc:1403] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.336s	user 0.018s	sys 0.024s
I20260709 13:11:38.553858 31373 ts_tablet_manager.cc:933] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:11:38.560307 31373 tablet_copy_client.cc:323] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:11:38.576488 31383 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:38.591352 29931 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.593889 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet bbc08410209249758a644676ff99841d from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:11:38.594543 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet bbc08410209249758a644676ff99841d from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-bbc08410209249758a644676ff99841d
I20260709 13:11:38.598654 29931 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.600423 31371 raft_consensus.cc:359] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.601332 31371 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:38.607999 30048 tablet_copy_source_session.cc:215] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:38.607967 29932 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.620090 31373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc08410209249758a644676ff99841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:38.602105 31371 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.634086 31371 ts_tablet_manager.cc:1434] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:11:38.635990 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-2c1b7d91eea54fb4990789f41041df86 received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:38.636471 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-2c1b7d91eea54fb4990789f41041df86 on tablet 2c1b7d91eea54fb4990789f41041df86 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:38.656899 31383 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:38.657938 31383 tablet_bootstrap.cc:492] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:38.658788 31383 ts_tablet_manager.cc:1403] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.012s
I20260709 13:11:38.661123 31373 tablet_copy_client.cc:806] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:38.677883 31383 raft_consensus.cc:359] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.678803 31383 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:38.679486 31383 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:38.681967 31383 ts_tablet_manager.cc:1434] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:11:38.666414 31373 tablet_copy_client.cc:670] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:38.693094 31373 tablet_copy_client.cc:538] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:38.695477 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-3facd19034dd44899de7471297d45bbc received from {username='slave'} at 127.0.0.1:50696
I20260709 13:11:38.695967 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-3facd19034dd44899de7471297d45bbc on tablet 3facd19034dd44899de7471297d45bbc with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:38.716054 31373 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:11:38.724830 30183 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:38.726994 31368 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:38.735746 30033 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:38.753892 30734 raft_consensus.cc:1217] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:38.784534 30104 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:38.788160 31301 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:38.793005 30734 raft_consensus.cc:1217] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:38.846832 31353 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:38.988726 30182 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:38.995488 31301 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:11:39.074362 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 165382us
I20260709 13:11:39.151551 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:39.201318 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 75894.8us
I20260709 13:11:39.225775 30107 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:39.238911 31373 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:39.246598 31373 tablet_bootstrap.cc:492] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:11:39.248034 31373 ts_tablet_manager.cc:1403] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.532s	user 0.038s	sys 0.015s
I20260709 13:11:39.262560 31373 raft_consensus.cc:359] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:39.263603 31373 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:11:39.264468 31373 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:39.268226 31373 ts_tablet_manager.cc:1434] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.006s
I20260709 13:11:39.949707 31418 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:39.950775 31418 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:39.953428 31418 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.039808 31418 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.048234 31418 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.050552 31418 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.051123 31418 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.051836 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1393) took 1199 ms. Trace:
I20260709 13:11:40.051664 31418 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.052217 30035 rpcz_store.cc:276] 0709 13:11:38.852306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.852482 (+   176us) service_pool.cc:224] Handling call
0709 13:11:38.852767 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.853103 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.853131 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.047635 (+1194504us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.050012 (+  2377us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:40.050051 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.050123 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.051615 (+  1492us) raft_consensus.cc:1685] finished
0709 13:11:40.051635 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.051773 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1991,"threads_started":1,"wal-append.queue_time_us":2383}
I20260709 13:11:40.054023 31418 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.054651 31418 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.055605 31418 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.058338 31418 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.058815 31418 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.059235 31418 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.061126 31418 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.061709 31418 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.062266 31418 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.065294 31418 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.065891 31418 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.066409 31418 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.068506 31418 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.069018 31418 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.069984 31418 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.072341 31418 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.122406 31305 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.123170 31305 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.125034 31425 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.125161 31418 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.125933 31418 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.125798 31425 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.128939 31431 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.125775 31305 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.128290 31434 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.129839 31431 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.130661 31434 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.131189 31425 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.131764 31425 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.132529 31431 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.132392 31425 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.133389 31434 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.128865 31435 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.126725 31432 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.136595 31436 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.137480 31435 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.138550 31432 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.139930 31436 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.141310 31425 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.142043 31436 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.143083 31432 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.143106 31435 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.145056 31418 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.148303 30038 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:40.149202 31437 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.149775 31437 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.151978 31437 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.161710 30033 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:40.160693 31433 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.165668 31433 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.168701 31433 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:40.168763 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.005s	sys 0.020s
I20260709 13:11:40.169798 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.169498 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.170080 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:40.170150 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.006s	sys 0.021s
I20260709 13:11:40.171237 31305 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.171800 31305 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.174453 31428 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.175091 31428 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.177649 31418 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.178273 31418 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.180204 31433 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.180384 31418 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.181386 31433 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.185842 31433 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.188016 31305 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.190182 31370 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.190488 31428 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.190801 31370 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.188081 31342 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.195423 31342 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.196691 31418 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.197384 31418 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.198781 31370 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.200299 31418 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.201037 31418 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.201828 31418 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.202334 31342 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.204609 31418 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.206169 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.206818 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.210060 31437 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.210764 31437 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.213765 31437 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.209672 31433 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.216532 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.216933 31433 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.222570 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.250234 31305 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.256958 31428 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:40.251080 31271 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.252435 31441 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.254925 31439 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.261689 31305 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.279668 31305 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.272943 31437 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.283188 31437 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.286569 31428 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.287250 31428 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.282516 31305 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.268085 31271 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.288890 31305 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.293956 31271 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.294016 31437 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.274267 31433 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.310153 31418 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.310745 31305 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.418470 31305 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.419305 31305 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.312114 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.312007 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.425670 31431 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.426651 31431 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.297827 31361 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.359181 31434 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.270707 31441 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.281867 31439 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.339378 31440 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:40.358034 30078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.020s	sys 0.012s
I20260709 13:11:40.312657 31435 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:40.369532 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 106983us
I20260709 13:11:40.371204 31443 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.365056 31342 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.310791 31418 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.397652 31314 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:40.365182 31437 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.348984 31428 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.380313 31370 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:40.716848 30078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.569s	user 0.022s	sys 0.013s
I20260709 13:11:40.723265 31444 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.723918 31444 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.725631 31445 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.726473 31444 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:40.735245 28927 debug-util.cc:398] Leaking SignalData structure 0x7b080000f320 after lost signal to thread 30182
I20260709 13:11:40.721623 31433 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.717576 31435 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.547907 31434 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.726236 31445 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.745033 31438 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.749127 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 254) took 1883 ms. Trace:
I20260709 13:11:40.710863 31361 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.718918 31437 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.764523 29931 rpcz_store.cc:276] 0709 13:11:38.857745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.894377 (+ 36632us) service_pool.cc:224] Handling call
0709 13:11:40.741543 (+1847166us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:11:40.718577 31342 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.741385 31444 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.732968 31370 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.727706 31440 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.778666 31448 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.752140 31433 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.793241 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:40.767485 28927 kernel_stack_watchdog.cc:198] Thread 30182 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 322ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:11:40.781667 31305 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.791234 31441 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:40.826653 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 279682us
I20260709 13:11:40.785696 31445 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.734656 31443 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.797041 31446 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:40.824236 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 486449us
I20260709 13:11:40.804845 31431 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.780927 31444 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.828747 31305 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.847121 31452 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.779320 31448 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.832020 31441 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.835428 30736 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:40.858870 31456 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.781105 31438 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.847815 31452 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.843577 31431 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.848973 31439 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.857197 31449 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.860625 31423 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.861323 31418 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.858942 31457 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.927222 31445 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.913185 31431 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.929818 31361 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.830675 31446 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.847524 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:40.859975 31305 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.930099 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:40.868191 31441 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.860715 31454 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:40.948333 31451 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:40.948660 30059 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1920 after lost signal to thread 28925
I20260709 13:11:40.935756 31418 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.949527 31370 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.952903 31431 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.946964 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-bbc08410209249758a644676ff99841d received from {username='slave'} at 127.0.0.1:44710
I20260709 13:11:40.935066 31435 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.937039 31437 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.970060 31461 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:40.976660 31370 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.976884 31444 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:40.971217 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 143262us
I20260709 13:11:40.977326 31370 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.979488 31370 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.980149 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.946460 31342 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.983572 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:40.984225 30036 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:40.985157 30705 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:40.985889 31370 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.946291 31434 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.986301 31370 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:40.955889 31438 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:40.941936 31445 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.945922 31361 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:11:40.986989 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-bbc08410209249758a644676ff99841d on tablet bbc08410209249758a644676ff99841d with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:40.925168 31456 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:40.986712 31370 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.936352 31449 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:40.995448 31453 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.995748 31455 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.995970 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:40.996169 31459 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.997555 31441 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:40.997968 31305 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.987123 31437 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:40.970917 31418 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.014416 30106 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:41.019855 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.021797 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.023476 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.021293 30704 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:40.945171 31423 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.946242 31457 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.030704 31456 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.033823 31423 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.036834 31457 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:41.026360 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 250128us
I20260709 13:11:41.025453 30737 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:40.989209 31451 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.045519 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.047349 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.047983 30033 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:41.050594 31450 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:41.033829 31370 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.051086 31450 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.051539 31450 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.055069 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:41.057745 30030 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.066558 31448 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.018827 31440 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.053344 31370 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.081012 31448 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.083748 31448 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.024276 31453 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.088913 31453 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:40.987486 31454 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.078059 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.065286 31452 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.043246 31437 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:40.992462 31461 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.060685 31460 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:41.106647 30030 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
W20260709 13:11:41.108202 30182 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.889s	user 0.011s	sys 0.040s
W20260709 13:11:41.110178 30182 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.891s	user 0.011s	sys 0.041s
I20260709 13:11:41.113307 30705 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:41.098135 31467 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.043120 31459 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.061425 31455 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:41.129637 30153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.982s	user 0.031s	sys 0.011s
W20260709 13:11:41.130033 30153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.982s	user 0.031s	sys 0.011s
I20260709 13:11:41.119177 31440 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.136811 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.059957 31450 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.114230 31460 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.142462 31444 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.146767 31438 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.138834 31445 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.156013 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1438) took 1933 ms. Trace:
I20260709 13:11:41.150748 31342 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.148211 31440 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:41.137277 31461 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.126507 31467 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.159075 31451 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.376438 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:41.377715 30740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 297) took 1225 ms (client timeout 1527 ms). Trace:
W20260709 13:11:41.378147 30740 rpcz_store.cc:269] 0709 13:11:40.152497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.154421 (+1001924us) service_pool.cc:224] Handling call
0709 13:11:41.377430 (+223009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.379805 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.388414 31437 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.354720 31428 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.392143 31428 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.395135 31428 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.147655 31454 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.201154 31470 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.159672 30182 rpcz_store.cc:276] 0709 13:11:39.218400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.218754 (+   354us) service_pool.cc:224] Handling call
0709 13:11:39.219018 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.219198 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:41.110625 (+1891427us) log.cc:844] Serialized 14 byte log entry
0709 13:11:41.151122 (+ 40497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.151172 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:41.151199 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.151244 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.151347 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9289,"prepare.queue_time_us":39036,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":3492,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3575,"thread_start_us":1927625,"threads_started":2,"wal-append.queue_time_us":67300}
I20260709 13:11:41.201957 31448 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.200975 31466 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.220234 31423 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.219866 31271 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.195523 31450 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.182188 31449 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.369350 31459 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.380613 30740 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:41.195808 31469 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.162075 31438 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.675762 31469 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.683745 31435 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.684238 31469 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.684367 31435 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.166288 31418 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.215541 31460 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.665005 31271 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.195922 30739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 295) took 1044 ms. Trace:
I20260709 13:11:41.657729 31470 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.671537 31423 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.166472 31342 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.676153 31466 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.154234 31444 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:41.710731 31441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.017s
W20260709 13:11:41.724380 31441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.017s
W20260709 13:11:41.716811 30077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.004s	sys 0.013s
W20260709 13:11:41.718413 30078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.028s
W20260709 13:11:41.724938 30077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.013s
W20260709 13:11:41.725260 30078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.028s
I20260709 13:11:41.725958 31365 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:41.726605 31423 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.726511 31365 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.727232 31444 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.727624 31467 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.728785 31365 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.729228 31470 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.705971 31440 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.730362 31365 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.730957 31365 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.733089 30112 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:41.733242 31365 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.717993 31455 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.734449 31455 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.734757 31435 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.723204 31271 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.718879 31448 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.734949 31455 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.735378 31466 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.735526 31448 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.737075 31455 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:41.719790 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.020s
I20260709 13:11:41.734452 31438 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.703301 30739 rpcz_store.cc:276] 0709 13:11:40.151927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.194988 (+1043061us) service_pool.cc:224] Handling call
0709 13:11:41.195319 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.195519 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.195546 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.195610 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.195649 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.195727 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.195859 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.748560 31423 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.749290 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.749236 31423 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.738476 31467 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.737658 31448 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.741561 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.754873 30740 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.755983 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.756384 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 926) took 1635 ms. Trace:
I20260709 13:11:41.756765 30107 rpcz_store.cc:276] 0709 13:11:40.121187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.755644 (+1634457us) service_pool.cc:224] Handling call
0709 13:11:41.755932 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.756098 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.756124 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.756165 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:41.756192 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.756240 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.756333 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.757902 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.751951 31467 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.761015 31467 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.753161 31423 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:41.747167 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.020s
I20260709 13:11:41.764084 31459 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.764891 31449 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.765483 31449 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.764989 30740 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:41.767249 31450 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.767777 31450 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.769834 31450 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.769999 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 239) took 2880 ms. Trace:
I20260709 13:11:41.770398 31459 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.772430 31459 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.776716 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.775305 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:41.777714 30704 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.519s (SENT) [suppressed 3 similar messages]
I20260709 13:11:41.770434 29932 rpcz_store.cc:276] 0709 13:11:38.889854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.890481 (+   627us) service_pool.cc:224] Handling call
0709 13:11:41.769904 (+2879423us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1738744,"reported_tablets":1}
I20260709 13:11:41.778790 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.779161 31479 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.779484 31449 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.766017 31342 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.779848 31479 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.779453 30038 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:41.782866 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.782876 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.784116 31448 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.791627 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:41.791886 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:41.791954 31448 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.792444 30183 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:41.792858 31449 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.793272 31449 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.794325 31448 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.791733 30112 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.784986 31478 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:41.798038 31449 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.798830 31443 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.798763 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.799973 30112 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.800217 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.798275 31478 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.797119 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:41.806275 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:41.802284 30733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 301) took 1639 ms (client timeout 1597 ms). Trace:
W20260709 13:11:41.809656 30733 rpcz_store.cc:269] 0709 13:11:40.156638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.789299 (+1632661us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:41.790376 (+  1077us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:41.808856 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.811918 30739 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:41.813277 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.814786 31433 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:41.815352 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.816264 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.816601 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.817539 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.818123 30106 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.818302 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.818826 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.818976 30112 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.819453 30113 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.819866 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.820209 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.820456 30112 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.820392 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.820973 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:41.821193 30113 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.821383 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.821780 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.821966 30106 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.822582 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:41.823787 30186 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:41.828989 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:41.831218 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:41.832643 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:41.822572 30112 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:41.838272 30113 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:41.838438 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.839363 30740 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:41.843151 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:41.844027 30186 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:41.841415 30739 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:41.846282 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.846938 30739 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:41.847821 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.795944 31479 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.840824 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.850323 30739 raft_consensus.cc:1217] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:41.850734 31459 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.851104 31440 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.851413 31459 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:41.852499 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 71993.8us
I20260709 13:11:41.818992 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.851866 30739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 304) took 1565 ms. Trace:
I20260709 13:11:41.852715 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:41.858091 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.858808 30113 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.835649 30153 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:41.859788 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 82105.9us
I20260709 13:11:41.857203 30079 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:41.854599 30109 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:41.853317 31459 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.811939 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.856766 31272 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:41.854961 31440 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.861306 30153 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:41.871513 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.872619 30153 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:41.861320 30079 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:41.872993 30113 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
W20260709 13:11:41.870760 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 43896.2us
I20260709 13:11:41.861508 31448 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.863773 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.877295 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.876331 31443 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.876503 31342 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.874745 31479 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.871193 31272 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.865669 31433 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:41.871498 31459 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.880872 31448 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.877390 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.916117 31448 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.873564 31440 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.898336 31272 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.913236 31470 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.885782 31443 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:41.886619 31342 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.886957 31479 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:41.928869 31479 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.929122 30733 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:11:41.857661 30739 rpcz_store.cc:276] 0709 13:11:40.286699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.848759 (+1562060us) service_pool.cc:224] Handling call
0709 13:11:41.849308 (+   549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.851507 (+  2199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.851542 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.851594 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:41.851631 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.851692 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.851811 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1117,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81}
I20260709 13:11:41.910439 31433 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.914450 31478 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.933837 31433 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.914753 31441 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.934451 31441 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.936601 31441 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.915369 31477 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.927227 31470 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.937328 31477 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:41.938750 30733 raft_consensus.cc:1240] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:41.938966 31470 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.927992 31443 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.939775 31477 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:41.928404 31342 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.937748 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:41.933305 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 53994.9us
I20260709 13:11:41.942890 31433 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.944178 30105 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:41.949730 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.950038 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.950628 30030 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
W20260709 13:11:41.950713 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 118172us
I20260709 13:11:41.964586 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.940089 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:41.966073 30733 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:11:41.980427 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.980963 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 925) took 1860 ms. Trace:
I20260709 13:11:41.981338 30110 rpcz_store.cc:276] 0709 13:11:40.120816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.977823 (+1857007us) service_pool.cc:224] Handling call
0709 13:11:41.980495 (+  2672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.980666 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.980692 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.980732 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:41.980761 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.980810 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.980911 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:41.977210 30059 debug-util.cc:398] Leaking SignalData structure 0x7b08001c41e0 after lost signal to thread 29970
I20260709 13:11:41.982622 31441 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.983227 31441 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.983351 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:41.991318 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 62) took 1270 ms. Trace:
I20260709 13:11:41.992007 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.991746 30104 rpcz_store.cc:276] 0709 13:11:40.720917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.990597 (+1269680us) service_pool.cc:224] Handling call
0709 13:11:41.990856 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.991014 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.991039 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.991091 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:41.991121 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.991174 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.991265 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.984881 31361 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.991701 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:41.993486 31479 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.954095 30740 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:41.994134 30038 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:41.977425 31470 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:41.995822 31479 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:41.996608 30739 raft_consensus.cc:1217] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:41.995863 31470 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:41.997769 30079 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:41.998977 31368 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:41.999442 31368 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.999926 31368 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.999598 31448 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:41.985378 31441 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:42.001386 30737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 299) took 1845 ms (client timeout 1693 ms). Trace:
I20260709 13:11:42.002254 30033 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.991654 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.008399 31448 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:42.001905 30737 rpcz_store.cc:269] 0709 13:11:40.155869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.165858 (+  9989us) service_pool.cc:224] Handling call
0709 13:11:42.001157 (+1835299us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400439254. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:42.001277 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509844224}
I20260709 13:11:42.010836 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.009856 30001 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.012748 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.007150 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:41.977113 31477 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:42.016454 31436 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.016887 31436 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:42.004319 30059 debug-util.cc:398] Leaking SignalData structure 0x7b0800318580 after lost signal to thread 30062
I20260709 13:11:42.017267 31436 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.018002 30734 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:42.020292 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.021646 30033 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:41.937273 31449 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.022936 30740 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.023566 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.021772 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.025540 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.024214 30736 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:42.026376 31441 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:42.026656 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.026908 31441 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.027150 31477 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.028986 31441 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:42.020550 31435 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.029748 31470 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:42.030068 31435 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.030580 31435 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.024695 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.031606 30033 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:42.033082 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.033519 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.010666 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:42.036829 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.037180 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.037530 30112 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:42.037688 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.038400 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.038632 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.040181 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.040633 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.040815 30106 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:42.029217 31477 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.041770 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.041908 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.035302 31433 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.043327 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:41.989583 31443 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.045102 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.018627 31432 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.045643 30001 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.042963 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.044823 30704 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.020587 31479 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:42.047086 31361 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.047334 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.054227 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.036211 31459 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.055291 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.055541 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.056185 30739 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.056478 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.057447 30110 raft_consensus.cc:2393] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:42.058287 31443 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.058701 31449 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:42.047760 30738 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 298) took 1892 ms (client timeout 1789 ms). Trace:
I20260709 13:11:42.056383 31342 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:42.059551 30738 rpcz_store.cc:269] 0709 13:11:40.155552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.044864 (+1889312us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:42.047578 (+  2714us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:42.060456 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.060990 30738 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.061455 31342 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.061729 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.058212 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.063369 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.063792 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.063735 31436 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.064560 30038 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:42.064652 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.018066 31428 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:42.065887 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.070899 30032 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:42.071269 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:42.049636 31432 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.051431 31462 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.051923 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.073608 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:42.056497 31459 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.053766 31446 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.053516 31479 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.074752 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.073546 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.075903 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.076129 31479 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:42.076357 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.073962 31462 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.078234 31462 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.078243 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.077039 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.056697 30733 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.050313 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.066001 31361 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.070596 31428 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.034955 31272 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.106199 31272 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.106479 31459 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.106750 31272 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.050457 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.024120 31368 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.073230 31432 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.080160 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.108462 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.053898 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.083956 30108 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:42.143359 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.148392 30179 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.148578 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:42.149924 30001 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.115865 31352 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.142072 31418 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.151754 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.151973 31418 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:42.142851 30735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 296) took 1990 ms (client timeout 2131 ms). Trace:
W20260709 13:11:42.154263 30735 rpcz_store.cc:269] 0709 13:11:40.152214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.287880 (+135666us) service_pool.cc:224] Handling call
0709 13:11:42.053633 (+1765753us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faee9c 00007fcbe2faea5b 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:11:42.142777 (+ 89144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8125824}
I20260709 13:11:42.149537 31462 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:42.151253 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.086615 31434 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.155762 30183 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.153873 31418 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.150614 31352 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.085302 30738 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:42.157753 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.159399 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.169371 30032 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:42.107793 31361 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.160764 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 95) took 1177 ms. Trace:
I20260709 13:11:42.170413 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.107040 31459 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.159907 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.167196 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:42.169497 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 139) took 2016 ms. Trace:
I20260709 13:11:42.170507 30031 rpcz_store.cc:276] 0709 13:11:40.983822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.983960 (+   138us) service_pool.cc:224] Handling call
0709 13:11:40.984257 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.988022 (+  3765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.988044 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.988443 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.101781 (+113338us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:41.118603 (+ 16822us) log.cc:844] Serialized 14 byte log entry
0709 13:11:41.118814 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.118892 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.788676 (+669784us) spinlock_profiling.cc:243] Waited 971 us on lock 0x7b18001ba300. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6557 00007fcbe2fe87c1
0709 13:11:42.085291 (+296615us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18001ba300. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:11:42.160517 (+ 75226us) raft_consensus.cc:1685] finished
0709 13:11:42.160536 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.160695 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3270,"prepare.queue_time_us":16793,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4731,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":5838,"spinlock_wait_cycles":6951296,"thread_start_us":102983,"threads_started":2,"wal-append.queue_time_us":128508}
I20260709 13:11:42.175779 29933 rpcz_store.cc:276] 0709 13:11:40.153464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.153607 (+   143us) service_pool.cc:224] Handling call
0709 13:11:42.169434 (+2015827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607757,"reported_tablets":1}
I20260709 13:11:42.172605 30079 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.181643 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.184227 31489 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.186066 31489 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.187139 31489 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.175155 31352 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.194624 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.160198 31434 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.201562 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.206450 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 300) took 2012 ms. Trace:
I20260709 13:11:42.171618 31436 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.206888 30741 rpcz_store.cc:276] 0709 13:11:40.156201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.167902 (+2011701us) service_pool.cc:224] Handling call
0709 13:11:42.168230 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.168438 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.168469 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.168515 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:42.168554 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.168610 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.168726 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:42.207655 30059 debug-util.cc:398] Leaking SignalData structure 0x7b0800330d60 after lost signal to thread 30137
I20260709 13:11:42.208729 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.194032 31432 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.212749 31432 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.221452 31428 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:42.222489 31368 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.222903 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.223522 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.224615 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.224690 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.194859 31443 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.225728 30733 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:42.227283 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.226226 31434 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.228978 31443 raft_consensus.cc:697] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:42.227946 30153 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:42.232059 30153 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:42.242245 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.269954 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:42.273554 30705 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:42.284363 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:42.289819 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54951.4us
I20260709 13:11:42.295639 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.274675 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.296376 30179 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.200739 30736 raft_consensus.cc:1240] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.235882 31458 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.241348 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:42.303848 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 62619.3us
I20260709 13:11:42.241765 31271 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.236078 31347 consensus_queue.cc:1059] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:11:42.289002 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 139148us
I20260709 13:11:42.221177 31489 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:42.338215 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:42.339185 30034 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:42.305845 30059 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6de0 after lost signal to thread 30211
I20260709 13:11:42.335395 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.226284 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.257727 31368 consensus_queue.cc:1059] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:11:42.349947 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:42.358055 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 294) took 2206 ms. Trace:
I20260709 13:11:42.305964 31458 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.334257 31433 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.373962 31458 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.305631 30038 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:42.306687 31459 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.306213 31271 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.305014 30739 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:42.367780 31452 raft_consensus.cc:1064] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:42.364032 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.344254 31450 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.399843 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.400532 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.401314 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.401818 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.402088 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.402760 30184 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:42.403264 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.404115 30079 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.394227 31271 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.400633 30181 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.410393 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.358566 30734 rpcz_store.cc:276] 0709 13:11:40.151652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.979075 (+1827423us) service_pool.cc:224] Handling call
0709 13:11:42.009537 (+ 30462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.021344 (+ 11807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.357778 (+336434us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400650c50. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:42.357954 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42233600}
I20260709 13:11:42.411358 30181 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
W20260709 13:11:42.413604 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 82509.5us
I20260709 13:11:42.414826 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:42.375476 31433 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.342438 31432 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:42.418094 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:42.418854 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 145462us
I20260709 13:11:42.418143 30179 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:42.417022 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.419672 30705 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.421205 30183 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.422317 30705 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:42.376644 30735 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.305783 31443 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.395704 31484 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.377780 31487 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.426816 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.429208 31449 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.415108 31467 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:42.422511 31433 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.439623 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:42.439688 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 75779.5us
I20260709 13:11:42.441677 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.418766 31368 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.442531 30001 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.443035 31301 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.445771 30153 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:42.447947 31466 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.448580 31466 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.449069 31466 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.457806 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.466251 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.466878 31489 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.467773 31489 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.468257 31489 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.468144 31352 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.468945 31489 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.410373 31435 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.471509 31435 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.472373 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.434216 31487 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.473914 31487 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.430239 31486 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.475766 30030 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:42.469077 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.411804 31440 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:42.482249 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63027.2us
I20260709 13:11:42.483306 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:42.434294 31449 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.502202 30035 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:42.503422 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.508683 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.454663 31432 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.513110 30738 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:42.518926 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.452448 31492 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:42.527812 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 50491.8us
I20260709 13:11:42.529745 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.530539 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.495790 31467 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:42.532133 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 89694.3us
I20260709 13:11:42.506778 31449 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:42.524858 30004 connection.cc:256] RPC call timeout handler was delayed by -1.0758607269999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:11:42.465179 31433 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.542676 31368 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.542575 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:42.543268 31368 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.543751 31368 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.543807 31466 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.545147 30179 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:42.546416 31433 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.523146 31432 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.549749 31432 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.549263 31361 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:42.558390 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 75867.5us
I20260709 13:11:42.529587 31465 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.506968 31418 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.528298 31492 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.575479 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.566407 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.558679 30034 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:42.569792 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.570634 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.536134 30732 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.504673 31493 consensus_queue.cc:1059] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:11:42.579600 31491 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:42.589061 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.589982 30181 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.562729 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.536266 31462 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.596462 30181 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.578765 31486 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.580428 31314 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:42.588855 30033 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:42.602943 31467 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.604336 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.605679 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.606567 30182 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.608800 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.610833 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.600056 31435 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:42.557184 31434 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.616770 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.618348 30184 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.627630 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:42.567754 31433 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:42.581259 31492 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.638289 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.629863 31435 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.641088 30179 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:42.587679 31272 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.635475 31446 raft_consensus.cc:3055] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:42.648914 31446 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:42.590605 31458 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.657820 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.589550 31271 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.639446 31301 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:42.677824 31440 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.679754 31352 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.683777 31434 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.683305 31452 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.677747 31301 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.672439 31436 raft_consensus.cc:3055] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.686117 31436 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:42.672595 30059 debug-util.cc:398] Leaking SignalData structure 0x7b0800377ba0 after lost signal to thread 30765
I20260709 13:11:42.672536 30735 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:42.661734 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.688966 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 305) took 2395 ms. Trace:
I20260709 13:11:42.697734 31435 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.694343 30109 raft_consensus.cc:3055] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.733435 30109 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:42.734403 30109 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.735730 30109 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.735742 31489 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.736943 31458 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.737682 31314 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:42.738281 31314 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.739164 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.738958 31368 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.740552 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.740945 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.741174 30184 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
W20260709 13:11:42.694240 30105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36342 (request call id 64) took 1932 ms (client timeout 1519 ms). Trace:
W20260709 13:11:42.694825 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.750619 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.675763 31432 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.698166 30732 rpcz_store.cc:276] 0709 13:11:40.294030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.899036 (+1605006us) service_pool.cc:224] Handling call
0709 13:11:41.913485 (+ 14449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.587186 (+673701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.688672 (+101486us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54006e0fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:42.688900 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404735232}
I20260709 13:11:42.697894 30079 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:42.767488 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 69670.4us
I20260709 13:11:42.768818 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.751921 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.753002 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:42.758744 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 190967us
I20260709 13:11:42.755774 31314 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.759361 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.759543 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:42.756903 30105 rpcz_store.cc:269] 0709 13:11:40.762265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.863369 (+1101104us) service_pool.cc:224] Handling call
0709 13:11:42.694032 (+830663us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b540038ccd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:42.694170 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144670592}
I20260709 13:11:42.760964 31489 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:42.762153 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 243331us
I20260709 13:11:42.776157 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.777711 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.762435 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.766386 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.779186 30182 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:42.770964 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:42.780417 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.781363 31435 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.781921 30004 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.782780 31435 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.783461 30004 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:42.784265 31434 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.784658 31434 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.785068 31434 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.785171 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:42.786392 31352 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.786793 31352 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.787180 31352 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.791741 31492 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.794329 31492 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.795563 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:42.688043 31436 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.803485 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.801868 31434 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.799940 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.806433 30034 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:42.807811 30030 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.794971 31456 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:42.809183 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:42.812211 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:42.814002 30033 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:42.814447 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:42.796780 31443 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.817209 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.799449 31496 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.803361 31365 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.825030 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:42.834401 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.835361 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:42.834630 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.659722 31446 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.804651 31368 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:42.838279 30185 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:42.878925 30036 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:42.880625 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 43913.6us
I20260709 13:11:42.828073 31365 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:42.810177 31498 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.882731 30032 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:42.803735 31435 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:11:42.821822 31492 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.824375 31464 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.803364 31495 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:42.825284 31466 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:42.821766 31443 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.828562 31496 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.805040 31462 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:11:42.894539 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:42.895771 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 85503.4us
I20260709 13:11:42.880890 31489 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.895735 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.886880 31365 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.880180 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:42.903671 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.892104 31492 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:42.849789 31352 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:42.880236 31423 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:42.897658 31443 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.900241 31496 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.888072 31367 consensus_queue.cc:1059] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:42.920993 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.914376 31492 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.908449 31456 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:42.939881 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:42.922623 31503 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.943003 31462 raft_consensus.cc:1064] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:42.914786 31487 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:42.930193 31449 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.012630 30035 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:42.990769 31503 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:43.008915 30735 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.024772 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.025640 30031 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.025872 30032 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.031956 31271 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:43.040073 31508 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:43.049537 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.034030 31434 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:43.051621 31503 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.069025 30033 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.045614 31351 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:11:43.077752 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.080595 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.082630 30032 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.051877 31462 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.024678 31456 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.051075 31361 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.088683 30736 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.118844 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.119441 30113 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.117945 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.120913 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.124316 30109 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:43.127517 31464 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:43.128849 31464 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.085052 31487 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:43.133057 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 215226us
I20260709 13:11:43.125728 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:43.173048 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.118229 31503 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.136670 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:43.125753 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:43.323150 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.188894 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.331362 30110 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:43.332168 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.350123 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.276666 31493 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:43.357359 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 220739us
I20260709 13:11:43.188201 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:43.365764 30032 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.272413 31498 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.362447 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:42.773057 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.375533 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:43.379043 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 255) took 1574 ms. Trace:
I20260709 13:11:43.379410 29931 rpcz_store.cc:276] 0709 13:11:41.804821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.805038 (+   217us) service_pool.cc:224] Handling call
0709 13:11:43.378983 (+1573945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369705,"reported_tablets":2,"spinlock_wait_cycles":28544}
I20260709 13:11:43.391512 30737 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.377179 30108 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:43.378074 29933 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.366624 31493 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:43.361532 31272 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.403434 30030 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.400175 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:43.371173 31347 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:43.399113 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.398401 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:43.408981 31520 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.414150 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:43.415809 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:43.422402 30036 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.407588 31347 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:43.432034 30110 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:43.433534 31499 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.433667 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.435123 31517 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.435539 31506 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.435823 31517 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:43.436298 31517 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.439833 31443 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.440652 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.418169 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.447048 30037 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.442747 31347 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.450070 30733 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.450278 30112 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:11:43.450999 31497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.023s	sys 0.026s
I20260709 13:11:43.447104 31493 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.425782 31452 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:43.441205 31496 consensus_meta.cc:287] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.001s
I20260709 13:11:43.455062 30113 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:43.460394 30109 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:43.462100 30105 raft_consensus.cc:2393] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:43.462996 31479 raft_consensus.cc:3055] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.467214 31418 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.465938 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.469413 31521 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.471043 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.473361 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.437286 31492 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.474972 31493 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.470917 31499 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:11:43.474514 31479 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:43.546020 30106 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:43.536716 31465 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 13:11:43.546868 31365 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.002s
I20260709 13:11:43.534302 31521 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:43.476723 31496 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:43.571573 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.571839 31352 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:43.572201 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.581880 30030 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.573204 30735 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:43.583060 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.583926 30111 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:43.583894 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:43.569895 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:43.588514 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 167888us
I20260709 13:11:43.590426 31519 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:43.596719 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.600927 30179 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.570050 31521 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.601884 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:43.606632 31497 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.607183 31497 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:43.610374 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.611142 30032 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.612470 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:43.612844 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.571020 31365 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.620654 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:43.621879 31352 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.614307 31272 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:43.625350 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.626338 30108 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:43.625665 31352 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:43.626253 31272 consensus_queue.cc:1243] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer 98b3b699b87245df85d3aa84c13f5691 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:43.608071 31497 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.632743 30179 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.591428 31479 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.636013 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.624452 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.637775 30734 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:43.638115 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.637162 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.646562 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.630767 31352 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.648396 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.647203 30180 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:43.649255 30186 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:43.655414 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.658387 30735 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:43.660640 31493 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:43.663942 30030 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:43.649148 31479 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.670331 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.650667 30105 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.664664 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.674695 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.675920 30037 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.676324 31432 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.678043 31365 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:43.673913 30030 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:43.680469 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.681452 31301 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:43.681957 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:43.682636 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 408) took 1921 ms. Trace:
I20260709 13:11:43.683040 30737 rpcz_store.cc:276] 0709 13:11:41.760899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.016608 (+255709us) service_pool.cc:224] Handling call
0709 13:11:42.817084 (+800476us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:42.817387 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.396209 (+578822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.682382 (+286173us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54001c0cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:43.682556 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324337792}
I20260709 13:11:43.683537 31520 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:43.684059 31520 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.681977 31301 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.684728 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.679786 30030 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.684172 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.690026 30032 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.691346 30036 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:43.693817 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.695001 30186 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.699800 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.698419 31347 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:43.697573 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.703688 31421 raft_consensus.cc:1064] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:43.704713 31347 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:43.706333 31449 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.706847 31521 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:43.721899 30002 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.531s (SENT)
W20260709 13:11:43.724732 30077 leader_election.cc:336] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.515s (SENT)
I20260709 13:11:43.725428 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:43.728494 30179 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:43.740132 30179 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.695941 31505 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:11:43.741552 31443 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.743952 31505 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.744406 31505 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:43.746255 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:43.748538 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:43.751338 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.752460 30183 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:11:43.754468 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.754905 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.755713 30184 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:43.755630 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.758008 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.738125 31466 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:43.763247 30185 raft_consensus.cc:2393] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:43.766538 31520 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.768349 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.769182 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.769871 30181 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
W20260709 13:11:43.769317 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59175.7us
I20260709 13:11:43.768410 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.772433 30030 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.772580 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.773375 30035 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:43.772178 30186 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:43.772841 30002 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.584s (SENT)
I20260709 13:11:43.759506 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.769210 30187 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:43.778070 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:43.780874 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.782786 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:43.783231 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.781349 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.784230 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.772162 31436 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:43.789631 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64942.3us
I20260709 13:11:43.793764 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.797676 30185 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:43.797991 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:43.808352 31493 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:43.812512 30077 leader_election.cc:336] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.633s (SENT)
I20260709 13:11:43.813422 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:43.814460 31493 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.818390 30735 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.818177 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.837327 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:43.838447 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.838694 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.840102 30031 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.843391 30030 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:43.844134 30030 pending_rounds.cc:85] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 4
I20260709 13:11:43.839792 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:43.847451 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.794974 31464 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:43.853935 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.845348 30030 pending_rounds.cc:107] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:43.860773 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.864378 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.865664 31521 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:43.865768 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.866591 30184 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:43.859263 30030 raft_consensus.cc:2889] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:43.858582 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.868075 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.868535 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.869167 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.871546 30036 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:43.871562 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.869663 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:43.875494 30187 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:43.869750 30184 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:43.876794 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:43.866524 31486 consensus_queue.cc:1059] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:11:43.794869 31449 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:11:43.841183 31301 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.844973 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:43.864653 31505 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:43.855419 31368 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:11:43.886837 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.942827 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:43.908478 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.912678 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:44.106683 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.072593 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.855616 31272 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:43.911180 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.150157 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:43.983800 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:43.903340 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 125046us
I20260709 13:11:44.065873 30183 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
W20260709 13:11:44.153048 30002 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.594s (SENT)
W20260709 13:11:44.109766 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65991.7us
I20260709 13:11:44.153533 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.111163 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:44.154616 30002 leader_election.cc:336] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.597s (SENT)
W20260709 13:11:44.156219 30002 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.610s (SENT)
I20260709 13:11:44.156615 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.030371 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:43.884346 31489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:11:44.035836 31535 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:11:44.232511 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.090816 30736 raft_consensus.cc:1240] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:43.959226 31517 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.005s
I20260709 13:11:44.205129 31446 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.219264 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.242139 30180 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.031143 31496 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:44.223371 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.223953 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:44.230226 31531 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.389s	user 0.005s	sys 0.000s
I20260709 13:11:44.230495 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.231210 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.098958 30111 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:44.233179 30184 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.194260 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:44.233598 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 87210.2us
W20260709 13:11:44.261924 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.233773 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.262104 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.202512 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:43.976823 31484 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.266665 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.079917 31492 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:43.889042 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:44.270926 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.271725 30180 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:44.240099 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:43.974786 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.220916 30179 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.249854 30181 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.252969 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:44.253521 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.312548 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.040043 31512 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:11:44.265858 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.268592 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.313643 30184 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.262030 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.262959 31462 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.247560 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 180) took 1147 ms. Trace:
W20260709 13:11:44.308676 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 46217.7us
I20260709 13:11:44.263899 31505 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.257086 31503 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.324564 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.325095 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.325448 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.310490 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.308817 30033 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.314335 30183 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.275620 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.266872 31484 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:44.226945 31421 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.319290 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.243778 31517 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.323117 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.342814 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.339222 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.339351 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.326932 30187 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.348205 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.310454 31498 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.349629 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:44.351357 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:44.351704 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.353389 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.356912 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.358047 30187 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.360888 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.361999 30185 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
W20260709 13:11:44.375883 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.374644 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.381971 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.386600 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.389430 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.394652 30183 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:44.382573 31491 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.317787 30732 rpcz_store.cc:276] 0709 13:11:43.095556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.114918 (+ 19362us) service_pool.cc:224] Handling call
0709 13:11:43.820516 (+705598us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:11:44.242718 (+422202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6041856}
I20260709 13:11:44.416793 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.442471 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1462) took 1327 ms. Trace:
W20260709 13:11:44.447970 31539 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:11:44.450709 31537 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:44.455090 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 101827us
W20260709 13:11:44.455077 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 298861us
W20260709 13:11:44.457430 30002 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.598s (SENT)
W20260709 13:11:44.458356 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.460088 30002 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.668s (SENT)
I20260709 13:11:44.460567 30002 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.476209 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.476526 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.486661 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.487911 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.488726 31544 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:44.490180 30002 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.693s (SENT)
I20260709 13:11:44.489040 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.494392 30180 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:44.495370 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.495790 30037 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.495983 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.497913 30037 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:44.500398 30031 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:44.499915 30037 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.502322 30037 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.515825 30178 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:44.521351 30179 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:44.443112 30111 rpcz_store.cc:276] 0709 13:11:43.115124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.586952 (+471828us) service_pool.cc:224] Handling call
0709 13:11:43.614889 (+ 27937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.261753 (+646864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.442014 (+180261us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540022e554. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:44.442338 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107549056}
I20260709 13:11:44.418795 31484 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.537917 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.531503 30029 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:44.545284 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.552270 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.553669 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:44.555749 31432 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.555965 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.556529 31432 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:44.556973 31432 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:44.557118 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.557457 31432 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.558709 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.559175 31487 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.559821 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:44.559968 31487 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.560691 31487 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.560941 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.562115 30002 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.562849 31418 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.563462 31418 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:44.567065 30151 leader_election.cc:336] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.588s (SENT)
W20260709 13:11:44.569039 31436 consensus_meta.cc:287] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.001s
W20260709 13:11:44.570190 30077 leader_election.cc:336] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.855s (SENT)
I20260709 13:11:44.571056 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.545034 31517 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:44.585870 31456 raft_consensus.cc:3055] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.586338 31456 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:44.587222 31456 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:44.587973 31493 consensus_meta.cc:287] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.003s
I20260709 13:11:44.588589 31456 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.561390 31487 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.588637 31493 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:44.595358 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.590094 31487 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:44.602469 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:44.605129 30034 raft_consensus.cc:606] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:44.608322 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:44.609262 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.604125 31450 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.617522 31450 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.601884 31301 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.621933 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:44.622915 30105 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:44.622001 31301 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.626598 31301 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:44.604064 31489 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:44.627125 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.627449 31489 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.628316 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.596072 31436 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.629448 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.631450 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.631865 31450 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:44.613116 30108 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:44.632618 30704 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:44.633497 31433 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.634040 31433 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.634671 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:44.635016 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 90) took 1092 ms. Trace:
I20260709 13:11:44.635270 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.606817 31487 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.635932 31489 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:44.635488 30105 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:44.636587 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.635488 30108 rpcz_store.cc:276] 0709 13:11:43.542721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.654149 (+111428us) service_pool.cc:224] Handling call
0709 13:11:43.702069 (+ 47920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.632672 (+930603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.634762 (+  2090us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400305cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:44.634952 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009187584}
I20260709 13:11:44.639401 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.634802 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.641940 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.642017 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.646948 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:44.649165 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:44.620846 29931 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.654446 31367 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:44.655073 29931 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.655934 31367 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.656463 31367 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.659497 31484 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.650282 30035 raft_consensus.cc:2376] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2. Re-sending same reply.
I20260709 13:11:44.656929 29931 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:44.668395 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.668774 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.671083 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.662155 29931 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.673269 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:11:44.675124 30179 raft_consensus.cc:606] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:44.659574 31517 consensus_queue.cc:1059] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:44.676242 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.691972 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.692236 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:44.692224 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59704.7us
W20260709 13:11:44.676829 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 68611.1us
I20260709 13:11:44.695839 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:11:44.691636 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 111018us
I20260709 13:11:44.697198 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.699563 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.702488 30107 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:44.707185 30113 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.675722 31479 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:11:44.713881 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.717918 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.673058 31271 raft_consensus.cc:1027] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: attempt to promote peer 8d2f11cccca04a7683da4080ab797bd7: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:11:44.691834 31498 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.721957 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.722244 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.676369 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.726886 30106 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.723541 30704 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:44.698295 31301 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.729672 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:44.736963 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.708874 31491 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.671330 31506 consensus_queue.cc:1059] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:11:44.744590 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.750757 30002 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.753551 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.754482 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.754480 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.756510 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.758520 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.763799 30002 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.739637 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.767431 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.770291 30741 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:44.676493 31367 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.746060 31491 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.770283 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.812675 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.761823 31543 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.815286 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.817234 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:44.813445 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 114476us
I20260709 13:11:44.821498 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.745561 31516 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:44.806546 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:44.826848 31489 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:44.807655 31553 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:44.808140 31487 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.739710 31540 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.757735 31497 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.736835 31450 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:11:44.773869 31446 consensus_meta.cc:287] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.521s	user 0.017s	sys 0.007s
I20260709 13:11:44.761583 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:44.816404 31517 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:11:44.803107 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.861385 30182 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:44.724529 31523 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:11:44.830238 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:44.834232 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:44.836962 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:44.861837 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 58818.4us
W20260709 13:11:44.846226 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97032.1us
I20260709 13:11:44.762687 31425 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:11:44.865888 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.801690 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:44.847023 30737 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:44.814774 31491 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.756597 31519 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:11:44.830528 31367 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.818564 31503 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.818992 31544 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.816733 31433 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:44.768843 31272 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.827749 31462 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.766710 31418 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.830394 31543 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.882666 31446 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:11:44.865085 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:44.895836 30181 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:44.872195 30030 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.895905 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:44.898214 30111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "8d2f11cccca04a7683da4080ab797bd7"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:44.898911 30111 raft_consensus.cc:606] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:44.898980 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.899315 30111 raft_consensus.cc:614] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:44.899864 31436 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:44.900250 31436 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:44.900669 31436 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.903070 30181 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.903414 30181 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.903472 30184 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:44.904290 30181 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.905310 30181 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.905645 31476 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.907171 31487 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:44.907689 30184 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.874045 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:44.910298 31555 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:11:44.911932 30184 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.912813 30111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:44.913007 30184 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.913479 30111 raft_consensus.cc:606] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:44.883813 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:44.878924 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.862528 31368 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.913986 30184 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.888650 31561 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.934788 31561 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.935725 31561 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.936235 31493 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.936865 31493 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:44.937062 31561 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:44.890383 31554 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:11:44.891218 31564 consensus_queue.cc:1059] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:44.942705 30184 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.892071 30185 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:44.934247 31479 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.944365 31479 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.757515 31432 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.896793 31433 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:44.856594 31540 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.908389 31505 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.913343 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:44.914152 30035 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:44.900251 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:44.889737 31552 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:11:44.861542 31565 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.922644 30111 raft_consensus.cc:614] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:44.925369 30181 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.862645 31489 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:11:44.939908 31557 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:11:44.939810 31493 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:44.941535 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.946053 30036 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.949671 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:44.959277 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 131085us
W20260709 13:11:44.963559 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 63368.4us
I20260709 13:11:44.951380 31433 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:44.971773 31433 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.971859 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.973610 31432 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:44.959765 31505 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:44.975013 31505 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.976570 31505 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.977344 31570 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.977761 31570 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.977975 31271 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.978376 31271 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.978572 31570 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.979720 31570 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.980284 31301 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:44.980612 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.954520 31540 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.979346 31271 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:44.933092 31436 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.985836 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.967187 31456 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.965411 31565 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:44.993144 31565 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.994436 31565 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.945318 31479 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:44.991655 31566 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.993629 30732 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:44.990943 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:44.999348 30002 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:44.982715 31487 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.005048 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:44.988509 31516 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.987967 31476 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.998533 31365 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:45.027057 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.037216 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:45.008767 31271 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.038754 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.009217 31496 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.008605 31272 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.050050 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.014403 31516 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:45.009582 31446 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:45.029547 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:45.026116 31418 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:45.026995 31519 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.010140 31489 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:11:45.046474 31476 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.041656 31479 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.025601 31421 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:11:45.091352 31571 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:11:45.051314 31517 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.016952 31543 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:45.096840 31513 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.060155 30734 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.100757 31436 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.017881 31566 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.125716 31513 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.095450 31519 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:45.137615 31519 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.105096 31506 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.132761 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.055482 31496 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.133203 31569 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:11:45.114555 31476 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:45.143824 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.147383 31476 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:45.161032 31551 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:11:45.163782 31567 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:11:45.164397 31563 raft_consensus.cc:3055] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.164884 31563 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.143121 31516 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.183260 30735 raft_consensus.cc:1217] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:11:45.184213 30735 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:45.180392 30740 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:45.187674 31517 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.188082 31517 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.188853 31517 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.189682 31561 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.190033 31517 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.190137 31561 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.191260 31561 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.192550 31561 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.199872 31352 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.200508 31352 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.198619 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.194242 31513 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.204205 31487 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.206171 31418 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:45.206257 30004 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.206431 31493 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:45.198756 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 148826us
I20260709 13:11:45.211784 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.212963 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.216429 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.217320 31446 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.217994 31446 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.220745 30151 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:45.221920 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1444) took 1625 ms (client timeout 1633 ms). Trace:
W20260709 13:11:45.222332 30182 rpcz_store.cc:269] 0709 13:11:43.596338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.596465 (+   127us) service_pool.cc:224] Handling call
0709 13:11:45.221731 (+1625266us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002670d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:45.221837 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899339136}
I20260709 13:11:45.230392 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.238512 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:45.248752 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.282976 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44610us
I20260709 13:11:45.284576 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.281464 31462 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.287231 31446 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.290321 31433 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.291982 31462 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.292042 31579 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.293042 31462 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.208730 31418 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.232884 31367 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.300979 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 263820us
I20260709 13:11:45.226234 31566 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:45.233232 31352 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.286372 31571 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.302855 31352 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.281886 31506 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:11:45.165828 31563 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:45.310949 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.313122 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:45.313705 30182 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.311012 31421 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.318797 31516 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.311909 31564 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.316510 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:45.322376 31573 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:11:45.322799 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:45.322762 31576 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.323688 30741 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.325631 31563 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.329579 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 140) took 3028 ms. Trace:
I20260709 13:11:45.330544 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.332999 30182 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:45.335011 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:45.355829 30181 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:45.335536 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:45.338128 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:45.358676 30187 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.358855 30181 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:45.363829 30181 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.337630 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:45.339010 30186 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:45.368103 30179 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:45.368602 31456 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.369063 31456 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:45.348363 31569 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:45.358681 30030 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:45.336673 31564 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.346721 31492 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.369786 31456 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.372637 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.375327 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:45.333582 31421 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.355286 31446 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:11:45.383512 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.354887 31496 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:45.360998 31506 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.386651 31575 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:45.386868 31506 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.387451 31575 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.385540 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.360492 31503 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.316704 31519 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.371970 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:45.391287 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:45.378350 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:45.395587 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.391482 31492 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.402189 31523 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:45.403430 31489 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.403817 31489 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.404662 31489 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.406203 31489 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.337143 31491 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.416239 31491 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:45.420854 30733 raft_consensus.cc:2368] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3.
I20260709 13:11:45.420410 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:45.426478 30187 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:45.427366 31578 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.396862 31365 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.399611 31496 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.396610 31503 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.422528 31492 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.388021 31506 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.421916 30734 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:45.386680 31421 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.445030 31499 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.445576 30004 leader_election.cc:400] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3.
I20260709 13:11:45.495759 30004 leader_election.cc:403] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:45.393626 31487 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:45.430658 31425 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.450062 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:45.503397 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 53415.2us
I20260709 13:11:45.437366 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:45.508249 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70967.8us
I20260709 13:11:45.512338 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:11:45.499833 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46836.5us
W20260709 13:11:45.500929 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 60141.8us
I20260709 13:11:45.443506 31496 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:45.483816 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.515493 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:45.493817 31499 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.374467 29933 rpcz_store.cc:276] 0709 13:11:42.300863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.301002 (+   139us) service_pool.cc:224] Handling call
0709 13:11:45.329511 (+3028509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:43.467732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:43.469922 (+  2190us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:43.469960 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:11:43.469977 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:43.471710 (+  1733us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:43.476567 (+  4857us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:43.479713 (+  3146us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:43.548386 (+ 68673us) tablet.cc:701] Row locks acquired
0709 13:11:43.549537 (+  1151us) write_op.cc:260] PREPARE: finished
0709 13:11:43.562565 (+ 13028us) write_op.cc:270] Start()
0709 13:11:43.562696 (+   131us) write_op.cc:276] Timestamp: P: 1783602703562511 usec, L: 0
0709 13:11:43.562721 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:11:43.622322 (+ 59601us) log.cc:844] Serialized 536 byte log entry
0709 13:11:44.228624 (+606302us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:11:44.550773 (+322149us) op_driver.cc:464] REPLICATION: finished
0709 13:11:44.815848 (+265075us) write_op.cc:301] APPLY: starting
0709 13:11:44.815945 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:44.816074 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:44.816102 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:44.816372 (+   270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:44.816542 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:44.816595 (+    53us) write_op.cc:312] APPLY: finished
0709 13:11:44.827140 (+ 10545us) log.cc:844] Serialized 23 byte log entry
0709 13:11:44.847108 (+ 19968us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.855351 (+  8243us) write_op.cc:454] Released schema lock
0709 13:11:44.857039 (+  1688us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:44.886540 (+ 29501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.888093 (+  1553us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288215,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":244902,"apply.run_cpu_time_us":2362,"apply.run_wall_time_us":57703,"num_ops":1,"prepare.queue_time_us":63826,"prepare.run_cpu_time_us":19230,"prepare.run_wall_time_us":230598,"raft.queue_time_us":96438,"raft.run_cpu_time_us":17639,"raft.run_wall_time_us":199384,"replication_time_us":978408,"spinlock_wait_cycles":10101376,"thread_start_us":280260,"threads_started":4,"wal-append.queue_time_us":150961}]]}
I20260709 13:11:45.541654 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.542049 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:45.545616 31436 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:45.545627 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.508785 31432 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.509866 31365 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:45.509568 31505 consensus_meta.cc:287] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.002s
I20260709 13:11:45.510051 31272 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.545728 31577 consensus_queue.cc:1059] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.161s
I20260709 13:11:45.433749 31540 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.513919 31421 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.461776 31492 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.555061 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:45.517904 31578 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:45.588034 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.550143 31425 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.548285 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:45.548674 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:45.598584 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 50371.7us
I20260709 13:11:45.618600 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:45.585807 31436 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.543200 31496 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.540515 31499 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:45.602968 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.597376 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 312885us
I20260709 13:11:45.502012 31564 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.628674 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.630508 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.631255 31271 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.442152 31575 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.632772 30151 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.637140 30151 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.594307 31578 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:45.633963 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.638335 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.597977 31425 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:45.640239 31271 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.631188 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.629755 30108 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.623518 31436 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.622092 31505 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.545159 31503 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.625521 31365 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.645481 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.658344 30151 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.625801 31272 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:45.639076 31561 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.637573 31519 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.667821 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.641810 31446 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.630162 31493 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:11:45.645257 31425 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:45.671679 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51593.9us
I20260709 13:11:45.642390 31578 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.642127 31433 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.651860 31436 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.651721 31505 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:45.675990 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.679407 31544 raft_consensus.cc:3055] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.669680 31479 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:45.685529 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.648874 31570 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.672600 31576 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.724195 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.724699 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48756.4us
I20260709 13:11:45.689828 31459 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:45.731288 31561 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.731698 31433 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:11:45.774427 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97393.7us
I20260709 13:11:45.721808 31580 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.765790 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.719753 31505 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:45.747634 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.685664 31272 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.780438 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:45.726940 31565 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.003s
I20260709 13:11:45.783545 31576 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.771452 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 257271us
I20260709 13:11:45.720796 31544 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:45.778667 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.778954 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:45.779726 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:45.779937 31492 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:45.779822 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:45.785771 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.787240 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:45.796271 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.797720 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:45.799446 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:45.799911 30107 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:45.807742 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:45.801326 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:45.810207 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:45.812140 31582 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:11:45.820593 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.822219 31584 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:45.822744 31436 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.826476 31484 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:45.827035 31484 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.828087 30110 raft_consensus.cc:2368] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
W20260709 13:11:45.829811 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.828092 31580 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.831883 31580 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:45.805874 31564 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.808271 31561 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.846772 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:45.848256 30187 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.848354 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:45.801617 31577 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.849756 30104 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:45.849936 30030 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.851037 30104 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.849812 30113 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:45.777495 31459 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.829437 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:45.858328 30113 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:45.871803 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:45.861683 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.862483 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.873713 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.874231 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.874974 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.879385 30187 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:11:45.834924 31436 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:45.846792 31540 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.886035 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:45.881202 30705 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:45.898356 30107 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:45.886179 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:11:45.907660 31476 consensus_meta.cc:287] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.742s	user 0.002s	sys 0.009s
I20260709 13:11:45.908223 31476 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:45.845157 31580 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.892194 31301 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:45.889295 30733 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:45.888043 31492 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:45.854957 31544 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:45.926797 31581 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:11:45.927451 31544 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.929363 31578 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.931567 31578 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:45.933319 31563 consensus_meta.cc:287] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.005s
I20260709 13:11:45.933811 31484 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.935612 31425 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:45.924337 31456 consensus_meta.cc:287] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:11:45.937170 31496 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:45.926724 31583 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:11:45.938045 31456 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:45.942330 31456 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.942085 31505 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:45.882190 31499 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.856895 31577 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:45.950290 31506 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.954698 31577 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:45.992203 30029 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:45.998195 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 107517us
W20260709 13:11:46.002701 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.013646 30105 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:46.018471 30107 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.018253 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.022586 30109 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:45.913502 30734 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:46.026928 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.917800 31301 raft_consensus.cc:697] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:46.030478 31492 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.035369 31476 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.937354 31425 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:45.943079 31432 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3.
I20260709 13:11:46.038950 30079 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:46.045135 31496 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.046824 31459 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.051746 31499 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.052654 31456 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.037278 31476 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:11:46.032281 31301 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.049263 31433 consensus_queue.cc:1059] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.068030 31456 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.103255 31456 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.114166 30036 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:46.117295 31577 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:46.117837 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.119393 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.127394 30107 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.127271 31543 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.128288 31499 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.120328 31577 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.120358 31544 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:46.135111 31503 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:46.135958 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.136085 31503 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.135226 31544 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.139015 30110 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.138674 31499 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.140489 31544 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.141875 31505 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.143105 31503 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.144122 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.128813 31459 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.146027 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.146910 30183 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:46.147114 30107 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.147325 31577 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.137750 31543 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.150189 31543 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.130023 30111 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.141060 31499 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.160538 30108 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:46.162111 30104 raft_consensus.cc:1240] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.161989 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.185036 31580 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.146049 31459 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.186558 30183 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.188611 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.188880 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.200302 31580 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.203418 31564 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.204262 31564 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.203433 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:46.205792 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.206307 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.206358 30187 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.207502 31487 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.208316 31487 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:46.211237 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.212656 30029 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:46.214570 30734 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:46.216713 31580 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:46.218328 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.209111 31564 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.221009 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.224396 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.220187 31487 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.225543 31587 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.225593 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:46.226490 31587 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:46.227825 31505 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.228456 31505 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:46.225539 30030 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:46.229768 31505 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.222038 30031 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
W20260709 13:11:46.240564 31421 consensus_meta.cc:287] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.011s
I20260709 13:11:46.241268 30180 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:46.244519 31544 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.245225 31544 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.180388 31543 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:11:46.177294 31577 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:11:46.255987 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.251626 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.258581 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.258301 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.266808 30031 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:46.260129 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:46.253260 31365 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.012s
I20260709 13:11:46.257863 31499 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:46.252679 31301 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.271343 31499 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.272013 31301 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.259114 31459 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.247733 31544 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.275564 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.249480 31587 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.275400 31564 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.280022 31564 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.226046 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.280534 31564 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.282629 31365 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.284725 30106 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:46.288328 31580 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:46.290431 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.290385 31580 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.291057 31580 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.291236 31499 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.280840 30029 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.286891 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:46.295534 30112 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:46.295235 31577 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:46.301957 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 135489us
I20260709 13:11:46.303037 31499 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.307331 31499 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.307895 31499 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.304021 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.304286 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.309914 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.310061 30178 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:46.313962 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.319033 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.320714 31301 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.324183 31519 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:46.324872 31519 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:46.305285 30183 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.305466 30180 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:46.244457 31456 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.306034 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.332729 30029 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:46.333112 31519 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.334813 31519 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.337170 31497 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:46.338070 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.340178 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:46.338052 31497 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.342600 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:46.343683 31497 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.343796 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:46.344470 31513 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.345041 31513 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:11:46.346225 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.347054 31450 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.348261 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.349030 30180 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:46.347244 31542 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.349928 31542 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:46.352494 30705 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.346266 31513 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.359203 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.354630 31301 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.366892 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:46.372907 31543 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.373656 31543 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.376886 31543 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.380172 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.381011 30106 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:46.351035 31542 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.384462 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.385649 30111 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.383533 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:46.390111 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.390935 30035 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.390991 31580 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.325222 31499 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.369318 31301 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.406397 31564 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:46.407241 31272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.011s
W20260709 13:11:46.423323 31272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.011s	sys 0.011s
I20260709 13:11:46.423532 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.407246 30108 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
W20260709 13:11:46.407660 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.424324 30105 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:46.406874 31301 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:46.425464 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.426616 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.427331 30029 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:46.408712 29932 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:46.429534 31499 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.431087 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.431740 30036 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.430459 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.408262 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.436568 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.442816 30031 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.415406 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:46.422871 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.422873 31580 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.448397 31580 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:46.410527 31352 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.450398 31352 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.452643 31352 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.454370 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.455384 30182 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:46.455751 31575 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:46.457798 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.458446 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.449205 30109 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.459312 30178 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:46.454578 30734 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.461550 30181 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:46.465950 30179 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:46.467451 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.468117 30113 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:46.470242 31578 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.470484 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.470836 31578 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:46.471293 30186 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:46.472013 31578 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.478003 31418 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.478389 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.478730 31418 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.479146 30182 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:46.480990 31418 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.482497 30178 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:46.445636 30029 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.478008 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.484983 30181 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:46.485773 30031 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:46.486135 31563 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.412547 31564 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.413889 31456 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.495030 30036 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:46.496582 31578 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.496721 31432 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.497205 30740 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.497779 31432 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.500703 31432 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.502457 31506 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:46.503710 31506 consensus_queue.cc:1243] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:46.505954 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:46.517567 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.519038 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.519979 31421 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.492960 31563 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:46.529949 31506 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.530802 31506 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:46.531104 31586 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:46.532100 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.531857 31586 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.547533 31456 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.548171 31456 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.549362 31519 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.550034 31519 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.551656 31586 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.552877 31456 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.555042 30734 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:11:46.557231 30079 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:46.528162 31580 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:46.558279 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.559438 31456 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.557734 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.561445 31456 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:46.562723 31586 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:46.562430 31418 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.550943 30109 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:11:46.565105 31418 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.565959 31418 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.547574 31301 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.531883 31506 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.542196 31563 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.569914 31456 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.571503 31506 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.576758 30030 pending_rounds.cc:85] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 4
I20260709 13:11:46.577210 30030 pending_rounds.cc:107] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:46.577805 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.578238 30030 raft_consensus.cc:2889] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.571712 31563 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.598358 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.596352 31578 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:46.602381 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:46.604588 31602 log.cc:927] Time spent T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:46.592650 31564 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.584797 31421 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:46.580205 30029 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:11:46.622097 30031 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:46.625247 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.632866 31421 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.637138 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.631968 31564 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.640450 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.640847 30111 raft_consensus.cc:1240] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.641335 30038 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:11:46.642195 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.642699 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.644593 30111 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:46.646152 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.646648 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.646894 30111 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.647239 31610 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.647827 31610 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.648530 31610 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.650185 30105 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.650326 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.651001 30111 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.651427 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.652580 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:46.653666 31499 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.654078 31499 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.654435 31499 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.657471 31493 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.658165 31493 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.659155 31301 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.660588 31493 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.661427 31586 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.662006 31586 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.660872 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.663405 30187 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.631012 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.679991 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.627493 31578 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.688969 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:46.684856 31586 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.695729 31610 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.700424 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.700680 31610 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.701097 30036 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:46.702294 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.702476 30704 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:46.708115 30704 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:46.672125 31580 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:11:46.712750 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.715402 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 68990.8us
I20260709 13:11:46.717242 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.718586 30113 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:46.690688 31519 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.671239 31418 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.685599 31499 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:46.722982 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.708361 31513 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.733052 30002 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.714085 31564 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.720019 31459 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.744320 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:46.740120 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.740767 31450 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.741492 31272 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.744992 30106 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:46.721692 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.723989 31493 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:46.747455 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.742184 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.749742 31543 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:46.733529 31586 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.744379 31513 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:46.750434 31462 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.752749 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.751121 31272 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.759600 31352 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:11:46.772778 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.777771 31489 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.778330 31489 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.779175 31544 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.779773 31544 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.779866 30105 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.780236 31544 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.781610 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.782411 31513 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.783126 30111 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:46.784510 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.785521 31493 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.785663 31586 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.767927 31462 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.788630 31462 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.790189 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:46.790804 31497 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.788338 31493 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.794517 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.795010 31544 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.795885 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.751960 31450 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:46.797087 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.797447 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.803421 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.778728 31489 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.804122 30110 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
W20260709 13:11:46.801577 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.736200 31610 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.802877 30181 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:46.805042 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.806896 30036 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:11:46.811601 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.791344 31497 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.815971 31497 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.803455 31450 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.819869 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:46.820442 31577 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.821054 31577 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.822453 30740 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:46.823465 31577 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.823818 30110 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.824548 30107 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:11:46.824710 31499 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.824963 30110 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.825629 31563 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.826362 30733 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 1 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:46.826665 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.751312 31580 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.831523 31272 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.837095 30187 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:46.782537 30109 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:46.839718 31563 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.842804 31578 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.839669 31493 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:11:46.781284 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.850569 30104 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:46.851711 30113 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:46.785300 30111 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:46.852065 30036 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:46.855688 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.856775 30187 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.858707 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.860582 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.866842 30180 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:46.849938 31499 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.873198 30186 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.839099 31610 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:46.887416 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.868897 31611 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.888342 30705 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.865260 31580 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:46.863245 31563 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:46.889974 31611 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.873428 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.878477 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.898875 30035 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.886730 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:46.894170 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:46.901036 30740 raft_consensus.cc:2368] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:46.877979 31484 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:46.878837 31450 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.881227 31459 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.903748 31586 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.895686 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.904222 31462 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.904976 30186 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.905453 31611 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.906323 31616 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.906910 31616 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.910009 31272 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.910697 31272 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.894718 31499 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.913559 31499 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.914656 30038 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.901208 31540 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.916494 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:46.916851 31540 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:46.920555 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.921569 30183 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.921461 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.920657 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.922156 30109 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.913673 30181 raft_consensus.cc:2376] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2. Re-sending same reply.
I20260709 13:11:46.916940 31450 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:46.911202 30001 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.947s (SENT) [suppressed 102 similar messages]
I20260709 13:11:46.925216 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.930913 30031 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:46.878410 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:46.932947 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.933118 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.933674 30030 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:46.934367 30733 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:46.937551 31616 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.937812 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.923254 31272 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.940086 31462 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.941560 30178 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:46.942981 31540 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.943879 30178 pending_rounds.cc:85] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 4
I20260709 13:11:46.944188 30178 pending_rounds.cc:107] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:46.944523 30178 raft_consensus.cc:2889] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.910737 31544 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.947194 30004 leader_election.cc:400] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:46.947541 30004 leader_election.cc:403] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:46.948392 31544 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.948716 31503 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:46.949702 30185 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:46.950675 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:46.951522 31580 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.953287 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:46.953963 30105 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.954121 31616 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.950865 31418 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:46.955472 31616 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.956375 31563 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.946547 31272 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:11:46.959618 30734 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:46.959968 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.960600 30111 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:46.961019 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.961649 30186 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.963112 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.965566 30185 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:46.965776 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:46.966928 30113 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:46.966920 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.971840 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:46.972769 31611 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:46.973598 31611 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:46.974443 31580 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:46.976670 31611 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.977689 31580 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:46.979241 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.978333 31462 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:46.981606 31523 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:46.981767 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.982075 31523 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:46.983189 31523 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.984294 31523 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.979641 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.985862 31610 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:46.979513 31586 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.986730 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.987243 31586 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.987601 31586 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:46.987761 31301 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:46.956435 31616 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.992671 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:46.993552 30187 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.988683 31586 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:46.994817 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.996309 31503 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:46.961661 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.995911 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:46.996770 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.000115 31580 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.014714 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:47.018481 30036 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.996649 31610 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.006069 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:47.006910 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:46.993979 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:47.010893 30704 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.011698 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.030200 30181 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.011837 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:47.004817 31586 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.012939 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.053874 30031 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:46.979254 31489 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.017685 30110 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:47.016659 30182 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:47.055431 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.055860 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.056063 30182 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:47.030107 30187 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:47.030802 30179 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:46.970619 31272 consensus_queue.cc:1059] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:11:47.040056 30035 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:47.040107 30153 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:47.052809 30186 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:47.059027 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:47.065994 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.074831 30034 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:47.077826 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.078667 30036 raft_consensus.cc:2393] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:47.079485 30001 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.082971 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.086247 31301 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:47.087795 31301 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:47.014973 31459 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:11:47.090787 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 50762.8us
I20260709 13:11:47.014631 31462 consensus_queue.cc:1059] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:11:47.071122 31499 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.068368 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.116348 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.071488 31421 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.041136 31610 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.067072 31577 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:47.065008 30734 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:47.096259 31432 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:47.136371 30029 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:47.125165 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:47.137676 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.137897 30179 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:47.138821 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.117913 31587 raft_consensus.cc:3055] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.120190 31272 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.128755 30110 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:47.132491 31489 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:47.133975 30740 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:47.067047 31497 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.112901 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.179208 30181 raft_consensus.cc:2410] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:11:47.183794 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 71041.2us
I20260709 13:11:47.160188 31272 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.190428 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.158267 31587 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:47.202502 30181 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:47.208083 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.208807 30181 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:47.211892 31432 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.212394 31432 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:47.183174 31506 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:47.222846 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.141628 31421 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.204978 31272 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.199453 31513 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:47.247659 30181 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:11:47.253141 30182 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:47.214553 30109 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:47.205751 31493 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:47.218465 31589 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:11:47.257807 30734 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:47.279356 31580 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:47.279654 30178 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.213387 31432 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.283286 31432 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:47.290943 31625 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:47.294056 31587 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.252853 31513 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:47.297943 31513 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:47.301749 31639 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:47.302275 31493 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:47.302779 31493 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:47.302968 31637 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.303385 31637 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.303843 31493 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:47.306375 31519 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.306572 30734 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:47.306963 31519 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:47.296918 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:47.279088 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.329874 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:47.332273 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.335554 30181 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.346997 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:47.350821 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:47.323660 31493 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.358981 31589 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:47.359973 31489 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.363507 31489 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:47.362830 31589 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.374830 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:47.376449 30180 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
W20260709 13:11:47.372249 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 126758us
W20260709 13:11:47.378144 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.341776 31610 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:47.393030 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.371694 31642 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:47.411234 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:47.372068 31489 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:47.519863 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.547689 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:47.605382 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57787.1us
I20260709 13:11:47.378585 31616 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.362882 31595 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:11:47.557245 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:47.420529 31642 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:47.364254 31519 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:47.659344 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.664412 30181 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:47.656559 30180 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.668076 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:47.669752 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:47.679883 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.683609 30179 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:11:47.685182 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 274012us
I20260709 13:11:47.690399 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:47.657277 31418 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.563277 31637 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:47.695343 31418 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:47.692627 31544 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.005s
I20260709 13:11:47.714020 31418 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.714383 31544 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:47.717711 31563 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.718392 31563 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.684384 31352 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:47.720479 31352 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:47.726207 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.695094 31519 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.720877 31352 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.677793 31456 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:47.731309 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.695796 31575 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:47.701794 31523 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.717s	user 0.017s	sys 0.000s
I20260709 13:11:47.700735 31462 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:47.728389 30105 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.005s
I20260709 13:11:47.720844 31563 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:47.743876 31640 log.cc:927] Time spent T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:11:47.744736 31641 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:11:47.746560 31634 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.336s	user 0.007s	sys 0.009s
W20260709 13:11:47.749647 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.739194 31462 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.751466 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:47.751981 30038 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:11:47.763304 31646 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:47.799667 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 48303.9us
W20260709 13:11:47.768786 31629 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
W20260709 13:11:47.770732 31635 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.482s	user 0.001s	sys 0.000s
W20260709 13:11:47.773211 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.774243 31450 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:47.775286 31633 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
W20260709 13:11:47.776707 31636 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.488s	user 0.000s	sys 0.001s
W20260709 13:11:47.777191 31499 consensus_meta.cc:287] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 13:11:47.809360 31499 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.735795 31575 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.727763 31637 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:11:47.791445 30180 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:47.739393 30105 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:47.807174 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1511) took 1045 ms. Trace:
I20260709 13:11:47.807889 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.779881 31587 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.811903 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.812951 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.801812 31462 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.813760 30032 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:47.815783 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.824714 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 257) took 1572 ms. Trace:
I20260709 13:11:47.825456 31650 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:47.831693 30036 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:47.806109 31610 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.831462 31418 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.797588 31563 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:47.800209 31646 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:47.846297 31645 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:11:47.836573 31575 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.736858 31642 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.847342 30029 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:47.838420 30106 rpcz_store.cc:276] 0709 13:11:46.761998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.764995 (+  2997us) service_pool.cc:224] Handling call
0709 13:11:46.809862 (+ 44867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.852652 (+ 42790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.852701 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.869387 (+ 16686us) log.cc:844] Serialized 26 byte log entry
0709 13:11:46.898614 (+ 29227us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:46.899910 (+  1296us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.923372 (+ 23462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.923440 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.759747 (+836307us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b18003f62e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:11:47.803436 (+ 43689us) raft_consensus.cc:1685] finished
0709 13:11:47.806967 (+  3531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.807111 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":229748,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":35962,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":21134,"spinlock_wait_cycles":67629952,"thread_start_us":13085,"threads_started":2,"wal-append.queue_time_us":252882}
I20260709 13:11:47.850484 31646 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.859905 31642 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.849789 31616 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:47.840220 31564 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:47.868202 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.835402 31456 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:11:47.848354 31589 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:47.847532 31610 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:47.881430 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 189194us
W20260709 13:11:47.882645 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 151471us
W20260709 13:11:47.892833 31586 consensus_meta.cc:287] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.827s	user 0.002s	sys 0.010s
W20260709 13:11:47.905660 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.905738 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:47.907373 30034 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.881847 31564 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.912093 31564 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:47.873891 31653 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:47.914746 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 107569us
I20260709 13:11:47.884790 31639 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.853627 31563 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.853494 31650 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.898205 31610 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.941747 30180 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:47.943215 30104 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.003s	sys 0.017s
W20260709 13:11:47.946125 30104 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.017s
I20260709 13:11:47.948192 30030 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:47.946760 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 117) took 1025 ms. Trace:
W20260709 13:11:47.953299 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 115960us
I20260709 13:11:47.953759 30104 rpcz_store.cc:276] 0709 13:11:46.920877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.922990 (+  2113us) service_pool.cc:224] Handling call
0709 13:11:46.980224 (+ 57234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.980511 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:47.063327 (+ 82816us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.946440 (+883113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.946504 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:47.946560 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.946624 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.946714 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183806,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4345,"raft.queue_time_us":52409,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":957181,"threads_started":3,"wal-append.queue_time_us":329095}
I20260709 13:11:47.977715 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:47.978535 30031 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:47.947513 31651 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:47.985450 30031 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:47.952709 31272 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.701s	user 0.001s	sys 0.012s
W20260709 13:11:47.980988 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.995911 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.996902 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.989943 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 101915us
I20260709 13:11:47.974144 31616 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:47.945758 31564 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:11:47.983901 31580 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.015033 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:47.992206 31450 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:47.952720 31639 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:47.941432 31653 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.029611 30704 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:11:48.021842 31432 consensus_meta.cc:287] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.006s
I20260709 13:11:48.002801 31611 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:48.040330 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1637) took 1006 ms. Trace:
I20260709 13:11:48.040894 30182 rpcz_store.cc:276] 0709 13:11:47.029247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.056694 (+ 27447us) service_pool.cc:224] Handling call
0709 13:11:48.035022 (+978328us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540016fb54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:48.035131 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389475072}
I20260709 13:11:47.999979 31272 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:48.009914 31616 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.009282 31352 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.027889 31580 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:48.052734 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 52358.4us
W20260709 13:11:48.053737 31493 consensus_meta.cc:287] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
W20260709 13:11:48.054862 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54489.4us
I20260709 13:11:48.056824 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.057473 31660 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:11:48.058105 30111 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:48.055109 31272 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.063172 31657 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:48.071102 31523 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.071534 31523 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:48.073590 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.072383 31523 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.077822 31523 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.080996 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:48.081874 31638 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.636s	user 0.000s	sys 0.011s
I20260709 13:11:48.083528 30738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 332) took 1029 ms. Trace:
I20260709 13:11:48.083979 30738 rpcz_store.cc:276] 0709 13:11:47.053736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.074179 (+ 20443us) service_pool.cc:224] Handling call
0709 13:11:47.138908 (+ 64729us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:47.139171 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.139658 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.139684 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.163109 (+ 23425us) log.cc:844] Serialized 564 byte log entry
0709 13:11:47.258853 (+ 95744us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:47.259005 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.259383 (+   378us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.899552 (+640169us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:11:48.083177 (+183625us) raft_consensus.cc:1685] finished
0709 13:11:48.083217 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.083377 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284576896,"thread_start_us":73355,"threads_started":1,"wal-append.queue_time_us":174132}
I20260709 13:11:48.087731 30034 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:48.081987 31493 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.033730 31450 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.059410 31418 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.042357 31611 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.065464 31653 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.081961 31655 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.090982 31499 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:48.064301 31575 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.063400 31498 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 13:11:48.114779 31650 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.081449 31462 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.115466 31649 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.115885 31649 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:48.116266 31663 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:48.116952 31462 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.117492 31499 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:48.118480 31499 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.124418 30035 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.139822 31450 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.144136 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.147723 31352 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.116767 31649 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.153700 31489 consensus_meta.cc:287] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:11:48.154322 31489 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.155181 31653 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.156213 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.157034 30104 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:48.158504 31616 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.162966 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 240) took 2731 ms. Trace:
I20260709 13:11:48.111200 31563 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.182472 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:48.178418 31626 log.cc:927] Time spent T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.897s	user 0.004s	sys 0.000s
I20260709 13:11:48.165078 31616 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:48.143332 31611 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:48.188602 31649 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.189651 30104 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:48.190521 31616 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.193046 31655 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.194376 31616 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.204006 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:48.205323 31616 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.205817 31616 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.206245 31616 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.206877 31421 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.212464 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.162048 31639 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.165536 29931 rpcz_store.cc:276] 0709 13:11:45.430277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.430397 (+   120us) service_pool.cc:224] Handling call
0709 13:11:48.161191 (+2730794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70524,"reported_tablets":5,"spinlock_wait_cycles":11008}
I20260709 13:11:48.200438 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 110) took 1297 ms. Trace:
I20260709 13:11:48.255504 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.216342 31519 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:48.261947 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.149983 31646 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.272158 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.262097 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48708.4us
I20260709 13:11:48.271387 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.271483 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.259349 30184 rpcz_store.cc:276] 0709 13:11:46.903550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.917586 (+ 14036us) service_pool.cc:224] Handling call
0709 13:11:46.917926 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.952157 (+ 34231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.952190 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.952857 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.062674 (+109817us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:47.062714 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.062774 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.177605 (+1114831us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:11:48.197496 (+ 19891us) raft_consensus.cc:1685] finished
0709 13:11:48.197528 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.200350 (+  2822us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150,"raft.queue_time_us":22863,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":27163520,"thread_start_us":109365,"threads_started":1,"wal-append.queue_time_us":297980}
I20260709 13:11:48.267458 30031 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:48.191310 31489 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.273922 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.277911 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.278970 31672 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:11:48.280989 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.261579 31421 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:48.284268 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.284621 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:48.285946 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.288381 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:48.289235 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1646) took 1154 ms. Trace:
I20260709 13:11:48.292122 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.280079 31611 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:48.293967 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.292243 30179 rpcz_store.cc:276] 0709 13:11:47.128869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.138521 (+  9652us) service_pool.cc:224] Handling call
0709 13:11:48.282591 (+1144070us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540016e254. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:48.282748 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230027136}
I20260709 13:11:47.841985 29932 rpcz_store.cc:276] 0709 13:11:46.252542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.252878 (+   336us) service_pool.cc:224] Handling call
0709 13:11:47.824601 (+1571723us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:46.473299 (+     0us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe2fc90ac 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe9b0816c
0709 13:11:46.786039 (+312740us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:46.786834 (+   795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:46.786894 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:11:46.786927 (+    33us) tablet.cc:662] Decoding operations
0709 13:11:46.787416 (+   489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:46.787521 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:46.787555 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:46.787873 (+   318us) tablet.cc:701] Row locks acquired
0709 13:11:46.787934 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:11:46.788115 (+   181us) write_op.cc:270] Start()
0709 13:11:46.788374 (+   259us) write_op.cc:276] Timestamp: P: 1783602706788047 usec, L: 0
0709 13:11:46.788423 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:11:46.789220 (+   797us) log.cc:844] Serialized 536 byte log entry
0709 13:11:47.363517 (+574297us) op_driver.cc:464] REPLICATION: finished
0709 13:11:47.722111 (+358594us) write_op.cc:301] APPLY: starting
0709 13:11:47.722348 (+   237us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:47.722543 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:47.722602 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:47.723112 (+   510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:47.753513 (+ 30401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:47.753580 (+    67us) write_op.cc:312] APPLY: finished
0709 13:11:47.753872 (+   292us) log.cc:844] Serialized 23 byte log entry
0709 13:11:47.754060 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.754130 (+    70us) write_op.cc:454] Released schema lock
0709 13:11:47.754185 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:47.754559 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.754587 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9,"reported_tablets":5,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":358126,"apply.run_cpu_time_us":2603,"apply.run_wall_time_us":32479,"num_ops":1,"prepare.queue_time_us":296395,"prepare.run_cpu_time_us":35459,"prepare.run_wall_time_us":125567,"raft.queue_time_us":286606,"raft.run_cpu_time_us":117075,"raft.run_wall_time_us":308392,"replication_time_us":574888,"spinlock_wait_cycles":53391616,"thread_start_us":531342,"threads_started":4,"wal-append.queue_time_us":257953}]]}
I20260709 13:11:48.276552 31651 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.318415 31616 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.320971 31616 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:48.321352 31654 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:48.321736 31654 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.321161 29933 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.322079 31654 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.322768 31637 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:48.326359 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:48.330176 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1499) took 1340 ms. Trace:
I20260709 13:11:48.330264 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:48.331480 30183 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:48.333626 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.327395 31519 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.330720 30038 rpcz_store.cc:276] 0709 13:11:46.996227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.006623 (+ 10396us) service_pool.cc:224] Handling call
0709 13:11:48.324932 (+1318309us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540020c6d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:48.325090 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621874944}
I20260709 13:11:48.335654 31575 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.336256 31667 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:11:48.336203 29933 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.337527 31610 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.293437 30105 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:48.291846 31563 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.291607 31421 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.350867 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.291292 31450 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:11:48.325326 31655 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:48.355297 31655 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.323419 31637 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:48.365238 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:48.365643 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:48.349685 31611 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:48.351536 31578 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.372898 31655 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.373214 31646 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.378269 31610 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:48.378244 31580 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:48.380592 31670 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:11:48.382349 31642 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.383251 31651 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:48.383898 31651 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:48.383500 31637 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.357880 31421 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.372942 31672 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:48.409605 31672 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.412585 31672 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.385066 31651 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:48.413988 31575 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:11:48.423293 31575 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.423785 31575 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:48.426363 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.362399 31563 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:11:48.446067 30150 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.532s (SENT)
I20260709 13:11:48.446592 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:48.449262 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.449537 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:48.440536 31563 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.454067 30032 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.403741 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.454530 31672 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:48.461125 31672 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.460091 31462 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:48.463099 31462 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:48.464310 31462 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.468066 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64433us
I20260709 13:11:48.415763 31611 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.469882 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.425004 31575 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.470956 30032 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.471705 31575 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.488930 31672 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:48.498319 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.499081 31580 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.510733 31654 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.512465 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 66462.6us
W20260709 13:11:48.513608 30150 leader_election.cc:336] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.570s (SENT)
I20260709 13:11:48.514300 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:48.505857 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.515864 31580 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.517601 31595 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:48.521246 31595 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.521672 31595 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.526001 31580 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:48.526975 31580 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.530720 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:48.531019 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:48.531862 30032 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.531675 31580 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:48.555114 30150 leader_election.cc:336] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.629s (SENT)
I20260709 13:11:48.555945 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:48.557528 31577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.030s
I20260709 13:11:48.557271 31580 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.565858 31611 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.569974 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 427022us
W20260709 13:11:48.593044 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.576102 31421 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:48.577890 31671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.016s	sys 0.020s
W20260709 13:11:48.578388 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 480614us
W20260709 13:11:48.595515 31671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.017s	sys 0.020s
I20260709 13:11:48.599148 31421 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.599609 31682 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:48.601802 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:48.607969 30179 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:48.609733 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:48.610517 30184 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
W20260709 13:11:48.622068 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.643926 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 123853us
I20260709 13:11:48.645215 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.646816 31489 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.677878 31489 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.678367 31489 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:48.681816 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 255554us
I20260709 13:11:48.682387 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:48.682904 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.683650 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:48.684305 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:48.683698 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:48.684974 31642 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.684378 30740 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:48.685503 31611 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:48.684326 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:48.686523 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:48.688265 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 237300us
I20260709 13:11:48.689070 31639 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.691555 30178 raft_consensus.cc:1240] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:48.691776 31658 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:48.693545 31673 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:48.693938 31673 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:48.694340 31456 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.694909 31673 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.696627 31673 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:48.698808 31699 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:11:48.700570 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.703693 30029 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:48.705080 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:48.705674 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.705957 31611 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:48.706502 31611 raft_consensus.cc:697] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:48.707504 31611 consensus_queue.cc:237] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.714495 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:48.720189 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:48.721660 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:48.723206 31580 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:48.723567 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.724608 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.724997 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.725733 30109 raft_consensus.cc:2410] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:48.726159 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.726329 31421 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.726547 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.726922 30112 raft_consensus.cc:2393] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:48.727105 30180 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:48.726794 31489 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.727761 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.723484 31672 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.728331 30109 raft_consensus.cc:2376] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2. Re-sending same reply.
I20260709 13:11:48.724723 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.728355 31672 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.730232 31672 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.732944 31489 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.733336 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.734988 30106 raft_consensus.cc:2376] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2. Re-sending same reply.
I20260709 13:11:48.741745 31489 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.742431 31489 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.745970 31489 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.756234 31489 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.752842 30001 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.649s (SENT)
I20260709 13:11:48.759326 31513 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:48.773166 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:48.731029 31686 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:11:48.769068 31489 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.778903 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.789861 30109 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:48.790829 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.814318 31679 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:48.791004 31672 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.810272 30108 raft_consensus.cc:2410] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:48.812264 30736 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.812423 31489 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:48.845711 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:48.866863 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 286057us
W20260709 13:11:48.886600 30150 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.732s (SENT)
W20260709 13:11:48.888238 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.855248 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:48.853574 31654 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:48.896438 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.897653 30001 leader_election.cc:336] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.947s (SENT)
I20260709 13:11:48.899827 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.854312 31595 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.891009 31489 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.922575 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 53321.5us
W20260709 13:11:48.948640 30150 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.773s (SENT)
I20260709 13:11:48.949251 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:48.891407 31575 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.914754 30106 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:48.930620 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.957875 30112 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:48.930968 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 255248us
I20260709 13:11:48.900655 31462 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:48.951795 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54189.7us
I20260709 13:11:48.918206 31639 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:48.968549 30032 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.976257 30107 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:48.958564 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.983119 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.003027 30038 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:48.967490 31456 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:48.967243 31637 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:48.988746 30037 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:48.971292 31610 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:48.993435 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44822.2us
W20260709 13:11:49.011750 30150 leader_election.cc:336] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.824s (SENT)
I20260709 13:11:48.955551 31489 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:48.992331 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.018790 30112 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:48.959344 31575 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:48.999982 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.021236 30113 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.021821 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:48.978382 30110 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.047281 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:48.969760 31462 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:49.025875 31694 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:11:49.004197 31639 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.021299 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:49.035494 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.042137 31610 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.041868 30150 leader_election.cc:336] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.852s (SENT)
W20260709 13:11:49.048506 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.066247 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:49.050091 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.050603 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.066751 30036 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:49.067057 30110 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:49.040889 30108 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.068190 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.068797 30112 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.036070 31575 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.078315 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.083604 30038 raft_consensus.cc:2368] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:49.040977 31654 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:49.061517 31462 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.071678 31670 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.019078 31637 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.082415 30001 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:49.088778 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.083246 31611 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.131909 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49648.7us
I20260709 13:11:49.068727 31639 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.088325 31646 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.135226 30112 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:49.075492 31674 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:11:49.139750 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.136710 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:49.124842 31610 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.147215 30110 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:49.174868 30113 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:49.178658 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.135408 31658 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.137614 31462 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:49.191413 30038 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:49.137199 31653 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.189724 31462 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:49.198179 31704 log.cc:927] Time spent T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:11:49.198268 31462 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.203541 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.204495 30104 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.205443 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.205981 30104 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.206619 31637 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.207015 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.207630 30104 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.208472 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.180419 31654 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:11:49.209296 30104 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.209923 31654 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:49.210297 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.210417 31654 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:49.211066 30104 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:49.211596 31654 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.172920 31702 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:49.215667 31595 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.189839 31272 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:11:49.149323 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:49.208520 31688 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:11:49.213138 31654 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.233966 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.249419 30036 raft_consensus.cc:2368] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:49.225531 31610 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.225235 31657 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.231550 31642 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.258846 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.267158 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.268258 30036 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:49.271823 30106 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:49.194864 31658 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.138263 31611 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.272228 30106 pending_rounds.cc:85] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 1
I20260709 13:11:49.276907 30106 pending_rounds.cc:107] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:49.142292 31646 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.277276 30106 raft_consensus.cc:2889] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:49.262125 31610 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.265506 31642 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.235169 31653 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:49.317145 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.318147 30034 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:49.286199 30736 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:11:49.278205 31421 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.264657 31657 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.335525 30110 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.345413 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:49.339593 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:49.343297 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 263893us
I20260709 13:11:49.349774 31642 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.354552 31672 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.359259 30109 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:11:49.360165 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 318317us
I20260709 13:11:49.365221 31611 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.366743 31421 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.368279 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:49.369035 31421 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.369060 30035 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:49.371762 31610 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.372360 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.373895 30112 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.334820 30736 pending_rounds.cc:85] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 2
W20260709 13:11:49.372244 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 183867us
I20260709 13:11:49.379071 30037 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:11:49.379638 30037 pending_rounds.cc:85] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 2
I20260709 13:11:49.379961 30037 pending_rounds.cc:107] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:11:49.380304 30037 raft_consensus.cc:2917] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:49.382593 30037 raft_consensus.cc:2889] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:49.387530 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:49.391068 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:49.376466 31639 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.380664 30736 pending_rounds.cc:107] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
W20260709 13:11:49.394057 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.387878 31696 log.cc:927] Time spent T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.456s	user 0.002s	sys 0.003s
W20260709 13:11:49.403009 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.385085 31610 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:49.387754 31421 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.401705 30736 raft_consensus.cc:2917] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:49.424162 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.426153 30112 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:49.439101 30106 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:49.426954 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.427773 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.428910 31716 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.433490 31639 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.434453 31611 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.434544 31670 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.435932 31658 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.476771 30105 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.473506 31672 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:49.421262 31421 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.416117 31610 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.478458 30736 raft_consensus.cc:2889] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:49.491776 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 95610.9us
I20260709 13:11:49.488945 31489 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.479619 31639 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.480867 31611 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.479082 31716 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.494433 31672 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.494261 31646 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.539027 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:49.539698 30741 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:49.515384 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:49.541823 30733 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:49.542132 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.542802 30104 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:49.544713 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.555433 30079 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:49.559546 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:49.537562 31710 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.554953 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.560514 31710 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.562602 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.562955 31710 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.563931 31671 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.564316 31671 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:49.564388 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.565456 30107 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:49.565237 31671 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.567847 31722 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:49.557629 30079 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:49.572160 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.531070 31489 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.583009 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.583781 30183 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:49.584133 30107 raft_consensus.cc:2376] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2. Re-sending same reply.
I20260709 13:11:49.586237 31421 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.570549 31657 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.592301 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.598142 30107 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:49.581630 31722 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.602360 30104 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:49.589732 31651 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:49.595329 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:49.608690 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:49.583253 31489 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:11:49.614226 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.601869 31716 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.608032 31651 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.624540 31651 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.607453 31722 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.627568 30105 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:49.617219 31575 raft_consensus.cc:3055] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:49.622313 31639 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.629572 31575 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:49.614991 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.630611 31575 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.632632 30111 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:49.633630 31575 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.633980 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.634868 30111 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:49.636068 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.636760 30111 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.642540 31489 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.643055 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.643914 30106 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
W20260709 13:11:49.646529 31717 raft_consensus.cc:670] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:49.646617 31611 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.608980 31657 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:11:49.628522 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.609896 31724 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.615144 30733 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.618674 31673 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:49.649015 30105 raft_consensus.cc:2376] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:11:49.649668 31724 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.645026 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.662722 30106 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.658833 31673 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.663765 31673 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.668922 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.619095 31462 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:49.669688 30110 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:49.670578 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.671290 31462 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.671533 30110 raft_consensus.cc:2376] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2. Re-sending same reply.
I20260709 13:11:49.674448 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.675036 30110 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:49.672107 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.669690 31642 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.676282 30112 raft_consensus.cc:2376] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:11:49.676185 31673 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.676410 31642 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.673130 30033 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:49.677350 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.678100 30112 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.673506 31724 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.680018 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.681267 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.683130 30110 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.684381 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.684666 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.685575 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.685981 31642 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.686374 30182 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:49.688112 30106 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.689505 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.693061 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.693830 30105 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.653349 31610 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:49.695976 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.702714 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.691944 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.684995 30110 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.707697 31673 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:49.711952 31733 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 13:11:49.717829 31651 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.719703 30106 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.720525 30036 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:49.699955 30112 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:11:49.725693 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.726590 30036 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:49.729091 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.729882 30104 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.732726 30105 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:49.733688 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.735172 31651 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.736433 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:49.742897 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.743250 30741 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:11:49.736605 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.737653 31653 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.739674 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.741639 30030 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.744048 30031 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.744237 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.744704 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.745443 30107 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.746435 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.747192 30104 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.748030 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.745223 30036 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.752269 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.752666 30110 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:49.753593 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.754163 30110 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.758129 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:49.758725 30036 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:49.758749 30180 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.761987 30110 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.757236 30111 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.763367 30110 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:49.763705 30733 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:49.770000 30107 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:11:49.777590 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.743490 30105 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.792220 31722 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:49.797012 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.803844 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.810184 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:49.809962 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 427854us
I20260709 13:11:49.811139 30113 raft_consensus.cc:2376] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:11:49.811699 30180 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:49.812240 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.814028 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:49.813202 31717 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:49.813696 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 47814.4us
I20260709 13:11:49.815241 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.812198 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.818482 30033 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:49.805492 31580 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:49.816948 30113 raft_consensus.cc:2376] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:11:49.822225 31611 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:49.822882 31611 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:49.823885 31611 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.819367 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.825177 30110 raft_consensus.cc:2376] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:11:49.825505 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:49.819725 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.827097 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.827770 30105 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:49.829016 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.833750 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.841267 30105 raft_consensus.cc:2376] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3. Re-sending same reply.
I20260709 13:11:49.831914 31736 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.842481 30178 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:49.842815 30113 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:49.843118 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.838653 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.845571 30183 raft_consensus.cc:2368] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:49.847105 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.847748 30180 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:49.848127 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.831918 31666 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.849642 31666 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.839463 30104 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: [1.3-2.4]
I20260709 13:11:49.852989 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:49.858245 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:49.858603 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:49.858950 30179 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.859261 30034 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 1.
I20260709 13:11:49.860184 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:49.852174 31716 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:49.869274 31610 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:49.870857 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.871668 30182 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:49.880738 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:49.880769 30104 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:49.882082 30185 raft_consensus.cc:2410] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:49.884164 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:49.851924 31666 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.889514 30180 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:11:49.891718 30182 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:49.884254 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.894182 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:49.878783 30112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:49.896104 31720 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:49.900055 30112 raft_consensus.cc:606] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:49.900383 31720 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.880683 31679 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:49.904014 31720 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.886926 31421 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:49.905390 31421 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.905980 31421 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.906032 31722 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.820396 31717 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:49.909893 31717 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:49.869990 31610 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:49.901152 31666 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:49.911633 31610 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.889999 31563 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:49.839922 31580 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:49.952947 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:49.919760 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:49.965011 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.024538 30110 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.024859 30180 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.024040 30104 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.996137 30187 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:49.935926 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.952298 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:49.980881 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.027455 30182 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.027624 30112 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:49.951738 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:49.978595 30108 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:50.028815 30179 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
W20260709 13:11:50.029889 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 114404us
W20260709 13:11:49.962152 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 68039.6us
I20260709 13:11:50.034940 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.039829 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.042340 30180 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:50.044593 30077 leader_election.cc:400] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:50.045229 30077 leader_election.cc:403] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.045423 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.044791 30104 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:50.046079 30187 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.047885 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.047935 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.048709 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.048699 30180 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
W20260709 13:11:49.985179 31739 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:11:50.051848 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:50.053819 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.057366 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.058404 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.055030 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:50.059442 30036 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:50.055830 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:49.981065 31672 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:49.980306 31736 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.066125 31657 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:50.060715 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.058938 30184 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 1.
I20260709 13:11:49.952478 31563 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.061023 30104 raft_consensus.cc:606] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:49.977620 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 996) took 1133 ms. Trace:
I20260709 13:11:49.982167 31720 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.063395 30077 leader_election.cc:400] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:50.086289 30077 leader_election.cc:403] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.062439 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.044464 31671 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.138489 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.139711 30181 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:50.140810 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.144608 30187 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:50.076709 30180 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:50.078779 30104 raft_consensus.cc:614] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:50.080963 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1010) took 1043 ms. Trace:
I20260709 13:11:50.141729 30181 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:50.083236 30179 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:50.146322 30108 rpcz_store.cc:276] 0709 13:11:49.037457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.276732 (+239275us) service_pool.cc:224] Handling call
0709 13:11:49.978223 (+701491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.033985 (+ 55762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.080745 (+ 46760us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54000a1750. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:50.080896 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527298304}
W20260709 13:11:50.151177 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.064741 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.111474 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.068188 31716 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:50.052057 31653 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:11:50.114866 31421 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.118584 30183 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:50.081624 30109 rpcz_store.cc:276] 0709 13:11:48.844146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.848280 (+  4134us) service_pool.cc:224] Handling call
0709 13:11:49.977373 (+1129093us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000a1754. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:49.977530 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247232256}
I20260709 13:11:50.120635 31720 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:50.126762 30150 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.050s (SENT)
I20260709 13:11:50.158776 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.084409 31563 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.131501 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:50.132165 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:50.160100 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97731.9us
I20260709 13:11:50.161832 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.162745 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.163371 30002 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.132575 31587 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:50.164968 31673 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.133033 30110 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:50.135000 30182 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:50.068027 31666 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:11:50.154721 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:50.165781 30179 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:50.166317 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 103037us
I20260709 13:11:50.172349 30077 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:50.170351 31673 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:50.172732 30077 leader_election.cc:403] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:49.980358 31610 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.167433 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:50.175266 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 49159.3us
I20260709 13:11:50.174413 30185 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:50.182631 31580 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:50.183396 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 56669.7us
I20260709 13:11:50.183878 30184 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:50.184063 30150 leader_election.cc:336] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.070s (SENT)
I20260709 13:11:50.184662 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.165467 31462 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.170883 31682 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.155143 31716 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:50.164939 31587 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.199678 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:50.194767 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:50.180229 31720 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.202114 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:50.176985 30740 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.176792 31352 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.197606 31610 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:50.180804 31722 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:50.190524 30181 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:50.195148 30178 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.177835 31637 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.173630 31673 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.218111 30036 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.203853 31642 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3.
I20260709 13:11:50.199421 31729 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:50.211253 31580 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.208438 31682 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:50.242285 30001 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.501s (SENT)
I20260709 13:11:50.242832 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.207410 31716 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.230794 30153 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:11:50.250802 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82565.2us
I20260709 13:11:50.217629 31352 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.224006 31637 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.253523 30031 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
W20260709 13:11:50.257033 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 62542.8us
I20260709 13:11:50.259914 30112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:50.260311 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.260690 30112 raft_consensus.cc:606] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.261204 30112 raft_consensus.cc:614] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:50.261694 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.235797 31729 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:50.267750 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.248277 31682 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.275274 31587 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.275520 31352 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.285075 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.286392 30033 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:50.251799 31610 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.290766 31611 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.291114 31352 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.291260 31611 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:50.291676 31611 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.293959 31587 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.298521 31462 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.300231 31752 consensus_queue.cc:1059] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:50.257575 31637 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.314625 29930 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.317144 31421 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:50.318186 31651 raft_consensus.cc:993] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:50.316874 29930 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.318733 31651 raft_consensus.cc:1081] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:50.319484 29930 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.321606 29930 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.271114 31729 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.318210 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 257) took 4649 ms. Trace:
I20260709 13:11:50.270622 31720 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.330901 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.337705 30112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:50.284940 31736 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.337926 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.338668 30112 raft_consensus.cc:606] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.340837 30112 raft_consensus.cc:614] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:50.287257 31710 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:11:50.342803 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 73580.3us
I20260709 13:11:50.307900 31580 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:50.345665 30001 leader_election.cc:336] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.706s (SENT)
I20260709 13:11:50.349551 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:50.354214 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.356531 30001 leader_election.cc:336] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.578s (SENT)
I20260709 13:11:50.357031 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:50.358652 30001 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.591s (SENT)
I20260709 13:11:50.359233 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.341840 31421 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:50.369189 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 113797us
I20260709 13:11:50.370694 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:50.372164 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 87299.6us
I20260709 13:11:50.372943 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.347286 31672 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:50.347649 31580 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:50.381095 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.382982 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.385313 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:50.333848 29933 rpcz_store.cc:276] 0709 13:11:45.668424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.669274 (+   850us) service_pool.cc:224] Handling call
0709 13:11:50.318134 (+4648860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.990265 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.029285 (+ 39020us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.029322 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:49.029335 (+    13us) tablet.cc:662] Decoding operations
0709 13:11:49.029776 (+   441us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.029839 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.029865 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:49.030163 (+   298us) tablet.cc:701] Row locks acquired
0709 13:11:49.030201 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:11:49.030362 (+   161us) write_op.cc:270] Start()
0709 13:11:49.030479 (+   117us) write_op.cc:276] Timestamp: P: 1783602709030311 usec, L: 0
0709 13:11:49.030499 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.031179 (+   680us) log.cc:844] Serialized 929 byte log entry
0709 13:11:49.546472 (+515293us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.630021 (+ 83549us) write_op.cc:301] APPLY: starting
0709 13:11:49.630115 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.630229 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.630352 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.632648 (+  2296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.632810 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:49.632858 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:49.633060 (+   202us) log.cc:844] Serialized 29 byte log entry
0709 13:11:49.633226 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.633308 (+    82us) write_op.cc:454] Released schema lock
0709 13:11:49.633349 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.633738 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.633769 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11371,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":78950,"apply.run_cpu_time_us":2165,"apply.run_wall_time_us":3688,"num_ops":2,"prepare.queue_time_us":605081,"prepare.run_cpu_time_us":60398,"prepare.run_wall_time_us":296279,"raft.queue_time_us":99334,"raft.run_cpu_time_us":6503,"raft.run_wall_time_us":78861,"replication_time_us":504445,"thread_start_us":833889,"threads_started":4,"wal-append.queue_time_us":350104}]]}
I20260709 13:11:50.377990 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:50.389739 31657 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.397042 31751 log.cc:927] Time spent T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:11:50.396665 31657 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.399005 31657 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:50.390064 31736 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:50.349563 31653 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:50.395648 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:50.419170 30077 leader_election.cc:400] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:50.378638 31610 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.423597 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.385696 31580 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.432183 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.383790 31722 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.353664 31710 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:50.440440 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57544.7us
I20260709 13:11:50.418370 31759 raft_consensus.cc:3055] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:50.447698 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 77074us
I20260709 13:11:50.399034 31352 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.422562 31736 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:50.453364 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.460984 31765 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.461717 31765 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.462281 31765 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.461045 31760 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.417709 31756 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:50.465615 31760 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:50.466053 31760 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.461658 31736 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.474098 31764 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.475149 31764 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:50.479168 31757 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.479413 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.479890 31757 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.480656 31757 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.481014 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.487963 31580 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.436663 31651 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.489149 30037 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
W20260709 13:11:50.496555 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 137937us
I20260709 13:11:50.436877 31754 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.505617 31352 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.452960 31759 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.485625 31587 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.499701 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:50.455715 31563 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:50.434226 31610 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:50.507697 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74315.7us
I20260709 13:11:50.451224 31722 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.522650 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.493350 31651 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:50.523342 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74455.9us
I20260709 13:11:50.525823 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.501261 31672 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:50.512621 31421 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:50.528594 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.530104 31421 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.522599 31758 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.559872 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.560778 31653 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.561456 31642 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.593773 31642 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.595944 31722 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:50.526623 31651 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.561764 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:50.564164 31767 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:50.568298 31421 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:50.570696 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:50.571678 31730 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.521481 31352 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.591125 31710 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:50.591308 30740 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:50.558876 31611 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.561702 31768 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:50.598857 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:50.528980 31587 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:50.607650 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45996.5us
I20260709 13:11:50.577356 31563 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:50.643009 30038 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.644774 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.571615 31672 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.610456 31653 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.558636 31637 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.647917 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.675626 30079 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:50.676048 30110 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:50.677155 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.646651 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.650609 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.677942 30110 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.677966 30112 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.652501 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.679404 30104 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.653311 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.681181 30183 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:50.652575 30108 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.654285 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.654800 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.654907 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.683409 30180 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:11:50.655241 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.684325 30106 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.657006 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.659735 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.685076 30187 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:50.685969 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:50.686514 30187 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.691147 30107 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:50.692101 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.692785 30107 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.692795 30187 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:50.694232 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.699972 30113 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.571913 31765 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:50.680416 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.709646 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.712365 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.713195 30105 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:50.713586 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.718413 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.701093 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:50.727803 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.729502 30112 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:50.722239 30183 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:50.730144 30186 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:11:50.732281 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 251332us
I20260709 13:11:50.643630 31587 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.647435 31771 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.649348 31563 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:50.753809 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 183260us
I20260709 13:11:50.758857 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.770071 30112 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.753166 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.771185 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.772253 30112 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.765436 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.773340 30113 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.715466 31657 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.761139 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.777141 30106 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.762275 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.775184 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.715337 31653 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:50.738001 31639 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:50.821426 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 223223us
I20260709 13:11:50.798543 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.593801 31759 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.800155 31770 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:50.800277 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:50.802006 31637 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:50.839087 31653 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.820662 31639 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:11:50.844071 31671 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 13:11:50.846331 31780 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.846940 31780 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.847913 31780 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:50.852818 31729 consensus_meta.cc:287] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.004s
I20260709 13:11:50.853268 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.854017 31637 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.854422 30113 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.803586 31610 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:50.738775 31580 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:50.807053 31757 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.636162 31730 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.812435 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:50.858295 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45936.8us
I20260709 13:11:50.754209 31587 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:50.814284 31769 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:11:50.814805 31611 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:50.815145 31761 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:11:50.800210 30110 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:50.740803 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.740653 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:50.754335 31775 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 13:11:50.854775 31679 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.766867 31563 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.836905 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:50.837242 31642 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:50.860083 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:50.772791 31682 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.815905 31764 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.819964 31657 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:50.827822 31767 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.823558 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:50.861904 31646 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.816721 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.901384 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:50.874428 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:50.902673 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.776178 31352 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.861866 31770 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:50.891758 31758 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:50.898924 31759 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.835458 31760 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:50.923141 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 160945us
I20260709 13:11:50.910923 31642 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.829550 31736 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.853328 31729 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.929286 30001 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.946889 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.929348 30178 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:50.900569 30111 raft_consensus.cc:2376] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3. Re-sending same reply.
I20260709 13:11:50.954911 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:50.941987 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:50.948123 31462 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.948726 30186 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:50.958024 30107 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:50.949930 31758 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:50.950726 31637 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.909876 31764 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.933743 31642 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.964121 30109 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.972791 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.966276 30736 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:50.978775 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.946868 31756 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:50.903941 31679 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.914954 31767 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:50.993615 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.996759 30150 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:50.975421 31642 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.986459 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:50.979465 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 243643us
W20260709 13:11:50.981285 31716 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.004s
I20260709 13:11:50.991127 31611 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.990430 31610 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.987759 31637 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.964607 31763 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:11:51.035488 31771 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:51.060303 31771 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.008471 31580 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.017689 31765 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.004179 31499 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:11:51.062664 31751 log.cc:927] Time spent T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:51.151525 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.136593 31801 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 13:11:51.155166 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.029307 30740 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:50.999325 31756 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.061926 31787 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.981905 31657 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:51.171797 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 159361us
I20260709 13:11:51.173045 30038 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.173852 31462 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:51.175109 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.174986 31462 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:51.175807 30038 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:51.177590 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.179766 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.182231 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.021942 31716 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:51.170409 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 158214us
W20260709 13:11:51.186517 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 226807us
I20260709 13:11:51.192047 30001 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.196051 30001 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.221304 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.222075 30038 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:51.169816 31781 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.221913 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.185848 31757 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.239562 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.241642 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.243703 30032 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:51.244913 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.252962 31767 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.254796 30038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
I20260709 13:11:51.255574 30038 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:51.256119 30038 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.183672 31799 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:11:51.261242 30036 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:11:51.280088 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:11:51.282030 31783 log.cc:927] Time spent T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:11:51.283450 31752 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.284173 31752 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.285879 31792 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:51.286931 31752 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.288197 30036 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.219357 31775 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:11:51.286613 31792 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.230142 31730 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.264915 31757 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.268923 31637 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:51.082480 31770 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.320454 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.327667 30104 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:51.291218 31736 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:51.307386 31651 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 13:11:51.334976 30038 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.323836 31764 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.329965 31757 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:51.349375 31797 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:11:51.349455 31653 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:51.366595 31781 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.367261 31639 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.367534 31781 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.367401 31653 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.372691 31729 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.334309 31651 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.401338 31781 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.375942 31792 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.407972 30030 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:51.398917 31563 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.397768 31757 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:51.398989 31639 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:51.416183 31587 consensus_meta.cc:287] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.000s
I20260709 13:11:51.416635 31587 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.419041 31587 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.402338 31716 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:51.398908 31653 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.420035 31760 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:51.456894 31682 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.421136 31611 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:51.402323 31642 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.468158 31642 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.425304 31563 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:51.401381 31651 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.429313 31756 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.370055 30038 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.439347 31679 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.405853 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.470539 30108 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:51.479526 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.480058 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.480304 30031 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:51.481187 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.481742 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.482534 30029 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:51.486277 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.487073 30037 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:51.491364 30037 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:51.493602 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 45163us
I20260709 13:11:51.494927 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:51.497972 31563 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.498381 31563 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.498828 31563 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.500530 31421 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.512722 31666 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:51.513011 31563 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:51.517838 31666 raft_consensus.cc:1068] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:51.518729 31756 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.519335 31756 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.520869 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.521559 31519 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:51.522614 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.522392 31519 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.523350 30029 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.525262 31756 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.521663 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.526573 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.527122 31639 consensus_queue.cc:1059] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.528298 30033 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.529026 31519 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.529448 31651 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.529965 31812 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.530354 31812 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:51.530737 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.531502 31519 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.531196 31812 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.532028 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.532522 31812 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.532944 31519 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.535786 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.536484 30033 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.538926 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:51.544319 30033 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:51.546715 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:51.553589 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:51.559970 31666 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:51.561282 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.564029 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:51.581107 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 408477us
I20260709 13:11:51.585219 31785 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.589710 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.590418 30112 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
W20260709 13:11:51.591040 30150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.048s	sys 0.022s
W20260709 13:11:51.590404 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 418157us
W20260709 13:11:51.591424 30150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.048s	sys 0.023s
W20260709 13:11:51.591988 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 577298us
I20260709 13:11:51.591133 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.592728 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.593075 30106 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 2: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:51.594219 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.594964 30104 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:51.541240 30029 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:51.567492 31666 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.609056 30105 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:51.594607 30150 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:51.593102 31807 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:51.593664 31563 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.608386 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:51.617954 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.601472 31672 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.602541 31770 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:51.619022 30036 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:51.620836 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:51.604383 31666 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.608433 31639 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:51.586300 31785 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:51.683383 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44992us
I20260709 13:11:51.657876 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.704214 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.720995 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.813509 30108 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.635432 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.705344 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.814570 30106 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.813707 30109 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.818794 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:51.819447 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.818784 30109 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:51.706017 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.635313 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.752764 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:51.815850 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:51.722235 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.705708 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.746026 31799 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.824494 31815 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.824337 31799 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.618248 31421 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.823107 30036 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:51.822141 30110 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.629832 31651 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.636392 31770 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:51.830971 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 195711us
I20260709 13:11:51.807761 31666 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.893796 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:51.900460 30186 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.635800 31352 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.635983 31563 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:51.904886 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74393.7us
I20260709 13:11:51.619580 31764 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.224s
I20260709 13:11:51.769008 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:51.654310 31657 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.632642 31756 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.269s
I20260709 13:11:51.661942 31672 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.244s
I20260709 13:11:51.720559 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:51.911252 31767 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:51.766445 31757 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.833707 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:51.897562 30109 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:51.834333 31651 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:51.658433 31773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.049s
I20260709 13:11:51.658629 31803 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:51.894704 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:51.960460 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65938.4us
I20260709 13:11:51.961238 30150 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.911026 30106 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:51.825764 31793 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.830531 31421 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.619736 31807 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:51.833675 31499 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.974207 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.923623 30107 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:51.977150 30105 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:51.916707 30734 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:11:51.956197 30108 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:51.977824 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:51.978986 30108 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.979337 30105 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:51.980468 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:51.825063 31815 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.899682 31653 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.969076 30110 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:51.968920 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:51.985064 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:51.964643 31773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.017s	sys 0.055s
I20260709 13:11:51.917059 31763 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.959342 31651 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.971963 30178 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:51.926203 31758 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:51.982025 31777 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:51.975656 31499 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.955614 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:51.993788 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:51.970881 31421 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.000577 30107 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.959609 31657 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:51.983565 30734 pending_rounds.cc:85] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 2
I20260709 13:11:51.975559 31672 consensus_queue.cc:1243] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:51.984196 31563 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.948690 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:51.982823 31736 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.983093 31760 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.983094 31720 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.955093 31785 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:51.915277 31352 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.091367 31352 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:51.983325 31793 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.092304 31785 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.092904 31785 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.093648 31793 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.095425 31785 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:52.098101 31812 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.002s
W20260709 13:11:52.031749 31820 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:52.031574 31807 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.033003 31799 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:52.033913 31817 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:11:52.034791 31814 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:11:52.035133 31774 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.037547 31815 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.059675 31770 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.009169 31763 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.020118 31499 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.016467 31758 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:51.987557 31803 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.068992 31764 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.926578 31724 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:11:51.969310 31767 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.080919 30109 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.088348 30186 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:51.969602 31757 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.013919 31777 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.028393 30734 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:11:52.157766 30734 raft_consensus.cc:2917] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:52.158303 30734 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.158650 30734 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 2.4
I20260709 13:11:52.158903 30734 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.160440 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.062845 30738 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.162215 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.163432 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.164830 30738 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:11:52.165148 30738 pending_rounds.cc:85] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 2
I20260709 13:11:52.108664 30030 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:11:51.991040 31653 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.132278 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 147301us
I20260709 13:11:52.165778 31777 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.166079 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:52.167166 31653 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.168062 31760 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:52.168491 31760 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.168809 31760 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.170219 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.173096 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.173725 30179 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 1.
I20260709 13:11:52.173796 30180 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:52.141309 31755 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.141834 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.142602 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.146677 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.148638 31758 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.186206 30037 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.179589 30109 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
W20260709 13:11:52.176081 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.161077 30734 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:52.174903 30739 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.165338 30738 pending_rounds.cc:107] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:11:52.203924 30738 raft_consensus.cc:2917] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:52.204514 30738 raft_consensus.cc:2889] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.175588 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.175588 31755 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:52.220389 30180 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:52.235438 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.236290 30180 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:52.218856 31799 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:11:52.241175 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 225793us
I20260709 13:11:52.211141 31758 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:52.214383 31793 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:11:52.198422 31657 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.265477 31828 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:11:52.267782 31757 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.245903 31799 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.271178 31799 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.245756 31755 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:52.274875 31755 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.276041 31651 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.276620 31803 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.278577 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.243101 31831 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:11:52.280153 31831 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.280531 31831 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:52.257731 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:52.285012 30180 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:52.295125 31421 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.297292 30183 raft_consensus.cc:2368] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3.
I20260709 13:11:52.297197 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.303382 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.304358 30033 raft_consensus.cc:2368] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:52.255205 31763 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.242089 31780 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:11:52.241972 31666 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.325471 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 67858.3us
I20260709 13:11:52.281317 31831 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.336229 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.330166 30151 leader_election.cc:400] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:52.339249 30151 leader_election.cc:403] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.340276 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.352620 31831 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.330066 31717 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.358212 31717 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:52.359287 31717 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.360184 31651 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.362003 31760 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.364477 31760 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:52.384308 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.367627 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.362047 31736 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.364952 30739 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:11:52.376320 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.406879 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:52.412221 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 507890us
I20260709 13:11:52.414481 30179 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:52.416816 30705 leader_election.cc:400] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3.
I20260709 13:11:52.417196 30705 leader_election.cc:403] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.422360 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:52.423578 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:52.424621 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:52.425724 31763 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.426261 31763 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.427155 31611 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:52.427726 31611 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:52.428805 31611 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.430483 31611 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.431023 31760 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.432832 31795 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:52.433208 31462 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:52.433737 31462 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.434796 31795 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:52.432893 31771 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.435962 31771 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.436580 31795 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:52.436857 31771 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.438719 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:52.439957 31352 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.427183 31763 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.442371 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.444130 31793 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:52.444317 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.444716 31793 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.440472 31352 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.444159 31587 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.445645 31793 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.445988 31352 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.446833 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.446954 31352 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.447562 31816 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.448005 31816 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.434581 31462 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.448761 31816 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.449726 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.451287 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:52.451606 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 145999us
I20260709 13:11:52.452696 30032 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:11:52.453107 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:52.454041 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:52.448820 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.454600 30032 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.459908 31760 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:52.460758 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.467985 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:52.469317 30037 raft_consensus.cc:2368] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4.
I20260709 13:11:52.475946 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.476787 30180 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:52.399379 31799 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.478051 30182 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
W20260709 13:11:52.478808 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59190.4us
I20260709 13:11:52.483773 30004 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:52.485860 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:52.482072 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:52.493592 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:52.494542 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:52.497350 30032 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:52.414444 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.495437 31352 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.419298 31767 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:52.477164 31679 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.502225 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.475317 31519 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:52.543272 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 49769.4us
I20260709 13:11:52.493372 31758 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:52.543813 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48671.9us
I20260709 13:11:52.495820 31795 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.543130 31780 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.505229 31352 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.556769 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.557595 30179 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:52.488818 31799 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.547792 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.549430 31807 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:52.554026 31736 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.544409 31812 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:52.507258 31499 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:52.599866 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.603404 30179 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:52.555253 31795 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:52.609117 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.609527 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48829.1us
I20260709 13:11:52.576613 31651 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.549945 31519 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.606840 31830 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:52.622040 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.637434 30181 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:52.625939 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.638788 30187 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.576152 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.641795 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.621732 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.643365 30186 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:52.579667 31639 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:52.556762 31352 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.644299 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 149854us
W20260709 13:11:52.649863 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.652413 30736 raft_consensus.cc:2368] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:52.655795 31653 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.656402 31653 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.658665 31653 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.661789 31795 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:52.664126 31842 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:52.669004 31421 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.670179 30180 raft_consensus.cc:2410] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:52.676606 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:52.677323 30032 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.602758 31736 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.604764 31812 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:52.679535 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.669248 31563 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.000s
I20260709 13:11:52.696780 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.722836 30187 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
W20260709 13:11:52.695230 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63781.4us
I20260709 13:11:52.727907 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.728952 30179 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.729732 30705 leader_election.cc:400] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4.
I20260709 13:11:52.729970 30183 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.730114 30705 leader_election.cc:403] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.731043 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.732287 30183 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.732702 30187 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:52.734046 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.735131 30153 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:52.736145 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:52.736145 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:52.744596 30183 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:52.746474 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.747329 30183 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:52.675606 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43022 (request call id 498) took 1109 ms. Trace:
I20260709 13:11:52.636552 31651 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.760236 30186 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.761412 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.761940 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.763224 30183 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:52.763962 30185 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:52.685777 31666 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:52.793882 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.794730 31816 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:52.799943 31777 consensus_meta.cc:287] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.634s	user 0.001s	sys 0.008s
I20260709 13:11:52.800416 31777 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.744164 31563 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:52.805936 30182 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:52.766013 30032 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:52.767738 30185 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
W20260709 13:11:52.761464 31717 raft_consensus.cc:2771] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: Leader pre-election decision while not in active config. Result: Term 4: won. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:52.774279 31651 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.775265 31352 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.775898 30734 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.778906 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.743144 31767 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.686498 31587 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:52.783351 30179 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:52.852677 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.784308 31499 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.856033 30179 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:52.787281 30186 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:52.790535 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1588) took 1084 ms. Trace:
I20260709 13:11:52.750353 31804 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4.
I20260709 13:11:52.791956 31799 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:52.778517 31519 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.778492 31679 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3.
I20260709 13:11:52.672889 31639 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.869024 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.870301 31639 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.816380 30185 pending_rounds.cc:85] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 2
I20260709 13:11:52.853360 31767 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.871085 30185 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:11:52.871519 30185 raft_consensus.cc:2917] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:52.872082 30185 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.872617 30185 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 2.4
I20260709 13:11:52.872790 31767 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:52.872956 30185 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.819772 30187 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:52.759543 31672 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.813457 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:52.879220 30182 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:52.865525 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.887991 30739 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:52.888245 30179 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:11:52.888953 30179 pending_rounds.cc:85] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 2
I20260709 13:11:52.889433 30179 pending_rounds.cc:107] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:52.890152 30179 raft_consensus.cc:2889] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.841030 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:52.843909 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:52.892725 30185 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:11:52.894971 30106 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.895310 30185 pending_rounds.cc:85] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 2
I20260709 13:11:52.844204 30180 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:52.895828 30185 pending_rounds.cc:107] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:11:52.809240 31812 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:52.857610 30113 rpcz_store.cc:276] 0709 13:11:51.705954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.822989 (+117035us) service_pool.cc:224] Handling call
0709 13:11:51.823315 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.893422 (+ 70107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.894474 (+  1052us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.923257 (+ 28783us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.194291 (+271034us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:52.205353 (+ 11062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.205497 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.790296 (+584799us) raft_consensus.cc:1685] finished
0709 13:11:52.790317 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.790469 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10482,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":8533,"thread_start_us":234883,"threads_started":1,"wal-append.queue_time_us":460079}
I20260709 13:11:52.892562 30184 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:52.845685 31563 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.866966 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:52.910300 30185 raft_consensus.cc:2917] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:11:52.911090 30185 raft_consensus.cc:2889] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.911724 30187 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:52.921869 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:52.759267 30736 rpcz_store.cc:276] 0709 13:11:51.566413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.567415 (+  1002us) service_pool.cc:224] Handling call
0709 13:11:51.912239 (+344824us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:11:52.672272 (+760033us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400681354. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:52.675510 (+  3238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435960320}
W20260709 13:11:52.927664 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.855635 31587 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.887085 30178 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:52.958936 30079 leader_election.cc:400] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
I20260709 13:11:52.959319 30079 leader_election.cc:403] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:52.960750 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.927929 30106 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:11:52.962078 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:52.921212 31763 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:52.940357 30732 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:52.920238 31563 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.957238 31352 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.923923 31812 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:52.983469 31587 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:52.984536 31849 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:52.985083 31849 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:52.986111 31672 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.986089 31849 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:52.986841 31672 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:52.987715 31849 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.973645 31666 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4.
W20260709 13:11:52.990198 31851 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:11:52.992825 31777 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:52.995067 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.001852 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.005789 31736 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:52.966634 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:52.930044 31848 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:11:52.972836 31462 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.962988 31757 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:52.960464 31795 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:11:52.978905 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.012923 30109 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:52.980665 30037 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:53.014650 30112 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:53.010138 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:53.015201 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.973081 31780 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:11:53.013942 30741 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:53.012174 30182 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
W20260709 13:11:53.017131 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 50590.5us
I20260709 13:11:53.017715 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.018304 30112 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:53.018729 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.018985 31758 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.019663 31758 consensus_queue.cc:1059] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:53.020433 31758 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:53.020979 31836 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:53.010670 30106 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:53.022066 31587 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.022758 31836 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:53.022850 31587 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.023237 31836 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:53.024093 31836 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.024578 31587 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.026031 31758 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:53.027719 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.037992 30109 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:53.028940 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.029659 30106 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:53.032126 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.033080 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.042403 30105 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:53.032044 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:53.057837 30113 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.059271 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:53.034996 31836 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.061640 30030 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.036726 31758 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:53.063885 31666 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:53.068863 31519 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:53.106755 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:53.077219 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:53.080096 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:53.088021 30077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.590s (SENT) [suppressed 28 similar messages]
I20260709 13:11:53.078423 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:53.111802 30183 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:11:53.085225 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:53.114249 30182 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:53.092736 31666 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.115950 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:53.119710 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.125082 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.130303 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:53.147380 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:53.113245 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:53.160776 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44945us
I20260709 13:11:53.119221 31666 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.161963 30108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:53.117061 31519 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:53.129132 31462 raft_consensus.cc:2764] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:11:53.163426 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 142811us
I20260709 13:11:53.145805 31780 raft_consensus.cc:1064] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:53.132459 31639 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.101613 31848 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:11:53.170610 30108 raft_consensus.cc:606] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:53.171504 30108 raft_consensus.cc:614] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.126528 31758 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.166081 30178 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:53.180445 31519 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:53.202339 31863 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:53.127862 31816 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:53.181253 30105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:53.210369 30105 raft_consensus.cc:606] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.210750 30105 raft_consensus.cc:614] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.143515 31793 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:11:53.193657 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68725.9us
I20260709 13:11:53.196074 31795 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:53.179682 31864 log.cc:927] Time spent T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:53.163341 31862 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.194662 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:53.181146 31859 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:53.167596 31679 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:53.250110 31679 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:53.173367 31639 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.219316 31462 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:11:53.233958 31653 consensus_queue.cc:1059] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:53.174301 31815 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:53.237637 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.261659 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.174126 31869 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:53.249258 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54679us
I20260709 13:11:53.250490 30178 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:53.245949 31758 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.262562 31679 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:53.277349 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.279830 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:53.280892 30185 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 2: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:53.258196 31587 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:53.285516 31587 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.237255 31563 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:53.287329 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:53.287918 30185 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:53.285991 31587 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:53.289929 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45673.5us
I20260709 13:11:53.292287 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.257652 31736 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.296926 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.297376 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.300643 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.302008 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.305935 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.306640 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.276674 31868 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:53.298657 31736 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.311548 31868 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.313941 31868 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.314496 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.317044 30186 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.318070 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:53.320570 31862 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:53.320966 30184 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:53.313103 31736 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:53.326189 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:53.303812 31754 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.308753 31653 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.331511 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:53.325121 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 176198us
I20260709 13:11:53.337306 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.321448 31519 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.321166 31862 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.340646 31755 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.342434 31763 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:53.347234 31877 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:11:53.359155 30036 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:53.365386 31639 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.356981 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:53.373764 31836 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:53.321159 31868 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:53.339177 31861 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:53.325166 31666 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.324209 31876 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:11:53.364464 31862 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.363327 31763 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:53.380877 31816 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:11:53.391516 31861 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:53.415107 31861 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.417582 31869 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.419734 31763 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.420899 31763 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.421041 31849 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.423172 31815 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.357190 31848 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:53.434115 30151 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:53.434373 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 102993us
I20260709 13:11:53.446390 31875 raft_consensus.cc:3055] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:53.418156 31869 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.463454 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:53.466470 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.389492 31717 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:11:53.461068 31875 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:53.490598 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:53.497776 30034 raft_consensus.cc:606] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.498173 30034 raft_consensus.cc:614] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.483214 31736 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:53.457867 31849 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.482241 31812 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:53.461678 31815 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:53.502380 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.509272 31875 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.506007 31876 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:53.517027 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 73653.2us
I20260709 13:11:53.487324 31856 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:11:53.505601 31812 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:53.536609 31666 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.539251 31868 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:53.508399 31736 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:53.546645 31812 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.549762 31868 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.562786 31777 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:53.568111 31878 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:11:53.562856 31868 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.594002 31869 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.614231 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:53.641958 31849 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.650738 31836 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:53.650315 31736 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.651515 31812 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.652264 31836 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.652769 31836 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.638334 31869 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:11:53.654661 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.665506 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 198514us
I20260709 13:11:53.640956 31519 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:53.654297 31812 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:53.671003 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 118465us
I20260709 13:11:53.662004 31815 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.676651 31816 raft_consensus.cc:1064] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:53.651590 31861 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.677632 31657 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.743321 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:11:53.744139 30034 raft_consensus.cc:606] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:53.744517 30034 raft_consensus.cc:614] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:53.731426 31812 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:53.736809 31519 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.746031 31816 raft_consensus.cc:1068] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:53.746533 31754 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.751952 31657 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:53.757151 31812 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:53.781546 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 197755us
W20260709 13:11:53.794273 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.798323 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.799171 31902 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.801712 31902 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.802515 31903 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.805626 31913 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:53.805938 31903 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.806242 31913 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.808102 31903 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.797544 31754 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:53.808461 31861 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.808887 31754 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:53.809340 31836 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.811064 31754 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.813730 31899 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:53.756945 31519 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:53.814684 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 348296us
I20260709 13:11:53.814602 31899 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.815608 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:53.816634 31519 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.818499 31902 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.821007 30112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:53.821691 30112 raft_consensus.cc:606] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:11:53.831862 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.832881 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.833060 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.834477 30113 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.835633 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.838270 30105 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:53.839977 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.841183 30113 raft_consensus.cc:2368] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:53.842381 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.844144 30108 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:53.846814 30108 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.848258 31899 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:53.848927 31899 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.849431 31899 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.850461 31657 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.852488 31913 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.849296 31812 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:53.853592 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:53.854980 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:53.861166 31587 consensus_meta.cc:287] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.010s
I20260709 13:11:53.861644 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:53.861940 31862 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.863646 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.864351 30104 raft_consensus.cc:2376] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4. Re-sending same reply.
I20260709 13:11:53.864543 31862 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.830448 31861 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.869163 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.846037 31653 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:53.873200 30105 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:53.879410 30113 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.883688 30106 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:11:53.861979 31587 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.885908 30032 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:53.877907 31861 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.887331 31672 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:53.882318 31908 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.877590 31653 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.889019 31653 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.888675 31908 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.891286 31908 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.892843 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.893841 30108 raft_consensus.cc:2368] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:53.894461 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.901541 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.901888 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:53.903326 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.904224 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.906198 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:53.883924 31758 consensus_meta.cc:287] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.593s	user 0.018s	sys 0.007s
W20260709 13:11:53.908267 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.912827 30113 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:53.908396 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.913923 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:53.914860 30113 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:53.910002 30106 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.937023 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:53.940394 30106 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:53.907245 31862 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.942910 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.945354 31877 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:53.945334 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 278313us
I20260709 13:11:53.950615 31763 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:53.951432 31763 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.946343 31877 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:53.958158 31899 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:53.958600 31763 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.948354 31862 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:53.963773 31587 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:53.982245 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 43517us
I20260709 13:11:53.988205 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:53.989344 30030 raft_consensus.cc:2410] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:53.992725 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.993290 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.994489 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.997077 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.997620 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:53.997781 30033 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:53.998322 30038 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:53.975978 31862 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:53.980748 31920 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:11:53.984417 31899 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:53.998816 31672 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:54.017990 31672 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:54.004791 31587 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.017993 31780 raft_consensus.cc:1068] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:54.033686 31877 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:54.035046 31587 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:54.036229 31899 consensus_queue.cc:1243] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:54.036746 31899 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.037050 31899 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:54.037863 31899 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:54.039022 31899 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.040019 31875 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.051555 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:54.051892 31653 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:54.052652 31921 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:54.053076 31921 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:54.053457 31921 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.054661 31587 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:54.021193 31672 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:54.062044 31653 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:54.066054 30032 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.069422 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.070101 30187 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:54.077852 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.078723 30186 raft_consensus.cc:2376] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3. Re-sending same reply.
W20260709 13:11:54.084754 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.090224 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:54.091037 30183 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.098923 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:54.099701 30030 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.105217 30180 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:54.108870 30187 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:54.110337 30187 pending_rounds.cc:85] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 1
I20260709 13:11:54.111070 30187 pending_rounds.cc:107] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:54.111615 30187 raft_consensus.cc:2889] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.112725 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.113453 30029 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:54.113595 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:54.115262 31736 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.115653 30178 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.118120 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.120462 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:54.121501 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63717.2us
W20260709 13:11:54.121946 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.123364 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:54.125207 31918 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.125628 31918 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.125957 31918 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.131680 31861 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:54.135095 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.136512 30036 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:54.143272 30110 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:54.146270 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:54.148130 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.152033 31815 raft_consensus.cc:1064] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:54.164004 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:54.201148 30180 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.192956 30030 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:54.215454 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:54.222663 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.224640 30181 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:54.225243 30181 pending_rounds.cc:85] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 1
I20260709 13:11:54.225589 30181 pending_rounds.cc:107] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:54.225915 30181 raft_consensus.cc:2889] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.225262 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.233282 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.235368 30185 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:54.240309 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.246698 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.249312 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:54.249799 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.245860 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.244164 31908 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:54.250739 30150 leader_election.cc:400] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
W20260709 13:11:54.240944 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.247691 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.177431 31736 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.273653 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.257820 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.270515 30150 leader_election.cc:403] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:54.271559 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.273494 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:54.223491 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:54.273793 30038 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.273830 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.292191 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:54.293707 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:54.293977 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:54.296648 30183 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:54.298429 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:54.304060 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.307329 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:54.309373 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:54.309535 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:54.313130 31899 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.313894 31916 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.315994 30038 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:54.318495 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.316227 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.319553 30183 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:54.319074 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:54.317648 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:54.281997 31908 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:54.376288 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.320350 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:54.419062 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.601240 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.321089 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.301553 31913 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
W20260709 13:11:54.329560 31932 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:54.290488 31736 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:54.689966 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.792507 31736 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:54.792685 30181 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:54.794732 30185 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:54.819943 31736 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:54.822561 31736 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:11:54.789328 30034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.018s
I20260709 13:11:54.784791 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:54.785588 30113 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:54.786151 30107 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:54.933709 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.330766 31875 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.308908 31653 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.308535 31777 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.329099 31916 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.310504 31890 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:54.794952 31913 raft_consensus.cc:3055] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.825428 31666 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:54.958200 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:54.959980 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:54.823494 31771 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.783622 30183 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:54.827692 30184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.024s	sys 0.029s
W20260709 13:11:54.975708 30184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.024s	sys 0.029s
W20260709 13:11:54.819643 31918 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.693s	user 0.016s	sys 0.000s
W20260709 13:11:54.982304 30705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.019s	sys 0.024s
I20260709 13:11:54.936393 31893 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.982813 30705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.019s	sys 0.024s
I20260709 13:11:54.937229 31916 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:54.824800 31862 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:11:54.951314 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 166618us
I20260709 13:11:54.953605 31913 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:54.825966 31886 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:54.976616 30107 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:54.950398 31811 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:54.794194 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:55.026947 30111 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.806191 31908 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:54.997854 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 773286us
W20260709 13:11:54.935464 30034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.018s
I20260709 13:11:54.999711 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:55.039757 30113 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:55.040813 30704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.019s	sys 0.056s
I20260709 13:11:54.955068 31861 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.004007 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:55.049015 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 45100.4us
I20260709 13:11:55.050033 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:54.843230 31921 consensus_meta.cc:287] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.789s	user 0.014s	sys 0.000s
I20260709 13:11:54.955827 31890 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:54.395542 31815 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.017906 31886 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.024775 31811 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.004788 31916 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:55.046581 30704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.020s	sys 0.056s
I20260709 13:11:54.975935 31666 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:54.955274 31653 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:54.977461 31902 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:54.993662 30183 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:55.058501 30104 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.983567 31771 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:55.064035 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.020s	sys 0.081s
W20260709 13:11:55.069720 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.020s	sys 0.081s
W20260709 13:11:55.070144 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 756382us
I20260709 13:11:54.997124 31918 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:55.065346 30153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.010s	sys 0.028s
I20260709 13:11:55.019235 31862 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.055456 31875 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:55.074975 30038 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:11:55.075958 30182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.008s	sys 0.034s
W20260709 13:11:55.076651 30182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.008s	sys 0.034s
I20260709 13:11:55.078109 30104 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:55.001292 31893 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.065994 31861 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:55.064663 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 850461us
I20260709 13:11:55.066964 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 242) took 1138 ms. Trace:
I20260709 13:11:55.071797 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:55.071811 30153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.011s	sys 0.028s
I20260709 13:11:55.081841 30034 rpcz_store.cc:276] 0709 13:11:53.919895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.921181 (+  1286us) service_pool.cc:224] Handling call
0709 13:11:53.921701 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.922178 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.922225 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:53.922797 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.245006 (+322209us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18001cdf80. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:11:55.039566 (+794560us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:55.040372 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.040471 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.040532 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:55.040550 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.056937 (+ 16387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8037,"spinlock_wait_cycles":23372160,"thread_start_us":794320,"threads_started":1,"wal-append.queue_time_us":867105}
I20260709 13:11:55.082094 30037 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:55.086869 30180 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:55.055856 31921 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.072463 31908 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.133852 31908 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.067368 31913 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.056090 31736 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.143141 31893 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:55.146427 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1610) took 1060 ms. Trace:
I20260709 13:11:55.146992 30184 rpcz_store.cc:276] 0709 13:11:54.086388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.086668 (+   280us) service_pool.cc:224] Handling call
0709 13:11:54.087108 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.100940 (+ 13832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.100972 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.154089 (+ 53117us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.976193 (+822104us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.001941 (+ 25748us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.016516 (+ 14575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.016597 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.146135 (+129538us) raft_consensus.cc:1685] finished
0709 13:11:55.146164 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.146347 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24575,"prepare.queue_time_us":25151,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2520,"raft.queue_time_us":31837,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":68089,"thread_start_us":743755,"threads_started":1,"wal-append.queue_time_us":855416}
I20260709 13:11:55.159281 31771 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:55.161875 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.162880 31767 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:55.163823 31777 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:55.163574 31767 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:55.164361 31777 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.168027 31886 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:55.170310 31653 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:55.102497 30187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.007s	sys 0.072s
W20260709 13:11:55.178401 30187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.009s	sys 0.072s
I20260709 13:11:55.137065 31908 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:55.197328 30186 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:55.070840 31902 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.119415 31943 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.128623 31849 raft_consensus.cc:1064] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:55.125159 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:55.129999 31862 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:55.088071 31875 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:11:55.189297 31944 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.128790 31666 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:55.199751 31918 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:55.191046 31771 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.206418 30179 raft_consensus.cc:2410] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:55.206808 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:55.205526 31849 raft_consensus.cc:1068] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:55.239261 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1619) took 1091 ms. Trace:
I20260709 13:11:55.240356 30179 rpcz_store.cc:276] 0709 13:11:54.147741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.165432 (+ 17691us) service_pool.cc:224] Handling call
0709 13:11:55.124893 (+959461us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5800003f98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:11:55.239180 (+114287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9592576}
I20260709 13:11:55.216696 31771 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.242396 30179 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:55.243134 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 201) took 1041 ms. Trace:
I20260709 13:11:55.243494 30179 rpcz_store.cc:276] 0709 13:11:54.201668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.241608 (+1039940us) service_pool.cc:224] Handling call
0709 13:11:55.242003 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.242828 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.243069 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:55.243933 31771 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:55.245144 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 202) took 1025 ms. Trace:
I20260709 13:11:55.245941 30179 rpcz_store.cc:276] 0709 13:11:54.219579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.244249 (+1024670us) service_pool.cc:224] Handling call
0709 13:11:55.244595 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.244767 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.244793 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.244833 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:55.244859 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.244928 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.245082 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:55.263206 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.270428 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:55.271077 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.274022 31736 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:55.275729 31736 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.276885 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1743) took 1082 ms. Trace:
I20260709 13:11:55.287370 30184 rpcz_store.cc:276] 0709 13:11:54.194509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.187349 (+992840us) service_pool.cc:224] Handling call
0709 13:11:55.188523 (+  1174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.188736 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:55.212196 (+ 23460us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.276574 (+ 64378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.276622 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.276660 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.276717 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.276829 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6822,"prepare.queue_time_us":48494,"thread_start_us":64066,"threads_started":1}
I20260709 13:11:55.282559 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1739) took 1089 ms. Trace:
I20260709 13:11:55.292344 30187 rpcz_store.cc:276] 0709 13:11:54.193264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.236295 (+ 43031us) service_pool.cc:224] Handling call
0709 13:11:54.236707 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.236946 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:55.179108 (+942162us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.282120 (+103012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.282195 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.282243 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.282327 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.282487 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":431866,"prepare.run_cpu_time_us":4213,"prepare.run_wall_time_us":52307,"thread_start_us":1044258,"threads_started":2}
I20260709 13:11:55.295727 31736 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:55.283993 30150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.011s	sys 0.008s
W20260709 13:11:55.334250 30150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.008s
W20260709 13:11:55.334925 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 1.01586e+06us
W20260709 13:11:55.338891 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.206241 31943 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.260653 31849 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.263052 31777 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:55.262434 31767 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:55.337888 31908 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.337378 31771 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.337213 31918 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:55.210819 31944 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.343091 31893 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.345369 31890 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:55.351974 31736 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.356910 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:55.477617 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1741) took 1283 ms. Trace:
I20260709 13:11:55.478159 30183 rpcz_store.cc:276] 0709 13:11:54.193810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.071159 (+877349us) service_pool.cc:224] Handling call
0709 13:11:55.083441 (+ 12282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.083663 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:55.194367 (+110704us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.476796 (+282429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.476866 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.476929 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.477025 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.477542 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107989,"prepare.queue_time_us":90739,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"thread_start_us":178990,"threads_started":1}
W20260709 13:11:55.504798 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 168765us
I20260709 13:11:55.506256 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:55.361660 31811 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:55.521531 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 251211us
I20260709 13:11:55.368431 31947 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.474567 31639 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:55.486008 31499 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:55.557046 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:55.560155 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.515380 31945 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:55.365222 31849 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.475813 31771 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.391232 31908 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:55.573683 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51596.7us
I20260709 13:11:55.534838 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1627) took 1234 ms. Trace:
I20260709 13:11:55.475361 31918 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.516426 31893 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:55.568066 30077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.019s	sys 0.002s
I20260709 13:11:55.552656 31921 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:55.559176 31957 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.713907 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:55.714370 30077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.032s	sys 0.002s
W20260709 13:11:55.714775 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 658359us
I20260709 13:11:55.571904 31499 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.713521 30108 rpcz_store.cc:276] 0709 13:11:54.300128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.534010 (+1233882us) service_pool.cc:224] Handling call
0709 13:11:55.534323 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.534507 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.534530 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.534570 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.534601 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.534649 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.534780 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:55.716125 30150 leader_election.cc:400] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
I20260709 13:11:55.715811 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:11:55.785218 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 70066.4us
I20260709 13:11:55.786235 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:11:55.792049 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.797060 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 81324.8us
I20260709 13:11:55.688645 31895 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:55.799378 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 277208us
I20260709 13:11:55.804013 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:55.562811 31639 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:55.783113 31961 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:11:55.844805 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 314361us
I20260709 13:11:55.548700 31947 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.869660 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1748) took 1631 ms. Trace:
I20260709 13:11:55.889231 30184 rpcz_store.cc:276] 0709 13:11:54.238205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.288675 (+1050470us) service_pool.cc:224] Handling call
0709 13:11:55.288978 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.289178 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:55.289486 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.869144 (+579658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.869222 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.869284 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.869377 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.869579 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31249,"prepare.queue_time_us":69408,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":579182,"threads_started":2}
W20260709 13:11:55.900447 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 102060us
I20260709 13:11:55.901541 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:11:55.906946 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1756) took 1661 ms. Trace:
I20260709 13:11:55.907475 30184 rpcz_store.cc:276] 0709 13:11:54.245475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.906007 (+1660532us) service_pool.cc:224] Handling call
0709 13:11:55.906365 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.906559 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.906582 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.906624 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.906662 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.906735 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.906867 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:55.783716 31902 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:55.796159 31666 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.914413 31954 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:55.953593 31954 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.954114 31954 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.882342 31976 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.801556 31957 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:55.934685 31948 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.945618 31902 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:56.003328 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 101923us
W20260709 13:11:55.994524 31949 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
W20260709 13:11:56.007526 30110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1058) took 2166 ms (client timeout 2224 ms). Trace:
I20260709 13:11:55.988723 31890 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:55.945314 31666 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:55.994911 31964 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:56.017295 30110 rpcz_store.cc:269] 0709 13:11:53.832157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.835257 (+  3100us) service_pool.cc:224] Handling call
0709 13:11:55.998641 (+2163384us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000a1c54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:55.998804 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645828352}
I20260709 13:11:55.843587 31895 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:56.055742 31890 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.000324 31950 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.818408 31945 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.063534 30077 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:56.065371 30105 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:56.089380 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1633) took 1783 ms. Trace:
I20260709 13:11:56.018221 31777 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:56.017655 31952 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:11:56.087199 30110 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:56.094959 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1635) took 1788 ms. Trace:
I20260709 13:11:56.095381 30110 rpcz_store.cc:276] 0709 13:11:54.306249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.086687 (+1780438us) service_pool.cc:224] Handling call
0709 13:11:56.087019 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.094668 (+  7649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.094882 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.096829 30110 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.098434 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1636) took 1792 ms. Trace:
I20260709 13:11:56.099262 30110 rpcz_store.cc:276] 0709 13:11:54.306662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.096280 (+1789618us) service_pool.cc:224] Handling call
0709 13:11:56.096622 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.097187 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.098366 (+  1179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.089864 30105 rpcz_store.cc:276] 0709 13:11:54.305696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.012823 (+1707127us) service_pool.cc:224] Handling call
0709 13:11:56.065006 (+ 52183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.089034 (+ 24028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.089311 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.021466 31944 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:56.072643 31815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.001s	sys 0.005s
I20260709 13:11:56.144915 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1757) took 1899 ms. Trace:
W20260709 13:11:56.159365 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 355555us
I20260709 13:11:56.192183 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:56.013636 31902 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:56.167171 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 142329us
I20260709 13:11:56.191720 30184 rpcz_store.cc:276] 0709 13:11:54.245800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.908618 (+1662818us) service_pool.cc:224] Handling call
0709 13:11:55.909005 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.909255 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:55.946598 (+ 37343us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.144358 (+197760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.144445 (+    87us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:56.144516 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.144631 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.144825 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67064,"prepare.queue_time_us":37616,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2379,"thread_start_us":130053,"threads_started":1}
I20260709 13:11:56.005008 31948 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.238981 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:56.159294 31815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.001s	sys 0.006s
I20260709 13:11:56.097085 31965 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:56.173156 31960 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
W20260709 13:11:56.270352 31967 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:11:56.270905 31975 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:11:56.271363 31972 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:56.271629 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1749) took 2033 ms. Trace:
W20260709 13:11:56.272361 31953 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:11:56.158880 31836 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:11:56.240623 31942 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.668s	user 0.000s	sys 0.001s
I20260709 13:11:56.272017 30187 rpcz_store.cc:276] 0709 13:11:54.238465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.293730 (+1055265us) service_pool.cc:224] Handling call
0709 13:11:55.294083 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.294378 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.294403 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.294917 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.520139 (+225222us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:55.520196 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.520279 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.271435 (+751156us) raft_consensus.cc:1685] finished
0709 13:11:56.271455 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.271575 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182328,"spinlock_wait_cycles":20744576,"thread_start_us":224797,"threads_started":1,"wal-append.queue_time_us":703461}
I20260709 13:11:56.242161 31950 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:56.221984 31499 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.086941 31964 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:56.316220 31956 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260709 13:11:56.318778 31948 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.320933 31895 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.321707 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1740) took 2128 ms. Trace:
I20260709 13:11:56.292385 31968 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:11:56.293608 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.293989 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 101900us
I20260709 13:11:56.163005 31985 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.301144 31987 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.303936 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1617) took 1991 ms. Trace:
I20260709 13:11:56.307976 31982 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.310595 31979 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:56.326100 31959 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.406s	user 0.000s	sys 0.002s
I20260709 13:11:56.322265 31666 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.327827 31945 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.277516 31908 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.286619 31639 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.284789 31944 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.356503 31986 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:56.357223 31955 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:11:56.358085 31834 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:56.361060 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:56.351593 30109 rpcz_store.cc:276] 0709 13:11:54.297466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.034759 (+737293us) service_pool.cc:224] Handling call
0709 13:11:55.035053 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.035364 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.035395 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.035847 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.291663 (+255816us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.291712 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.291791 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.288765 (+996974us) raft_consensus.cc:1685] finished
0709 13:11:56.288798 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.288980 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1587,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"thread_start_us":255407,"threads_started":1,"wal-append.queue_time_us":496247}
I20260709 13:11:56.303287 31771 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:56.368497 30185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1746) took 2137 ms (client timeout 2279 ms). Trace:
I20260709 13:11:56.371645 31970 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:11:56.375506 30179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.028s	sys 0.042s
I20260709 13:11:56.333271 31893 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:56.389125 30185 rpcz_store.cc:269] 0709 13:11:54.233972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.317093 (+ 83121us) service_pool.cc:224] Handling call
0709 13:11:56.368245 (+2051152us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003b1d54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:56.368421 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441946880}
I20260709 13:11:56.414251 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1611) took 2318 ms. Trace:
I20260709 13:11:56.414813 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:56.414669 30182 rpcz_store.cc:276] 0709 13:11:54.088038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.088204 (+   166us) service_pool.cc:224] Handling call
0709 13:11:54.088716 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.088986 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.089026 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.101313 (+ 12287us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.077194 (+975881us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:55.077278 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.077345 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.405706 (+1328361us) raft_consensus.cc:1685] finished
0709 13:11:56.405729 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.405855 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":864387,"threads_started":1,"wal-append.queue_time_us":1332023}
I20260709 13:11:56.407372 31904 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:56.304976 31836 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.411303 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:56.271988 31972 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.416842 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:56.386323 31944 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.384166 31987 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.339634 31968 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.386734 31982 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.383327 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 210) took 2242 ms. Trace:
W20260709 13:11:56.386370 30076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.013s	sys 0.056s
I20260709 13:11:56.557447 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1616) took 2259 ms. Trace:
W20260709 13:11:56.576398 30076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.015s	sys 0.056s
W20260709 13:11:56.417939 30179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.035s	sys 0.045s
W20260709 13:11:56.560137 30003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.014s	sys 0.022s
W20260709 13:11:56.579885 30003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.015s	sys 0.023s
W20260709 13:11:56.565203 30183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.019s	sys 0.111s
W20260709 13:11:56.582410 30183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.020s	sys 0.112s
W20260709 13:11:56.582561 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.583220 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.565703 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1619) took 2267 ms. Trace:
I20260709 13:11:56.584290 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1751) took 2345 ms. Trace:
I20260709 13:11:56.560602 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1623) took 2261 ms. Trace:
W20260709 13:11:56.566385 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 347290us
I20260709 13:11:56.322108 30178 rpcz_store.cc:276] 0709 13:11:54.193549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.593952 (+400403us) service_pool.cc:224] Handling call
0709 13:11:54.812421 (+218469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.954606 (+142185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.957365 (+  2759us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.051769 (+ 94404us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.473623 (+421854us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.485225 (+ 11602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.485456 (+   231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.321466 (+836010us) raft_consensus.cc:1685] finished
0709 13:11:56.321496 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.321646 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":19181,"thread_start_us":398047,"threads_started":1,"wal-append.queue_time_us":507970}
I20260709 13:11:56.584892 30183 rpcz_store.cc:276] 0709 13:11:54.238981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.516726 (+1277745us) service_pool.cc:224] Handling call
0709 13:11:55.517080 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.517315 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:55.799756 (+282441us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.583324 (+783568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.583649 (+   325us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:56.583783 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.583903 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.584164 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159955,"prepare.queue_time_us":286668,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":782806,"threads_started":1}
I20260709 13:11:56.576212 30111 rpcz_store.cc:276] 0709 13:11:54.297201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.027761 (+730560us) service_pool.cc:224] Handling call
0709 13:11:55.028078 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.028461 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.028495 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.029049 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.370210 (+341161us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.396370 (+ 26160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.486719 (+ 90349us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.391566 (+904847us) raft_consensus.cc:1685] finished
0709 13:11:56.391595 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.556837 (+165242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8307,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":332087,"threads_started":1,"wal-append.queue_time_us":528545}
I20260709 13:11:56.486522 31890 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.413808 31849 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.609453 31890 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.610497 31890 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.612831 31836 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:56.614439 31916 consensus_meta.cc:287] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 1.546s	user 0.014s	sys 0.012s
I20260709 13:11:56.614289 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:56.616040 31990 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.409139 31834 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.622053 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.623870 31997 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.410059 31950 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:56.603439 30001 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.003s	sys 0.014s
I20260709 13:11:56.640019 31946 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.585289 30106 rpcz_store.cc:276] 0709 13:11:54.131693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.133500 (+  1807us) service_pool.cc:224] Handling call
0709 13:11:56.372807 (+2239307us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:56.373046 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.373231 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.373257 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.373312 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:56.373361 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.373446 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.373572 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295552}
W20260709 13:11:56.503947 31966 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:11:56.643615 30001 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.003s	sys 0.014s
W20260709 13:11:56.497164 31954 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.003s
I20260709 13:11:56.639818 31985 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:56.651556 31985 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.652171 31990 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.653589 31973 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.454668 31947 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.654534 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:56.658034 31990 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.637714 31972 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.434412 31854 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.587343 30104 rpcz_store.cc:276] 0709 13:11:54.298975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.096584 (+797609us) service_pool.cc:224] Handling call
0709 13:11:55.193029 (+ 96445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.193501 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.193543 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.197788 (+  4245us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.276247 (+ 78459us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:55.276288 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.276353 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.559853 (+1283500us) raft_consensus.cc:1685] finished
0709 13:11:56.559941 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.560387 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":5027,"thread_start_us":65596,"threads_started":1,"wal-append.queue_time_us":1232678}
I20260709 13:11:56.584215 30113 rpcz_store.cc:276] 0709 13:11:54.297976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.041749 (+743773us) service_pool.cc:224] Handling call
0709 13:11:55.059847 (+ 18098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.358736 (+298889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.358780 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.359281 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.794935 (+435654us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:55.794994 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.795105 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.565085 (+769980us) raft_consensus.cc:1685] finished
0709 13:11:56.565128 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.565484 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28238,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":81217,"thread_start_us":607259,"threads_started":2,"wal-append.queue_time_us":1067518}
I20260709 13:11:56.434300 31904 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:56.494221 31902 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.670027 31944 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.664340 31893 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:56.681586 31893 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.674823 31854 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.676034 31968 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.680244 31904 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:56.687081 31893 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.688382 31666 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.487280 31957 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:56.662217 31997 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.498733 31964 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.654449 31973 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:56.710891 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 1.06133e+06us
I20260709 13:11:56.417028 31970 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.680248 31946 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.775871 31987 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:56.776470 30150 connection.cc:256] RPC call timeout handler was delayed by -1.7876922609998473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:11:56.777220 31984 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:56.722491 31985 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:56.772128 31957 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.713897 31893 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:56.799118 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.773761 31954 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.751981 31916 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.777917 31944 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:56.814949 31902 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.833510 31902 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:56.830937 30180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1744) took 2505 ms (client timeout 1563 ms). Trace:
I20260709 13:11:56.810451 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:56.809286 31834 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:56.854279 30180 rpcz_store.cc:269] 0709 13:11:54.194779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.221462 (+ 26683us) service_pool.cc:224] Handling call
0709 13:11:56.641858 (+2420396us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54002170d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:56.700314 (+ 58456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981735040}
I20260709 13:11:56.810878 31758 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.859964 31973 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.859805 30034 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.859720 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.827210 31970 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.808589 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.854306 31997 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:56.859860 31992 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:11:56.787510 31666 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.874003 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:56.876869 30030 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:56.877689 32010 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.809048 31989 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.890552 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:56.891095 31946 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:56.893573 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1747) took 2568 ms. Trace:
I20260709 13:11:56.894039 30179 rpcz_store.cc:276] 0709 13:11:54.237928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.247821 (+1009893us) service_pool.cc:224] Handling call
0709 13:11:55.339607 (+ 91786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.339851 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:56.577954 (+1238103us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.726567 (+148613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.747230 (+ 20663us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.765085 (+ 17855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.770302 (+  5217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.806157 (+ 35855us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32841,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":18346,"raft.run_wall_time_us":30770,"spinlock_wait_cycles":3969920,"thread_start_us":1290298,"threads_started":2,"wal-append.queue_time_us":185444}
I20260709 13:11:56.864682 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.878615 32010 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.871141 31854 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:56.888865 31987 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.886159 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:56.883509 31893 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.905874 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:56.882948 32009 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:56.883944 31957 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.885322 31944 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:56.908393 30736 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:56.938261 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:56.963145 30178 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.977419 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 371) took 2820 ms. Trace:
I20260709 13:11:56.978634 31973 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:56.906350 31985 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:56.883198 31984 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:56.906169 31758 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.023276 30030 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:11:57.003867 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.014580 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.978535 30732 rpcz_store.cc:276] 0709 13:11:54.157002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.163919 (+  6917us) service_pool.cc:224] Handling call
0709 13:11:54.237082 (+ 73163us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faee9c 00007fcbe2faea5b 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:56.657982 (+2420900us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faeeee 0000000000375939 00007fcbeb0221e0 00007fcbeb0eb0c4 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:56.658506 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.681875 (+ 23369us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:56.709644 (+ 27769us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.924286 (+214642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.926827 (+  2541us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:56.951755 (+ 24928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.957696 (+  5941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.977154 (+ 19458us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10148,"prepare.queue_time_us":57080,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":33451,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":43329,"spinlock_wait_cycles":70888576,"thread_start_us":107545,"threads_started":2}
I20260709 13:11:57.035811 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:57.013581 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.036806 30106 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
W20260709 13:11:57.031435 30001 connection.cc:256] RPC call timeout handler was delayed by -1.0975465880001138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2279s for a response
W20260709 13:11:57.040489 30001 connection.cc:256] RPC call timeout handler was delayed by -1.0915235510001366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260709 13:11:57.041847 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:57.041939 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:56.977272 30738 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:57.043354 31981 raft_consensus.cc:993] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:57.044179 31981 raft_consensus.cc:1081] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:11:57.042984 30036 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:57.046627 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.047425 30036 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:57.048033 31902 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.048504 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.028332 32009 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.049363 30036 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:57.055532 31758 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.050755 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.056722 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.019521 31666 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.049499 32001 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.060845 32001 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.041872 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1637) took 2582 ms. Trace:
I20260709 13:11:57.041075 30183 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:57.014430 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.015667 32010 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.050122 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.049769 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:56.979400 31973 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.082449 32010 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:11:57.085057 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 105368us
I20260709 13:11:57.085180 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.085453 32010 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.086179 30179 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:57.087518 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.088727 32010 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.089569 31893 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.063402 30110 rpcz_store.cc:276] 0709 13:11:54.306963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.102073 (+1795110us) service_pool.cc:224] Handling call
0709 13:11:56.103099 (+  1026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.103515 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:56.407860 (+304345us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.779123 (+371263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.806830 (+ 27707us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:56.857491 (+ 50661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.866210 (+  8719us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.889672 (+ 23462us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":609366,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":6409,"raft.queue_time_us":158114,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":26542,"thread_start_us":579826,"threads_started":3,"wal-append.queue_time_us":331698}
I20260709 13:11:57.091557 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:56.961047 31946 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:57.092518 30185 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:57.102077 31916 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:56.967808 31987 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.095297 31893 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:57.139678 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.142388 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.145128 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.145524 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.145885 30180 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:57.146402 30185 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:57.147346 31893 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.146320 30187 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:57.142408 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.153960 30034 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:57.156286 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.117250 31985 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.156286 30179 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:11:57.167560 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.173691 31973 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.177105 31950 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:57.177873 31950 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.192793 31982 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:57.195051 32005 log.cc:927] Time spent T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
W20260709 13:11:57.203680 31958 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.817s	user 0.001s	sys 0.002s
I20260709 13:11:57.204339 29932 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.207023 29932 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 4, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:57.210220 30181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1753) took 2970 ms (client timeout 1867 ms). Trace:
W20260709 13:11:57.210711 30181 rpcz_store.cc:269] 0709 13:11:54.239562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.246408 (+  6846us) service_pool.cc:224] Handling call
0709 13:11:57.209871 (+2963463us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400298bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:11:57.210025 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250832128}
I20260709 13:11:57.181569 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.225044 31984 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.224435 29932 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:11:57.232470 29930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 141) took 9517 ms. Trace:
I20260709 13:11:57.231283 29932 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:11:57.250694 32015 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:11:57.250430 29932 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.138521 31946 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:11:57.255785 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.253139 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:57.268466 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.226826 32001 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.290139 31893 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.291183 31868 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:57.291978 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.296622 31954 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:57.300665 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54811us
I20260709 13:11:57.302853 29932 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:57.304193 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.311435 31957 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.315004 31950 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.320019 31868 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:57.287817 31985 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.320659 31893 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:57.323215 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.323325 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.326666 30180 raft_consensus.cc:2410] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:57.323791 31990 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:57.324862 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.331192 31987 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:57.332811 31736 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 1.815s	user 0.010s	sys 0.010s
I20260709 13:11:57.342031 31736 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.344884 30179 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:57.340664 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.352890 30185 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:57.355140 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.355765 30180 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:57.352313 31893 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:57.356851 31869 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:57.357909 31902 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:57.358458 31902 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:57.359658 31902 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.361219 31902 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:57.366153 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 177648us
I20260709 13:11:57.366940 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.366871 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.370342 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.369146 30733 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:57.380724 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.374387 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.388428 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.391160 30180 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:57.379467 31736 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.401046 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1609) took 3314 ms. Trace:
I20260709 13:11:57.401551 30186 rpcz_store.cc:276] 0709 13:11:54.086043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.104250 (+ 18207us) service_pool.cc:224] Handling call
0709 13:11:54.104513 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.198395 (+1093882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.400382 (+2201987us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002166d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:57.400837 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512725760}
I20260709 13:11:57.403277 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.409595 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.378471 31973 consensus_queue.cc:1059] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:11:57.411547 31937 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 2.363s	user 0.003s	sys 0.024s
I20260709 13:11:57.413235 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.413564 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.414095 30186 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:57.418077 30180 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:57.417704 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.418467 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:57.427199 31868 raft_consensus.cc:1064] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:57.424264 31758 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:57.428385 31758 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:57.428790 31758 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:57.427721 31868 raft_consensus.cc:1068] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:57.432070 31918 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:57.423058 31670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.013s	sys 0.008s
I20260709 13:11:57.232977 29930 rpcz_store.cc:276] 0709 13:11:47.714619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.714931 (+   312us) service_pool.cc:224] Handling call
0709 13:11:57.232002 (+9517071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:50.920921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:51.159651 (+238730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:51.162993 (+  3342us) write_op.cc:435] Acquired schema lock
0709 13:11:51.171388 (+  8395us) tablet.cc:662] Decoding operations
0709 13:11:51.236642 (+ 65254us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:51.236739 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:51.236781 (+    42us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:11:51.237274 (+   493us) tablet.cc:701] Row locks acquired
0709 13:11:51.237304 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:11:51.237516 (+   212us) write_op.cc:270] Start()
0709 13:11:51.237676 (+   160us) write_op.cc:276] Timestamp: P: 1783602711237455 usec, L: 0
0709 13:11:51.237709 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:51.238556 (+   847us) log.cc:844] Serialized 1686 byte log entry
0709 13:11:51.997117 (+758561us) op_driver.cc:464] REPLICATION: finished
0709 13:11:52.505313 (+508196us) write_op.cc:301] APPLY: starting
0709 13:11:52.505433 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:52.505622 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:52.505746 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:52.576145 (+ 70399us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:52.629300 (+ 53155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:11:52.637785 (+  8485us) write_op.cc:312] APPLY: finished
0709 13:11:52.671920 (+ 34135us) log.cc:844] Serialized 41 byte log entry
0709 13:11:53.035198 (+363278us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:53.040306 (+  5108us) write_op.cc:454] Released schema lock
0709 13:11:53.047854 (+  7548us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:53.096039 (+ 48185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:53.098090 (+  2051us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":139805,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":495553,"apply.run_cpu_time_us":43434,"apply.run_wall_time_us":563975,"num_ops":4,"prepare.queue_time_us":329577,"prepare.run_cpu_time_us":7359,"prepare.run_wall_time_us":623424,"raft.queue_time_us":353758,"raft.run_cpu_time_us":116476,"raft.run_wall_time_us":462385,"replication_time_us":737657,"thread_start_us":1232427,"threads_started":5,"wal-append.queue_time_us":716561,"wal-append.run_cpu_time_us":45237,"wal-append.run_wall_time_us":2102148}]]}
W20260709 13:11:57.438920 30705 connection.cc:256] RPC call timeout handler was delayed by -1.0053406209999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:11:57.442104 30705 connection.cc:256] RPC call timeout handler was delayed by -1.0053406209999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:11:57.441284 31758 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.444442 31758 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.429622 31973 raft_consensus.cc:3055] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:57.438846 31670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.013s	sys 0.009s
W20260709 13:11:57.453769 31904 consensus_meta.cc:287] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.005s
I20260709 13:11:57.466434 30740 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:57.467341 31803 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:57.469446 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:57.471980 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.488023 32009 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.490212 31868 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:57.491048 31868 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:57.458410 31973 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:57.495260 31973 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.497164 31973 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.492502 31868 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:57.506629 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 113918us
W20260709 13:11:57.508888 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.511384 30077 connection.cc:256] RPC call timeout handler was delayed by -1.4115387430001647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:11:57.511860 30077 connection.cc:256] RPC call timeout handler was delayed by -1.3395387430000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:11:57.512140 30077 connection.cc:256] RPC call timeout handler was delayed by -1.1586387429999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:11:57.512462 30077 connection.cc:256] RPC call timeout handler was delayed by -1.0146387429999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:11:57.513852 32011 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.513953 32020 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.477217 31904 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.514652 32011 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.514720 32020 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.516844 31904 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.517261 32020 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:57.519209 31963 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 1.512s	user 0.003s	sys 0.001s
I20260709 13:11:57.516852 32011 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.514715 31890 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.523461 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:57.541771 31943 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.546258 31944 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:11:57.549933 32016 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.406s	user 0.001s	sys 0.003s
I20260709 13:11:57.555388 31890 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:57.555932 32020 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:57.556543 30002 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.557680 31990 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.558234 31990 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:57.558291 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.558794 31990 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.559785 32028 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.560176 32028 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.560712 32028 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.560868 31893 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:57.561390 31893 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.561795 31893 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.562475 31913 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.567970 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.570031 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.571202 31869 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:57.571367 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.571638 31869 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.572021 31869 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.573226 31969 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.573297 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.576835 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.577840 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:11:57.581795 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 88417.2us
I20260709 13:11:57.595445 31991 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.595582 31990 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.597770 32028 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.577801 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.601248 31948 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:57.602779 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.604799 31946 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.555389 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:57.618721 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 63462us
I20260709 13:11:57.619848 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.619946 31990 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.621289 32009 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.622294 32028 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.623543 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.611361 31991 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:57.624468 32020 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.624611 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.626015 31973 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.626183 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:57.630573 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 52843.9us
I20260709 13:11:57.622287 32009 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.628954 31948 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.634327 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 216) took 3448 ms. Trace:
I20260709 13:11:57.624647 31991 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.634928 30107 rpcz_store.cc:276] 0709 13:11:54.186091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.024191 (+838100us) service_pool.cc:224] Handling call
0709 13:11:55.024548 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.067115 (+ 42567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.067151 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.067196 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:55.067223 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.633702 (+2566479us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5400305cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:57.633769 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.634128 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97338752}
I20260709 13:11:57.629796 31973 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:57.637919 31973 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.638075 31977 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.638540 31977 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:11:57.638770 32027 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.135s	user 0.003s	sys 0.002s
I20260709 13:11:57.638952 31977 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.646057 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1758) took 3399 ms. Trace:
I20260709 13:11:57.646751 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.647308 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:57.647452 31965 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.648227 30178 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:57.647996 31965 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.665498 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.667860 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.668217 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.668506 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.669013 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.669346 30186 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:57.669860 30182 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:57.669286 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.670688 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.671259 30037 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:11:57.671943 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.673360 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.673801 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.674243 30032 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:57.674738 30038 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:57.675292 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.675984 30180 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:57.626375 31893 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.677883 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.666316 30035 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:57.646535 30184 rpcz_store.cc:276] 0709 13:11:54.246121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.249145 (+2003024us) service_pool.cc:224] Handling call
0709 13:11:56.250538 (+  1393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.294530 (+ 43992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.294562 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.300944 (+  6382us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.708263 (+407319us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.708382 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.708588 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.640809 (+932221us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b18003df5a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:11:57.643543 (+  2734us) raft_consensus.cc:1685] finished
0709 13:11:57.643566 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.645842 (+  2276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43509,"raft.queue_time_us":58951,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":57,"spinlock_wait_cycles":61887872,"thread_start_us":364094,"threads_started":1,"wal-append.queue_time_us":369221}
I20260709 13:11:57.627884 31969 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:57.660929 31997 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:57.680938 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54829.7us
I20260709 13:11:57.684262 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.685433 32009 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.678674 31913 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.686302 31946 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:57.687129 31946 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.687722 31997 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.688910 31893 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.688522 31997 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.689733 31913 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.691375 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1063) took 3844 ms. Trace:
I20260709 13:11:57.689206 31946 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.692613 31986 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:57.649322 31869 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.700248 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.701088 30038 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:57.695299 30112 rpcz_store.cc:276] 0709 13:11:53.846509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.869663 (+ 23154us) service_pool.cc:224] Handling call
0709 13:11:54.133562 (+263899us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:56.650934 (+2517372us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faee9c 00007fcbe2faea5b 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:11:56.651431 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.685616 (+ 34185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.685649 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.686543 (+   894us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.722002 (+ 35459us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:57.690523 (+968521us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b180030a3c0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe5c7b4bc 00007fcbe2fc948b 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe9acb3c7 00007fcbe60dd9a7 00007fcbe60ed0bf
0709 13:11:57.690675 (+   152us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.690920 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.691010 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.691053 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:57.691062 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.691192 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77160,"prepare.queue_time_us":75037,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":9035,"raft.queue_time_us":36273,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":472,"spinlock_wait_cycles":18566016,"thread_start_us":120382,"threads_started":2,"wal-append.queue_time_us":98097}
W20260709 13:11:57.712129 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 80965.4us
I20260709 13:11:57.712813 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.713874 30033 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:11:57.691943 31997 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.714224 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.716235 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.718912 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.720629 30032 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:11:57.723507 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 116589us
I20260709 13:11:57.724849 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:11:57.705251 31986 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.715869 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.830871 31875 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.838641 30178 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:11:57.838694 31875 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.839617 31965 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.839848 31997 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.840453 31868 raft_consensus.cc:1064] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:11:57.840425 31997 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.842299 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.843086 31997 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.844313 32009 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:57.845000 32009 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.847172 32009 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.847680 32009 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.842329 31875 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.848222 32009 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.852048 32009 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.853564 31868 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.856417 31875 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:57.859400 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 132453us
I20260709 13:11:57.860036 31977 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.717984 31946 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:11:57.775514 31944 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:57.772296 31920 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.890929 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.891037 31920 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.833616 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.766398 31893 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:57.835529 32033 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.132s	user 0.006s	sys 0.000s
I20260709 13:11:57.771632 31979 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.858536 31875 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.861363 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.863480 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.864758 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.831203 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1628) took 3530 ms. Trace:
I20260709 13:11:57.872417 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.906314 30034 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:57.874293 31943 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.875762 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.876755 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:57.878034 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.879254 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.908022 30037 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:57.881313 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:57.883783 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:57.884963 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:57.872597 31991 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.892017 30184 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
W20260709 13:11:57.893496 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 169229us
I20260709 13:11:57.832348 31869 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:11:57.897094 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 62854.6us
I20260709 13:11:57.914095 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.901841 32041 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.909018 30031 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:57.913839 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.913141 30029 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.856627 31973 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:57.905635 31979 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.919977 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.902673 31944 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:57.903458 31986 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:57.919229 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.897220 31893 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:57.932314 30185 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:57.922737 31943 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.907503 30178 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:57.927249 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:57.927564 30182 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:57.928932 31991 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:57.935249 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.936761 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:57.906098 30108 rpcz_store.cc:276] 0709 13:11:54.303845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.783928 (+1480083us) service_pool.cc:224] Handling call
0709 13:11:55.784369 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.888480 (+104111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.888518 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.929105 (+ 40587us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.332714 (+403609us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.706911 (+374197us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.691016 (+984105us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18001814e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287 00007fcbe60ee208
0709 13:11:57.830581 (+139565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.830694 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.830766 (+    72us) raft_consensus.cc:1685] finished
0709 13:11:57.830876 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.831041 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15549,"prepare.queue_time_us":433228,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5898,"raft.queue_time_us":303913,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":29728,"spinlock_wait_cycles":6417152,"thread_start_us":763808,"threads_started":4,"wal-append.queue_time_us":449756,"wal-append.run_cpu_time_us":8729,"wal-append.run_wall_time_us":1453919}
I20260709 13:11:57.940325 30032 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:57.940223 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.940819 31736 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:57.941602 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:57.931430 31979 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.933636 31893 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.957909 31944 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:57.962539 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.950923 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.938225 31913 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.968983 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:57.934476 31938 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:11:57.971823 30183 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:57.978755 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.983381 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:57.994553 30035 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:57.980723 31920 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:57.990568 31921 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.007465 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:57.971220 31736 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:58.009742 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 63671.9us
I20260709 13:11:57.988574 32009 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.988883 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.015545 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:57.990919 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:58.017370 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.023411 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.027773 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.020761 31921 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:58.011714 31869 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.019698 30178 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:58.034899 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51587.8us
I20260709 13:11:58.018962 31904 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:58.022841 31977 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.039988 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.032408 31869 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:58.027318 31989 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:58.045276 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.048024 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.045085 31986 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.033360 31965 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:58.050462 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 56875us
I20260709 13:11:58.054706 32009 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:58.043498 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:58.055794 30736 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.055970 32009 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.056478 32009 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:11:58.051859 31965 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:58.058050 31965 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.045197 31989 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:58.061566 31868 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:58.061964 31989 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.062208 31921 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.062708 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.063750 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:58.063982 31758 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.065644 32009 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.061621 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.044049 31904 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.054927 31976 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.067873 31976 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:58.068346 31976 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.068583 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.068868 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:58.069530 30183 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 1.
I20260709 13:11:58.069628 31997 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.070506 31986 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.071777 32009 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.072837 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:58.044960 31869 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.076565 31946 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:58.088160 31946 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.077557 31943 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.079154 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:58.090754 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.091401 30185 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.091202 31893 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.066038 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.081146 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:58.081668 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.099640 30182 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:11:58.085227 30029 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.085922 31973 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.085820 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.087278 31736 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.051092 31875 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.103057 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:58.110826 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.115367 30185 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:58.103762 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:58.109001 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:11:58.114794 30150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.518s (SENT) [suppressed 32 similar messages]
I20260709 13:11:58.062116 31868 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.095577 30178 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:58.123852 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.124411 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:11:58.124737 30183 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:58.126071 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:58.108393 31758 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:58.132925 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.103518 31893 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.138391 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.140260 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:58.140684 31811 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.141680 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.142095 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.142346 30033 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.142673 30034 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:11:58.143074 31875 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.143431 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.155921 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.122008 31948 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.162637 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.166177 30038 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:58.123939 31868 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.159341 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.143450 31875 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.133420 31944 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.185107 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.182852 30032 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:11:58.193694 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 91012.4us
I20260709 13:11:58.135059 31758 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:58.173556 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.201829 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.144557 31854 raft_consensus.cc:3055] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:58.203619 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.170490 32041 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:58.206300 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.207237 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.209008 30002 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:58.209260 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.197523 31875 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:58.217319 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 43907.2us
I20260709 13:11:58.204241 31758 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.205082 31946 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.219509 30151 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.207710 31986 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:58.218227 31913 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.207096 31854 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.225674 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.214184 32028 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:58.226652 32042 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:58.218580 30736 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:58.227662 31893 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.231074 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.243005 30104 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.226317 31671 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.210968 32041 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.243852 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:58.244436 31811 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:58.250051 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.250090 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.244397 31893 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.214022 31973 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:11:58.256031 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.258180 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.241806 31946 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.243345 30178 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:58.261657 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.239483 32028 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:58.247112 32041 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.264581 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.268328 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.269232 30106 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:58.250108 31811 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:58.266042 31991 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:58.270578 31811 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.270735 31991 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:58.271224 31991 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.254175 31893 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:58.281634 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.262295 31946 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.283730 31946 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.286139 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.286804 30106 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.288378 30111 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:58.292200 30183 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:11:58.265578 31978 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.240612 31989 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.267396 31973 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.268368 32028 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:58.302459 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44321.4us
I20260709 13:11:58.306145 31913 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:58.307652 31913 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.274509 31920 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.317345 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.317857 30153 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:11:58.319188 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 112296us
I20260709 13:11:58.320420 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.322141 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:58.322611 32051 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:11:58.322906 30107 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.324121 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.324832 30111 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.322288 31866 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.326994 31965 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.333452 30184 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:58.334551 31979 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.336807 31979 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.339311 30107 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:58.340530 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.341117 30107 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.342687 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.343315 30106 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.344214 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.344985 30106 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.345893 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.346498 30109 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.347402 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.348101 30109 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:58.303113 31973 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:58.349363 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.350243 31973 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.329262 30183 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:58.351502 31973 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.352432 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.353101 30109 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:11:58.353969 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.314116 31854 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.354997 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.355414 30109 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.356127 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.356173 30186 raft_consensus.cc:2368] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:58.356386 31811 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.356954 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.301992 31978 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:58.357672 31978 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.330207 30178 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.326056 31976 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.358597 31670 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:58.359737 31670 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:58.360116 31670 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.360144 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.360580 31976 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.273218 31869 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.362200 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.363624 31869 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.364444 30179 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:58.364955 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.333498 32047 log.cc:927] Time spent T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 13:11:58.366511 30179 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:58.326905 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 70950.7us
I20260709 13:11:58.367650 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.361099 31670 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.357348 30109 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.328490 31968 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:58.375967 30107 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.385659 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.385882 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.302474 31758 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.393360 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:58.393829 30001 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.563s (SENT)
I20260709 13:11:58.393961 31670 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.394556 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.396040 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.366667 32058 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.416085 30036 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:11:58.402206 31893 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.408509 31989 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.416190 30108 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.385079 31921 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.416834 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.430960 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.420364 30112 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.434396 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.436308 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.438091 32041 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.439627 30178 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:58.440259 32041 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.440440 31944 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.441536 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.443569 31875 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:11:58.443936 31991 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.445925 30104 raft_consensus.cc:2368] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4.
I20260709 13:11:58.391212 31979 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:58.443936 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.420848 30109 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.448671 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.447343 30111 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.449321 30179 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.408794 31868 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.425127 31758 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.425669 30032 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.421617 32058 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:11:58.393842 31811 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.429860 31921 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.475104 32058 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.479143 31854 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.475133 31921 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.396188 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.404217 31946 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.451026 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.453622 31948 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:58.454491 31965 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.457727 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.491390 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.491974 30182 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:58.462811 30179 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:58.464197 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.387513 31977 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:11:58.466241 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.468489 30004 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.468849 31893 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.414788 31904 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.429227 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.496992 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.497848 30113 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.497921 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.498586 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.498904 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.499178 30111 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.499440 30108 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.500739 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.500883 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.492271 30107 raft_consensus.cc:2376] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2. Re-sending same reply.
I20260709 13:11:58.490259 31948 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.491544 31758 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:58.501377 30105 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.503665 31948 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:58.506644 32045 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:58.507030 32045 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:11:58.507381 32045 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.509014 31875 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.504720 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.523993 30108 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.524121 31869 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.510978 31946 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.511526 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.514030 30002 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.525027 31758 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:58.527642 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.528347 30106 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:11:58.522338 31969 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.528044 31758 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.522832 31991 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:11:58.521785 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 53380.7us
W20260709 13:11:58.522110 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 92948.5us
I20260709 13:11:58.525550 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.531498 31868 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.531997 30110 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:58.525665 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 131864us
I20260709 13:11:58.469178 31978 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.545508 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.544956 32059 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:58.551004 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.552943 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 258) took 8653 ms. Trace:
I20260709 13:11:58.556937 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.556941 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.557652 30110 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:58.559227 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.559295 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.561529 30106 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:58.564453 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.559227 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.540731 31921 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.541177 32058 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.554980 31804 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:11:58.552003 31854 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:11:58.553345 29932 rpcz_store.cc:276] 0709 13:11:49.899805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.901960 (+  2155us) service_pool.cc:224] Handling call
0709 13:11:49.913814 (+ 11854us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:11:58.552882 (+8639068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:57.449874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:57.520581 (+ 70707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:57.520639 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:11:57.520657 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:57.521671 (+  1014us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:57.521798 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:57.521845 (+    47us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:57.522514 (+   669us) tablet.cc:701] Row locks acquired
0709 13:11:57.522564 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:11:57.522726 (+   162us) write_op.cc:270] Start()
0709 13:11:57.522897 (+   171us) write_op.cc:276] Timestamp: P: 1783602717522662 usec, L: 0
0709 13:11:57.522942 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:11:57.525038 (+  2096us) log.cc:844] Serialized 2520 byte log entry
0709 13:11:58.220182 (+695144us) op_driver.cc:464] REPLICATION: finished
0709 13:11:58.306350 (+ 86168us) write_op.cc:301] APPLY: starting
0709 13:11:58.306428 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:58.306623 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:58.306776 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:58.307558 (+   782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:58.307829 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:11:58.307872 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:58.308190 (+   318us) log.cc:844] Serialized 53 byte log entry
0709 13:11:58.308410 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.308515 (+   105us) write_op.cc:454] Released schema lock
0709 13:11:58.308578 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:58.309499 (+   921us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.309530 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3241045,"reported_tablets":14,"spinlock_wait_cycles":16150400,"child_traces":[["op",{"apply.queue_time_us":82428,"apply.run_cpu_time_us":2622,"apply.run_wall_time_us":3094,"num_ops":6,"prepare.queue_time_us":120193,"prepare.run_cpu_time_us":18765,"prepare.run_wall_time_us":109262,"raft.queue_time_us":214708,"raft.run_cpu_time_us":22290,"raft.run_wall_time_us":98193,"replication_time_us":693261,"thread_start_us":300464,"threads_started":4,"wal-append.queue_time_us":174065}]]}
I20260709 13:11:58.555191 31811 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:11:58.605955 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.567559 31972 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:11:58.567665 31969 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:58.610428 31868 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:58.571637 30030 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:58.610131 31803 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.611513 31803 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.608335 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.610594 31969 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:58.571960 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.575507 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.612790 30038 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.612824 31969 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.573740 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.614588 30108 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:58.614693 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.571075 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.615960 30033 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:58.617712 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.618695 31803 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.620457 31803 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.622489 30038 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.580435 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.630384 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.634019 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:11:58.635689 31943 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:58.582361 31854 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.586869 31658 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:58.638244 32045 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.638705 31658 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:58.639114 31658 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.639348 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.640362 32045 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.641222 30734 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:58.641655 31854 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.642653 31854 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.640416 30178 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:58.643783 31854 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.587263 32028 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:58.645669 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.646387 30037 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.600340 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.647446 30110 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:58.647790 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.646744 32028 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.648373 30104 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:58.648413 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.648816 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.649130 30106 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:58.640030 31658 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.649528 30109 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:58.603184 30031 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.650096 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.635715 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:11:58.567814 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:58.580482 31978 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.651998 30035 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:58.651350 30739 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:11:58.588104 31804 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.653272 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.653343 31804 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:11:58.569641 31920 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.654210 30110 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.655463 31804 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:58.604717 32058 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:58.656824 31804 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.656566 30178 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.602576 31921 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.661026 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.662606 31921 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.664392 30036 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:11:58.632507 29931 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.650184 31658 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.666003 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.666185 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.667318 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.680649 30104 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:11:58.667863 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.668174 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.668807 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.682361 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.683075 30107 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.669121 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.667558 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.669729 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.669847 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:58.670073 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.677594 30002 leader_election.cc:400] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:58.684376 30112 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:58.708600 30002 leader_election.cc:403] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.714797 30037 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.707993 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.720054 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.716409 31921 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:58.722041 31921 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.722255 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.723572 31803 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.724128 31921 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:58.725736 30035 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:58.733848 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.734704 30104 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:58.737447 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:58.747046 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.736857 29931 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:58.755335 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 174132us
I20260709 13:11:58.756364 30002 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.677059 31948 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.760028 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:11:58.764226 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.730742 31913 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.736918 32028 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:11:58.759306 31921 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.772367 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.754537 32059 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:58.771518 31869 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.779174 31736 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:58.779974 30104 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:58.767907 31758 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.781453 31969 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:58.765872 31943 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:58.778656 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.774560 29931 catalog_manager.cc:5697] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.790145 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.792117 32059 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.799247 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:58.799937 30037 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:58.760703 31920 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:58.770607 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:58.791193 32058 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:58.801909 31921 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:58.809689 29931 catalog_manager.cc:5697] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.812722 30105 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:58.794231 31913 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:58.854269 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.819077 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.855275 30113 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:58.856184 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.819623 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:58.826496 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.810949 30732 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:58.820057 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:11:58.822170 31943 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:58.805063 31736 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.816337 31921 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:58.987660 31868 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.818234 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.990093 30108 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:58.841315 29931 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:11:58.857182 30110 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.857373 30111 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:11:58.820245 30107 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.838697 32058 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:11:58.881428 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.981913 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 161917us
I20260709 13:11:59.001387 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:58.985059 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.985121 31965 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:58.988971 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 118173us
I20260709 13:11:58.994755 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:59.000234 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:59.003996 30107 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.010269 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:59.014663 29931 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 3 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.005482 31965 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:11:59.021855 31965 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.025569 31736 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:59.025830 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:59.026772 31736 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:11:59.029605 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.029963 32058 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.030925 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:11:59.031531 30108 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.030432 31893 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:59.027295 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:58.816648 31969 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:59.309957 30107 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:11:59.516676 30111 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:59.219882 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.358635 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:59.200323 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 197678us
I20260709 13:11:59.518431 30185 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.033936 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:59.125573 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.045207 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.093210 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:11:59.072503 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 62624.6us
I20260709 13:11:59.034551 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:11:59.072913 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.488893 30112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.056s
W20260709 13:11:59.522444 30112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.010s	sys 0.056s
I20260709 13:11:59.523346 30037 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:59.111867 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:59.521327 30187 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.524290 30179 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:11:59.525204 30110 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.005s
I20260709 13:11:59.526021 30110 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:11:59.526209 30113 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:11:59.090497 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:59.526798 30001 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.505s (SENT)
I20260709 13:11:59.150283 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:59.100104 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.528723 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:59.529440 30180 raft_consensus.cc:2410] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:59.099691 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.523057 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:59.539085 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.540417 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:59.541321 30037 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:58.987589 31948 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:58.983242 31943 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:11:59.554690 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:11:59.424072 30109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.003s	sys 0.009s
I20260709 13:11:59.549199 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:59.555908 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:11:59.551853 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 517519us
I20260709 13:11:59.556576 30110 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:11:59.553104 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 174865us
I20260709 13:11:59.553506 30035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:54300
W20260709 13:11:59.307986 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.559108 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.557737 30035 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.560406 30035 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.551256 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:11:59.232681 31875 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.101761 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:59.560002 30033 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:59.570861 30108 consensus_meta.cc:287] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:11:59.590875 30108 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:11:59.008446 31868 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:11:59.557920 30109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.006s	sys 0.010s
I20260709 13:11:59.029605 31758 consensus_queue.cc:1059] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.527s
I20260709 13:11:59.595420 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.109750 31965 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.595606 30104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:54808
I20260709 13:11:59.558538 31804 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:59.596696 30105 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:59.586256 30183 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:59.618104 30104 raft_consensus.cc:606] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:59.615324 30033 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:59.603087 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:59.618937 30001 leader_election.cc:336] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.602s (SENT)
I20260709 13:11:59.622524 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:59.616732 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.313251 29931 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132), now has a pending config: VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129), VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130), VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131), VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:59.626966 30185 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:11:59.632735 30187 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:59.635165 30186 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:59.635656 29931 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 2, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:59.638170 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:59.597347 32079 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:11:59.653782 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.656347 30030 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:11:59.611063 31943 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.657629 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:59.658427 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.659904 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.661104 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.661932 30038 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:59.670156 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.671066 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.671545 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:59.672139 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:59.672703 30038 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.675876 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.693161 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.695242 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.786481 30180 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:11:59.108186 31913 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.598518 31875 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.661356 31948 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.774667 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:11:59.773711 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 84283us
I20260709 13:11:59.684993 31943 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.672708 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.619642 31868 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.691454 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:11:59.827284 30038 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
W20260709 13:11:59.785229 31670 raft_consensus.cc:670] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } [suppressed 5 similar messages]
I20260709 13:11:59.818545 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:59.823939 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.827473 30032 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:59.793675 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:59.857969 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 197101us
I20260709 13:11:59.856446 30033 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.858996 30185 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:59.856312 30035 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.873891 30180 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:59.877658 30033 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:59.882109 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1672) took 1063 ms. Trace:
I20260709 13:11:59.885326 30109 rpcz_store.cc:276] 0709 13:11:58.818671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.820441 (+  1770us) service_pool.cc:224] Handling call
0709 13:11:58.820816 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.821045 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:59.620252 (+799207us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.881639 (+261387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.881714 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:59.881789 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.881893 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.882033 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283903,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":1021918,"threads_started":3}
I20260709 13:11:59.855692 31979 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.909202 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.867277 31965 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:11:59.865617 32045 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.910064 31804 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.920770 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:59.924234 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105807us
I20260709 13:11:59.926970 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:59.938149 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:11:59.939090 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:11:59.909438 32059 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.606619 30732 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:11:59.942754 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.944001 31893 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:59.944231 32075 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:11:59.945588 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1205) took 1233 ms. Trace:
I20260709 13:11:59.945971 30036 rpcz_store.cc:276] 0709 13:11:58.712351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.712517 (+   166us) service_pool.cc:224] Handling call
0709 13:11:58.735801 (+ 23284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.736227 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.736267 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.759421 (+ 23154us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.149109 (+389688us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:59.149171 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.149268 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.945321 (+796053us) raft_consensus.cc:1685] finished
0709 13:11:59.945343 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.945499 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1080,"raft.queue_time_us":22473,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9003,"thread_start_us":346666,"threads_started":1,"wal-append.queue_time_us":1006030}
I20260709 13:11:59.942279 32068 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:59.949698 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.950598 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:11:59.954074 32085 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:11:59.926497 31758 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:59.955438 31758 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.956483 31869 raft_consensus.cc:3055] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:59.957006 31869 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:11:59.942342 32041 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:11:59.958205 32041 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.959968 30034 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:11:59.960175 32041 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:11:59.961048 32091 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.961578 32091 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:11:59.963660 32091 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:59.971494 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.972590 31875 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:59.973886 30186 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.974869 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:11:59.975660 30181 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:11:59.972823 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:59.976365 30187 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.924454 32045 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.927536 31804 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.983626 32045 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:11:59.919458 31979 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:11:59.973845 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:11:59.989964 30187 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:11:59.994522 30001 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:59.995296 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:00.002759 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.003552 30185 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.987332 31804 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.011548 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.001075 31758 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:00.002439 32068 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:00.018491 30739 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:00.023322 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.018607 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.024164 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:00.026939 30179 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.028070 30037 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:00.031293 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 136187us
I20260709 13:12:00.032203 30736 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.035650 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.035989 32099 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:00.036335 30110 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
W20260709 13:12:00.040011 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.041952 30110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbc08410209249758a644676ff99841d"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50288
I20260709 13:12:00.042465 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.042917 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:00.043663 32083 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.442s	user 0.001s	sys 0.002s
I20260709 13:12:00.043803 32100 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.044364 32100 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.044763 32100 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.045185 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.042508 30110 raft_consensus.cc:606] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:00.045776 30110 raft_consensus.cc:614] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:00.045859 30183 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:00.047955 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.048601 30185 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:00.005337 32055 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.051438 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:00.055083 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:00.014953 32059 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.057286 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:11:59.958199 31869 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.037421 31986 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.066105 31854 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.051332 31670 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.050280 31758 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.069167 30035 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:00.061040 31979 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:00.069309 32080 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.538s	user 0.000s	sys 0.004s
I20260709 13:12:00.066604 31854 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.066920 31989 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:00.084349 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.067514 31986 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.070957 32099 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.086342 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:00.055003 31868 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:12:00.094141 32068 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:00.095403 32068 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.097167 31869 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.071190 31904 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:12:00.059844 32055 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:00.097358 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45974.1us
I20260709 13:12:00.116690 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:00.102185 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1815) took 1015 ms. Trace:
I20260709 13:12:00.110673 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:00.074115 31965 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:12:00.112265 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.077668 32057 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 13:12:00.108430 32081 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.334s	user 0.003s	sys 0.000s
I20260709 13:12:00.114209 32114 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:00.116865 30739 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:00.087682 31854 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.117365 30736 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.119498 32099 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:00.097577 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 45481.5us
I20260709 13:12:00.117486 30182 rpcz_store.cc:276] 0709 13:11:59.086788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.527654 (+440866us) service_pool.cc:224] Handling call
0709 13:11:59.528040 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.552532 (+ 24492us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:59.780606 (+228074us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.883683 (+103077us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.927898 (+ 44215us) log.cc:844] Serialized 564 byte log entry
0709 13:11:59.928051 (+   153us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:59.928087 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.928153 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.101953 (+173800us) raft_consensus.cc:1685] finished
0709 13:12:00.101976 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.102114 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":84866,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":5898,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11167,"thread_start_us":280503,"threads_started":2,"wal-append.queue_time_us":216796}
I20260709 13:12:00.130724 30077 leader_election.cc:400] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:00.134267 30077 leader_election.cc:403] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:00.113034 32102 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:00.133682 32110 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.129125 31875 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:00.160190 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.131971 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:00.159476 32110 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.163520 32110 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.127821 32114 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:00.134171 32084 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.165745 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.167891 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.168538 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1664) took 1394 ms. Trace:
I20260709 13:12:00.164570 32114 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.169064 32084 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.133351 32094 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:12:00.169785 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.174345 32094 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.174829 32094 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.175069 32084 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.175917 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.168977 30112 rpcz_store.cc:276] 0709 13:11:58.773935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.774368 (+   433us) service_pool.cc:224] Handling call
0709 13:11:58.799495 (+ 25127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.801178 (+  1683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.801222 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.810959 (+  9737us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.523042 (+712083us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:59.523082 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.524100 (+  1018us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.013647 (+489547us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:00.160650 (+147003us) raft_consensus.cc:1685] finished
0709 13:12:00.160674 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.168468 (+  7794us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3431,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":29086,"spinlock_wait_cycles":553058688,"thread_start_us":541045,"threads_started":1,"wal-append.queue_time_us":675388}
I20260709 13:12:00.171132 32045 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.157637 32091 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:00.182010 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.188546 30180 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
W20260709 13:12:00.182633 32096 log.cc:927] Time spent T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:12:00.182884 32055 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:00.157449 32099 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.188591 30034 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:00.155918 32102 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:00.167253 31875 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:00.190933 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:00.175856 32094 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.202215 32093 raft_consensus.cc:2764] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:00.179082 32045 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.211732 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:00.194141 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.192806 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:00.188620 32041 consensus_queue.cc:1059] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:12:00.219703 32041 raft_consensus.cc:3055] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.220248 32041 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.221324 32045 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.223563 32099 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.199038 32102 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.156629 31986 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.230392 31986 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.232156 32094 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.232790 32057 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.213675 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 45512.8us
I20260709 13:12:00.221238 30736 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:00.205164 31875 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.206612 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.235845 30033 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:00.237946 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.236783 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:00.239347 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:00.198076 31946 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:00.243510 30736 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:00.243932 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.258302 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:00.246096 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 229329us
I20260709 13:12:00.262594 32112 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.264775 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.255628 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:00.272096 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.277885 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.282485 32103 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.282958 31904 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:12:00.283252 32099 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:00.283736 32099 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.282361 32091 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:00.288049 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.296836 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.268759 32093 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.298691 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.265811 32113 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.271085 31803 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.271224 31965 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.276178 31991 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.303506 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.275894 31946 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:00.279502 31969 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:00.279649 32084 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.286911 32116 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.300025 31944 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.313637 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 58096.2us
I20260709 13:12:00.299705 31904 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.301877 31803 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.242580 32041 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.304848 31920 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.284726 32099 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:00.308573 31969 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:00.304522 31989 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:00.331801 31803 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.314579 32116 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.357533 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.343436 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.358170 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:00.345719 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 48975.2us
I20260709 13:12:00.358891 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.344566 30107 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:00.328966 31904 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.354379 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.330276 32113 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:00.356094 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.360361 30112 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:00.308156 31965 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.359268 30001 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.360702 30106 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:00.358258 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:00.362057 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 60862.3us
I20260709 13:12:00.364473 30104 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.364773 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.367565 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.368435 30112 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:00.343447 31969 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.372435 32120 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.373005 32120 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.373566 32120 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.361817 31904 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:00.378891 32115 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:00.342386 31973 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.371027 30150 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.339272 32055 raft_consensus.cc:2764] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:12:00.330483 32100 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.416095 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.333614 31944 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.416803 30105 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:00.418727 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 399) took 1322 ms. Trace:
I20260709 13:12:00.417865 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.419061 31978 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.419296 32126 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.419596 31989 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.354882 32041 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.438731 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.420646 31920 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.361619 32116 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:00.442624 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.381649 32059 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.453117 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:00.445866 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74935.3us
I20260709 13:12:00.448175 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:00.449636 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 160601us
I20260709 13:12:00.445753 30109 raft_consensus.cc:2376] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4. Re-sending same reply.
I20260709 13:12:00.456272 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.459072 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:00.460090 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 75416.1us
I20260709 13:12:00.461443 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.462126 30033 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:00.465315 30038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:00.465875 30112 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:00.469343 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.474542 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.445700 31920 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.479604 30184 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:00.480821 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:00.481460 30001 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.488318 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.484726 30179 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:00.489974 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.451620 31978 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.492810 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.492826 31893 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:00.499562 32117 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.501473 32101 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.502141 32100 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.502085 32101 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.502898 32100 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:00.503664 32100 consensus_queue.cc:1243] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:00.504693 32101 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.504454 32045 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.505558 32113 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.508632 30109 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:00.482530 31920 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.510141 30183 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:00.512123 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.512440 30109 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:00.426213 31946 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.443609 32126 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.522176 31944 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:00.427146 30732 rpcz_store.cc:276] 0709 13:11:59.096248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.546619 (+450371us) service_pool.cc:224] Handling call
0709 13:11:59.606266 (+ 59647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.606499 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:00.255151 (+648652us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.342005 (+ 86854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.346636 (+  4631us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:00.359187 (+ 12551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.369428 (+ 10241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.417569 (+ 48141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"raft.queue_time_us":2296,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3512,"spinlock_wait_cycles":3444608,"thread_start_us":55356,"threads_started":1,"wal-append.queue_time_us":82466}
W20260709 13:12:00.523571 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.528306 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.492632 31758 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.484102 32128 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.532142 32100 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.542364 32100 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:00.508656 32091 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:12:00.544005 32091 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.544373 32091 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.544643 32100 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.544850 32114 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.545266 32091 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.511294 32101 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.537247 31893 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.549592 30740 raft_consensus.cc:2393] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:00.553807 31758 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.569109 31978 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.550114 32131 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.570209 32131 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:00.554872 32091 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.581781 31965 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:00.581821 31758 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:00.547145 32128 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:00.587873 32128 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.589797 31969 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.592844 31969 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.594328 32102 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.595589 30110 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:00.596473 31854 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.596954 32102 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:00.597626 32126 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.598423 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:00.602335 30113 raft_consensus.cc:2410] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:00.590106 32120 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.604532 30182 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:00.607002 32120 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:00.610836 32045 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.611573 31904 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.612630 30185 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.602979 32116 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.616741 30111 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:12:00.630179 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 160931us
I20260709 13:12:00.641043 32094 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.641043 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 107064us
I20260709 13:12:00.643293 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.644078 30187 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:00.552810 32101 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.648855 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.650054 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.650667 30181 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:00.651598 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.652432 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:00.651364 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.653556 30179 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:00.655254 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:00.656304 32059 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.657793 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:00.658525 30108 raft_consensus.cc:2410] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:00.649959 30032 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:00.660478 30184 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.641959 32094 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.663626 32094 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.665130 31904 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:00.666679 32116 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:00.658579 30732 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:00.667435 31854 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.574018 32131 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:00.668768 32131 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.653079 30037 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:00.672667 30104 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:00.654415 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:00.675801 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.677556 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.679453 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:00.680230 30181 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.680146 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.676707 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:00.726732 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.727770 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 50443.1us
I20260709 13:12:00.729041 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:00.729431 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 52754us
I20260709 13:12:00.765960 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.731974 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:00.814826 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 48963.4us
I20260709 13:12:00.810463 30181 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
W20260709 13:12:00.812333 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 284058us
I20260709 13:12:00.815630 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:00.816220 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:00.815156 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 83287us
W20260709 13:12:00.767328 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 87258.5us
I20260709 13:12:00.817342 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.818341 31869 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.818687 32144 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.819221 31869 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:00.821493 31803 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.730979 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:00.725829 32117 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:12:00.837059 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.768373 32045 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.686095 31969 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.153s
W20260709 13:12:00.840471 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 109593us
I20260709 13:12:00.725060 31804 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.763273 32116 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.794435 32101 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.672224 31875 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.742038 31986 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.742138 31989 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.880239 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.897946 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.839779 32099 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.823808 31946 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.764246 32058 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:12:00.779497 32113 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.903043 30736 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:00.842073 32045 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.774842 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:00.881742 31854 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.687844 31920 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:00.879885 32055 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.902483 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 60812.2us
I20260709 13:12:00.886233 31804 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.914264 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:00.939045 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:00.882891 32135 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.896042 32116 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:00.931533 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51313.9us
I20260709 13:12:00.909915 31946 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:00.902077 31986 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:00.939476 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.939749 30037 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.915934 32041 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.928400 32045 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.946208 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.960005 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:00.960359 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.960881 30112 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.929738 32094 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.916484 30107 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:00.962092 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:00.938926 32084 consensus_meta.cc:287] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.010s
I20260709 13:12:00.934526 31854 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.940543 31804 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.964054 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.931607 31893 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:12:00.911165 31989 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:00.964846 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 82686.6us
I20260709 13:12:00.945386 32116 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.956946 31946 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.966534 32128 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.975066 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.975541 31920 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:00.975713 32041 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.970700 31854 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:00.978020 32140 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:12:00.973129 32084 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:00.978930 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:00.980154 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.962644 32099 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.957479 32144 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:00.988339 32142 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:00.988435 32121 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:00.989425 32136 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:12:00.995791 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:00.964675 32102 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:00.997385 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.977504 31986 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:00.965315 31868 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.009548 30112 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.019253 30037 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.038968 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:01.003777 32093 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.034602 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.045068 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.011942 31920 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.049011 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.020006 32144 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:01.055330 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 115678us
I20260709 13:12:01.021111 32121 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:01.046890 31868 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.067351 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.067401 32121 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.068622 32121 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:12:01.069063 29984 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:12:01.069522 29984 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:12:01.069800 29984 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:01.069896 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.057615 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.068893 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.072636 30037 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:01.074857 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.076056 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:01.076269 30150 leader_election.cc:336] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.504s (SENT)
W20260709 13:12:01.077170 30150 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.225s (SENT)
I20260709 13:12:01.040024 32094 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.087910 30032 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:12:01.158542 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82544.5us
W20260709 13:12:01.121661 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.164868 30109 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:01.166615 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.167455 30109 raft_consensus.cc:2376] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3. Re-sending same reply.
I20260709 13:12:01.168818 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.169667 30109 raft_consensus.cc:2376] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5. Re-sending same reply.
I20260709 13:12:01.052824 32100 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.170800 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:01.065850 32114 consensus_meta.cc:287] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:12:01.181620 30112 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:01.182799 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.187642 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.189361 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.190140 30112 raft_consensus.cc:2376] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3. Re-sending same reply.
I20260709 13:12:01.191365 30112 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:01.194212 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.195067 30178 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:01.195901 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:01.196798 30178 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:01.187642 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:01.198118 32122 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.560s	user 0.004s	sys 0.000s
I20260709 13:12:01.198662 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:01.083000 32041 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.199759 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:01.200500 30187 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:01.201712 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.202454 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.196663 31804 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.051970 31965 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:01.057202 32099 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.205217 30038 raft_consensus.cc:606] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.076241 31986 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.066264 32102 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.033634 32045 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.068863 31868 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.230079 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.054167 31920 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.235033 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.235400 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.251317 30110 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:01.258041 31989 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:01.256699 30183 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:01.237659 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.239292 30032 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:01.269062 32134 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:01.280285 30108 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.203301 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.083047 31875 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:01.181159 32135 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.247939 30106 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:12:01.230927 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:01.284660 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 81509us
I20260709 13:12:01.264721 31920 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:01.270182 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.273988 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.240259 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.282519 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.275833 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.291841 30110 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:01.291146 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:01.292990 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 52736.1us
I20260709 13:12:01.293215 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.294143 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.294819 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.295607 30113 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.283236 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:01.284569 30106 pending_rounds.cc:85] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 1
I20260709 13:12:01.296952 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:01.303107 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.245013 31965 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.300495 30106 pending_rounds.cc:107] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:12:01.310870 30106 raft_consensus.cc:2889] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:01.289836 31943 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.266610 32144 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.316973 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.317669 30110 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.296430 32134 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:01.299041 32093 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.301115 32102 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.305512 32135 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.306433 31920 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.325892 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.327387 30108 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:01.296234 32058 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:12:01.326099 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:01.330546 30151 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.310005 31875 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.341848 30077 leader_election.cc:400] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:01.342233 30077 leader_election.cc:403] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:01.342785 32093 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:01.324373 32102 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.331678 32152 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:01.349654 32159 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:01.350214 32159 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:01.351089 32159 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.352931 32102 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.356642 31965 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:01.357648 31946 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.359941 31946 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:01.362593 30186 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:01.324255 32153 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:01.370170 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.370944 30108 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.372988 30113 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:01.344799 32084 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.333846 31989 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:12:01.384582 30110 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:01.394191 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.395095 30110 raft_consensus.cc:2376] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4. Re-sending same reply.
I20260709 13:12:01.396026 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.397082 30110 raft_consensus.cc:2410] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:01.398963 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.400645 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.401633 30110 raft_consensus.cc:2410] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:01.394143 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.401688 30108 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:01.372545 31920 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.369318 32153 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.405759 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.406939 30113 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:01.404589 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.410460 31804 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:01.409834 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61658.9us
W20260709 13:12:01.413763 32154 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:01.416754 32084 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:01.417975 32055 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:01.418998 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79381us
I20260709 13:12:01.468349 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:01.418421 32055 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:01.428325 30109 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:01.433447 32091 consensus_meta.cc:287] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.000s
I20260709 13:12:01.394239 32134 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.438472 30108 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:12:01.408275 32153 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.439747 30113 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:01.441994 30183 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:01.449747 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:01.450896 32102 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.470623 32055 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.487699 32055 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.452224 32116 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.454090 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:01.457855 31869 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.458606 32045 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.460420 31969 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:01.461478 32143 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:01.461598 32059 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.465535 31854 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.509279 30182 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:01.466534 30740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 239) took 1297 ms. Trace:
I20260709 13:12:01.497568 31758 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:01.528046 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1133) took 1162 ms. Trace:
I20260709 13:12:01.423321 30110 raft_consensus.cc:2410] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:01.530014 30106 rpcz_store.cc:276] 0709 13:12:00.366211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.366442 (+   231us) service_pool.cc:224] Handling call
0709 13:12:01.247578 (+881136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.316266 (+ 68688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.527856 (+211590us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400046fd0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:01.527988 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025750272}
I20260709 13:12:01.475287 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.552201 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.552783 30037 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.477070 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.555788 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.557029 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.461330 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.479007 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.559701 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.560746 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.481544 30736 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEARNER]: Advancing to term 4
I20260709 13:12:01.486743 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1128) took 1135 ms. Trace:
W20260709 13:12:01.491291 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.495031 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:01.501911 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52293.5us
I20260709 13:12:01.488145 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:01.504189 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.508489 31804 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:01.561304 30034 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:12:01.572084 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.567695 30033 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:01.574491 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:01.574906 30033 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:01.575452 31921 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:01.575858 31921 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:01.576226 31921 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:01.579099 30032 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.580570 31913 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:01.581020 30106 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:12:01.582109 30106 pending_rounds.cc:85] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 1
I20260709 13:12:01.466794 32121 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:01.508566 32157 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:01.499522 31869 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.524240 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.521857 32116 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:01.513933 31969 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.518389 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:01.497331 31893 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:12:01.529299 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:01.602358 30739 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:01.466571 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.472029 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:01.534371 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:01.530701 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:01.527778 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:01.526587 30740 rpcz_store.cc:276] 0709 13:12:00.169228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.177743 (+  8515us) service_pool.cc:224] Handling call
0709 13:12:01.466301 (+1288558us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54005401d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:01.466455 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721856384}
I20260709 13:12:01.539060 30110 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:01.537379 31758 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.548611 31854 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.499883 32113 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:12:01.550175 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1232) took 1306 ms. Trace:
I20260709 13:12:01.583642 30111 rpcz_store.cc:276] 0709 13:12:00.343061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.343188 (+   127us) service_pool.cc:224] Handling call
0709 13:12:01.478618 (+1135430us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540007bf54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:01.478728 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550351104}
I20260709 13:12:01.618462 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.619341 30185 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.585760 30034 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:01.585875 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.589524 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:01.621239 30184 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:01.515916 32149 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:01.592054 30037 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.592734 30106 pending_rounds.cc:107] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:12:01.593753 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:01.598145 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105254us
I20260709 13:12:01.606341 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.626219 30183 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.597275 30105 raft_consensus.cc:2376] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5. Re-sending same reply.
I20260709 13:12:01.626878 30106 raft_consensus.cc:2889] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:01.609138 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78535.2us
I20260709 13:12:01.596156 31804 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.612941 30110 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:01.638111 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44459us
I20260709 13:12:01.639629 30110 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:01.631556 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:01.636415 30036 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:01.639163 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.640158 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.640833 30184 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.617165 30035 rpcz_store.cc:276] 0709 13:12:00.243283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.243401 (+   118us) service_pool.cc:224] Handling call
0709 13:12:00.271651 (+ 28250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.272097 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.272139 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.281655 (+  9516us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.222031 (+940376us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b18003376c0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:01.448313 (+226282us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.448365 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.448441 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.549879 (+101438us) raft_consensus.cc:1685] finished
0709 13:12:01.549899 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.550114 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8647,"raft.queue_time_us":102,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10022,"spinlock_wait_cycles":3546496,"thread_start_us":226047,"threads_started":1,"wal-append.queue_time_us":1240865}
I20260709 13:12:01.637244 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:01.607579 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.642248 30180 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.611218 30736 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:01.645658 30153 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:01.648841 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.647712 30110 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:12:01.596340 32121 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.596978 31969 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:01.651583 32167 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.610240 32045 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:01.655220 31986 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:01.706502 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 43774.3us
I20260709 13:12:01.707633 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:01.708990 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 60239.6us
I20260709 13:12:01.711470 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.657224 32160 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:01.657518 31869 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.614454 31978 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:01.657853 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 72097.2us
I20260709 13:12:01.686180 30032 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:01.695667 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:01.667862 30183 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.611171 32157 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:01.637485 32149 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:01.635367 31948 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.718920 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.606972 32101 consensus_queue.cc:1059] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:12:01.705724 31989 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.718981 30037 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.660902 32152 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:01.740865 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:01.753829 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46322.9us
I20260709 13:12:01.652127 32144 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.754778 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.755777 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:01.729599 31875 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.766288 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.772972 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:01.773423 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:01.774431 32120 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.774947 31869 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:01.775249 31920 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:01.775873 31920 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:01.775579 31869 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.776911 31920 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.755218 30113 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:01.785503 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 141378us
I20260709 13:12:01.786747 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:01.786037 30037 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:01.748894 31913 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:01.725651 31893 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:12:01.773909 32150 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:01.778888 31869 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.759683 32160 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:01.759717 32152 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.760022 31978 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:01.772054 31943 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.782193 32145 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.803469 30185 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:01.782538 32041 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.808058 30153 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:01.761236 32153 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.798259 32165 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.798745 32149 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.853679 32174 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.854444 31978 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:01.761538 31969 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:01.857198 32139 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.857649 32090 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:01.861884 32160 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:01.862622 32169 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:12:01.863945 30180 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.797925 32150 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:01.799940 32152 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.787623 32151 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:12:02.013986 32143 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:02.014405 32143 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:01.799448 31804 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.805287 31803 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:01.863967 32172 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:12:01.983503 30184 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:01.876219 31875 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.981683 31943 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:02.003180 32153 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:01.892026 32045 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.876231 32165 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.003789 32149 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:02.005266 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:02.058187 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 53053.5us
I20260709 13:12:02.006537 30183 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:02.010141 32150 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:02.011103 32102 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:01.876305 32093 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.019579 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:02.021960 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 214014us
I20260709 13:12:01.869867 31869 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:01.878481 32116 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.029611 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36690 (request call id 15) took 1554 ms. Trace:
I20260709 13:12:02.060438 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:02.159619 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 99286.3us
I20260709 13:12:02.160559 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:02.061547 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.112398 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.074425 32058 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.894032 32157 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.168887 30110 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:01.978443 32174 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.050117 32165 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.072914 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:02.170531 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97699.9us
W20260709 13:12:02.103204 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.134006 32093 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.134183 31869 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.041734 31875 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.054127 32045 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.189929 32159 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:02.190448 32159 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:02.192019 32045 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:02.194304 32178 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:02.047276 31943 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.058966 32143 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.198124 32143 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:02.198415 31943 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.171587 31904 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.105118 32167 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.104851 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:02.015381 32090 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.109413 32121 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.065124 31921 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.077234 32153 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:12:02.130286 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1834) took 1062 ms. Trace:
I20260709 13:12:02.150462 32144 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.154721 32173 log.cc:927] Time spent T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:12:02.158051 30038 rpcz_store.cc:276] 0709 13:12:00.465033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.465192 (+   159us) service_pool.cc:224] Handling call
0709 13:12:02.018751 (+1553559us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54003e17d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60cd853 00007fcbeb09b60a 00007fcbe46217d4 00007fcbe4621762 00007fcbe4621691 00007fcbe462160c 00007fcbe46208c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:02.018848 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700126592}
I20260709 13:12:02.167623 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:02.219658 30105 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:02.175885 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:02.229998 30184 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:02.178762 30185 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:02.178690 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.164608 31944 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.183166 32174 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.185454 32192 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.187542 31803 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:02.187999 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:02.189770 31875 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.202003 32167 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.208642 32152 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.191443 32159 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.165176 32058 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.219651 30180 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:02.214593 30181 rpcz_store.cc:276] 0709 13:12:01.067866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.069539 (+  1673us) service_pool.cc:224] Handling call
0709 13:12:01.069838 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.087781 (+ 17943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.087812 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.201633 (+113821us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.504276 (+302643us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:01.504324 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.504392 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.115361 (+610969us) raft_consensus.cc:1685] finished
0709 13:12:02.130050 (+ 14689us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.130223 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22238,"raft.queue_time_us":115191,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":301819,"threads_started":1,"wal-append.queue_time_us":433986}
I20260709 13:12:02.239166 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.246097 30113 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:02.205946 31920 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:12:02.256855 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 241715us
I20260709 13:12:02.250741 30732 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:02.262171 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:02.263185 30187 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:12:02.270318 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1704) took 1100 ms. Trace:
I20260709 13:12:02.270781 30113 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:02.270798 30104 rpcz_store.cc:276] 0709 13:12:01.169970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.202664 (+ 32694us) service_pool.cc:224] Handling call
0709 13:12:01.229686 (+ 27022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.236672 (+  6986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.236703 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:01.236753 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.236804 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.270057 (+1033253us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b540022db54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:02.270117 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.270250 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15602048}
W20260709 13:12:02.273166 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 107505us
I20260709 13:12:02.240197 32144 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.281613 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:02.252965 31803 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:02.255992 32135 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.260988 32058 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.288131 30112 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:02.306347 32150 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.307271 32167 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:02.290709 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:02.292642 31803 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.294394 31921 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.295074 32174 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:02.246712 32192 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.317131 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.318112 30736 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:02.309926 32159 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:02.325351 30736 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:02.363610 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45602.3us
I20260709 13:12:02.366192 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:02.370664 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.291031 31989 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:12:02.387140 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:02.406785 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:02.407689 31875 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:12:02.324532 31904 consensus_queue.cc:1059] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:12:02.408141 31875 raft_consensus.cc:1068] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:02.408658 31904 raft_consensus.cc:3055] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.409051 31904 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:02.409860 31904 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.411026 31904 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.314783 32151 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:02.415467 32109 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:02.416071 32109 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:02.420472 32192 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.425752 30181 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:02.425541 32199 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:02.427695 30181 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:02.434432 31869 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.436460 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.436805 32152 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.335762 32167 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:12:02.443392 32041 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.444092 32041 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.389698 32198 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:02.392234 32055 consensus_meta.cc:287] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.904s	user 0.012s	sys 0.000s
I20260709 13:12:02.393567 32113 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.394727 32174 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.395989 32150 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.396814 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:02.396975 32093 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.591167 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1840) took 1518 ms. Trace:
I20260709 13:12:02.591840 30182 rpcz_store.cc:276] 0709 13:12:01.072537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.181532 (+108995us) service_pool.cc:224] Handling call
0709 13:12:01.418647 (+237115us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b5800003f98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:01.418839 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.509838 (+ 90999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.590887 (+1081049us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b540016f654. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:02.591091 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300661888}
I20260709 13:12:02.316368 32102 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:02.484602 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:02.502521 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:02.578732 30180 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:02.582921 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1835) took 1514 ms. Trace:
I20260709 13:12:02.399310 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:02.594336 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 91916.4us
I20260709 13:12:02.594983 30186 rpcz_store.cc:276] 0709 13:12:01.068146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.071068 (+  2922us) service_pool.cc:224] Handling call
0709 13:12:01.180038 (+108970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.363250 (+183212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.582422 (+1219172us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400297cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:02.582681 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419150208}
I20260709 13:12:02.578248 31854 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.609614 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:02.606870 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:02.417198 32109 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.628757 31875 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.608147 32102 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.634824 32102 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.591436 32149 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:02.636003 32149 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.609203 32112 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:02.636998 32112 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.638468 32149 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.639248 32112 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.646919 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.648106 30738 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 2: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:02.648653 30738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 244) took 1119 ms. Trace:
I20260709 13:12:02.650772 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1838) took 1578 ms. Trace:
I20260709 13:12:02.651521 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.652269 30033 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
W20260709 13:12:02.655536 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.657658 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.651185 30179 rpcz_store.cc:276] 0709 13:12:01.072013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.072123 (+   110us) service_pool.cc:224] Handling call
0709 13:12:01.072437 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:01.282003 (+209566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.282044 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:01.282647 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:12:01.529034 (+246387us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18003ca6c0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:01.660946 (+131912us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.661004 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.650448 (+989444us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400266bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:02.650505 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.650548 (+    43us) raft_consensus.cc:1685] finished
0709 13:12:02.650559 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.650701 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8361,"raft.queue_time_us":5208,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13919,"spinlock_wait_cycles":464201344,"thread_start_us":131727,"threads_started":1,"wal-append.queue_time_us":457092}
I20260709 13:12:02.649035 30738 rpcz_store.cc:276] 0709 13:12:01.529273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.537374 (+  8101us) service_pool.cc:224] Handling call
0709 13:12:02.646701 (+1109327us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:02.648569 (+  1868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25633152}
I20260709 13:12:02.674165 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:02.599572 32055 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:02.705447 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.620637 32144 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.675915 32166 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.626308 32150 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:12:02.708683 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.679389 31875 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:12:02.587554 32113 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.738722 30182 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:02.678741 32198 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:02.708673 32148 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:02.742080 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 85060.7us
I20260709 13:12:02.626680 31854 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:02.741989 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 67920.5us
W20260709 13:12:02.751080 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 70668.6us
I20260709 13:12:02.784948 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:02.718961 32151 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.718760 32145 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:02.799978 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.809816 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:02.810938 30037 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:02.812593 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:02.818142 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.818974 30030 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:02.744822 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:02.803144 30733 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:02.825743 32165 consensus_meta.cc:287] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:12:02.826251 32165 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.827515 30741 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:02.828558 32165 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.744341 30029 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:12:02.798360 32041 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:02.831699 30181 raft_consensus.cc:2410] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:02.784314 32144 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:02.832890 32144 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.790406 32148 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.834035 32149 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.835033 32149 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.835238 32148 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.835376 32149 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:02.790580 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:02.836745 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:02.836627 32149 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:02.837781 32205 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:12:02.842846 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.840286 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.840356 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.844887 30037 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:12:02.845455 32206 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:12:02.858080 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1719) took 1068 ms. Trace:
I20260709 13:12:02.858510 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.859447 32113 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.858536 30107 rpcz_store.cc:276] 0709 13:12:01.789951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.272733 (+482782us) service_pool.cc:224] Handling call
0709 13:12:02.286312 (+ 13579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.314751 (+ 28439us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:02.314789 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.327752 (+ 12963us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.661288 (+333536us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:02.661326 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.661388 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.857859 (+196471us) raft_consensus.cc:1685] finished
0709 13:12:02.857883 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.858022 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23616,"raft.queue_time_us":27807,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":45247,"thread_start_us":70342,"threads_started":1,"wal-append.queue_time_us":277034}
I20260709 13:12:02.847651 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:02.861987 30104 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.796500 32159 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:02.837337 30035 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:02.867080 31854 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:02.849965 32175 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.789s	user 0.009s	sys 0.002s
I20260709 13:12:02.859651 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.838215 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:02.853477 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:02.872488 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.743126 32166 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:02.845736 32149 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.876627 30104 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:02.893301 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:02.894088 30104 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:02.896742 30035 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:02.887089 32159 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:02.888629 32144 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:02.870316 30151 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:02.797636 32151 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:02.801020 32145 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:02.901075 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 295017us
I20260709 13:12:02.892510 31854 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:02.903000 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:02.900919 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:02.916153 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:02.920171 30031 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:02.906246 32152 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:02.910935 31854 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.914561 32204 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:02.914259 32041 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.919533 32093 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.970273 31875 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:12:02.987143 30034 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:02.926776 32152 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.925505 32144 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.968948 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50696 (request call id 264) took 1296 ms. Trace:
I20260709 13:12:03.039100 30183 rpcz_store.cc:276] 0709 13:12:01.672561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.731312 (+ 58751us) service_pool.cc:224] Handling call
0709 13:12:02.968625 (+1237313us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54001eafd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:02.968847 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564504960}
I20260709 13:12:02.922096 32200 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:12:02.930488 31854 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.011320 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:02.963339 32148 raft_consensus.cc:476] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:12:03.025292 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1266) took 1475 ms. Trace:
W20260709 13:12:02.977921 32058 consensus_meta.cc:287] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.001s
I20260709 13:12:03.029000 32101 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:03.029855 31875 raft_consensus.cc:1068] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:12:03.043804 32212 log.cc:927] Time spent T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:12:03.045053 32179 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.972s	user 0.006s	sys 0.005s
I20260709 13:12:02.978612 32204 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:02.929584 32211 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:12:03.148123 30153 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:03.014657 31758 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:03.060423 32213 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:12:03.063681 30105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 1718) took 1274 ms (client timeout 1557 ms). Trace:
I20260709 13:12:03.150115 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:03.066787 32144 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.038239 32152 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.068536 32145 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.069214 32166 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:03.174714 32166 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:03.070513 32209 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:03.052918 30034 rpcz_store.cc:276] 0709 13:12:01.550299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.986634 (+1436335us) service_pool.cc:224] Handling call
0709 13:12:02.986960 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.024960 (+ 38000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.025216 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.176765 30034 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:03.072085 32151 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.177352 32135 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:12:03.073544 32198 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.177814 32135 raft_consensus.cc:1068] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:03.177896 32198 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.078727 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:03.179759 30113 raft_consensus.cc:2376] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5. Re-sending same reply.
I20260709 13:12:03.180980 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.182281 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.082401 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:03.183374 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 101100us
I20260709 13:12:03.084151 30033 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:03.084308 30106 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.084926 32093 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:02.972601 32041 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:02.972316 32159 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.092271 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:03.105952 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.213701 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.214792 30183 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:03.106148 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.144378 32058 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:03.107187 32186 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 1.049s	user 0.007s	sys 0.013s
I20260709 13:12:03.107686 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.114015 31948 consensus_queue.cc:1059] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:03.120150 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.220471 30104 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:03.221552 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.120476 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:03.120828 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:03.226717 30736 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.130146 32187 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:03.133374 32112 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.134004 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1260) took 1626 ms. Trace:
I20260709 13:12:03.135313 32165 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:03.139513 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:03.150524 30105 rpcz_store.cc:269] 0709 13:12:01.789568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.006264 (+216696us) service_pool.cc:224] Handling call
0709 13:12:03.063382 (+1057118us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54002b4154. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:03.063587 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340528000}
I20260709 13:12:03.246927 30179 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
W20260709 13:12:03.164548 29931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 241) took 13055 ms (client timeout 15000 ms). Trace:
I20260709 13:12:03.247915 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.164968 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:03.168712 32117 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:03.161128 32102 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:03.171099 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.171566 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:03.258682 30111 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.259720 30112 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:03.199054 30033 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:03.216372 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.262048 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.262771 30184 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:03.106953 32195 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.146798 32101 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.150576 32192 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:03.149650 31904 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:03.207464 32151 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.207858 32145 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.245198 30036 rpcz_store.cc:276] 0709 13:12:01.507119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.616245 (+109126us) service_pool.cc:224] Handling call
0709 13:12:01.616517 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.640634 (+ 24117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.133655 (+1493021us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b540010e5d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:03.133919 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6169472}
I20260709 13:12:03.212343 32135 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.256110 30187 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.215793 32091 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:03.253958 32143 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.214159 31758 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.244251 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:03.269419 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 119362us
I20260709 13:12:03.275132 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.249226 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.276762 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:03.265107 30112 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:03.333159 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1167) took 1891 ms. Trace:
I20260709 13:12:03.333968 30108 rpcz_store.cc:276] 0709 13:12:01.441718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.614800 (+173082us) service_pool.cc:224] Handling call
0709 13:12:01.660050 (+ 45250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.668946 (+  8896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.668979 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.717914 (+ 48935us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.773820 (+ 55906us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.773868 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.773944 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.106374 (+1332430us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:03.329551 (+223177us) raft_consensus.cc:1685] finished
0709 13:12:03.329573 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.333071 (+  3498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8482,"raft.queue_time_us":9026,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9790,"spinlock_wait_cycles":14090112,"thread_start_us":5135,"threads_started":1,"wal-append.queue_time_us":147221}
W20260709 13:12:03.341883 30001 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.557s (SENT) [suppressed 30 similar messages]
W20260709 13:12:03.296526 32223 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:12:03.272717 32102 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.261475 32112 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.214558 32093 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.316725 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:03.242969 32139 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.253648 32117 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:03.267416 32174 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.257990 32120 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.281376 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.389465 32198 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.279727 32195 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.321252 32091 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:03.247802 29931 rpcz_store.cc:269] 0709 13:11:50.109483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.109674 (+   191us) service_pool.cc:224] Handling call
0709 13:11:50.118069 (+  8395us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b5400040790. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faf0b2 00007fcbebf28a89 00007fcbebec0da6 00007fcbebe92088 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc
0709 13:12:03.164477 (+13046408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:00.060764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:00.169237 (+108473us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:00.176911 (+  7674us) write_op.cc:435] Acquired schema lock
0709 13:12:00.178694 (+  1783us) tablet.cc:662] Decoding operations
0709 13:12:00.203092 (+ 24398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:00.203148 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:00.203181 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:00.203941 (+   760us) tablet.cc:701] Row locks acquired
0709 13:12:00.203960 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:00.204103 (+   143us) write_op.cc:270] Start()
0709 13:12:00.204221 (+   118us) write_op.cc:276] Timestamp: P: 1783602720204055 usec, L: 0
0709 13:12:00.204243 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:00.219000 (+ 14757us) log.cc:844] Serialized 3562 byte log entry
0709 13:12:00.531507 (+312507us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.762845 (+231338us) write_op.cc:301] APPLY: starting
0709 13:12:00.762931 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.763131 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.792971 (+ 29840us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.990316 (+197345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.990574 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:12:00.990631 (+    57us) write_op.cc:312] APPLY: finished
0709 13:12:00.990904 (+   273us) log.cc:844] Serialized 65 byte log entry
0709 13:12:00.991086 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.991207 (+   121us) write_op.cc:454] Released schema lock
0709 13:12:00.991267 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.991632 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.991660 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31176,"reported_tablets":18,"spinlock_wait_cycles":11606400,"child_traces":[["op",{"apply.queue_time_us":231042,"apply.run_cpu_time_us":4980,"apply.run_wall_time_us":228787,"num_ops":8,"prepare.queue_time_us":235199,"prepare.run_cpu_time_us":17676,"prepare.run_wall_time_us":246629,"raft.queue_time_us":157463,"raft.run_cpu_time_us":36268,"raft.run_wall_time_us":123420,"replication_time_us":326990,"spinlock_wait_cycles":76544,"thread_start_us":455162,"threads_started":4,"wal-append.queue_time_us":123664,"wal-append.run_cpu_time_us":9886,"wal-append.run_wall_time_us":1678268}]]}
I20260709 13:12:03.309003 32211 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.310992 30111 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:03.448540 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:03.537983 30183 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:03.450275 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 173563us
I20260709 13:12:03.539790 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:03.289028 32192 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.317906 32151 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.316665 32145 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.468773 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.312001 30736 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:03.271348 32204 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.331848 31758 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.613178 31758 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.332298 32143 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.492532 30113 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:03.326077 32135 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.613830 31913 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:03.614444 31913 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.615279 32143 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.616940 31913 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:03.606914 31920 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.536336 32091 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.489295 32198 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:03.608700 32041 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:03.614032 32222 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:12:03.460474 32148 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:03.618604 31854 consensus_meta.cc:287] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:12:03.710749 31854 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.571106 32211 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.620420 30037 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:03.452855 31804 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:12:03.563776 32220 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.609040 32165 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.604002 31893 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:03.645943 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:03.759022 30186 raft_consensus.cc:2368] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:03.669480 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:03.621994 32223 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:12:03.660818 32228 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:12:03.763360 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:03.702423 32227 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:03.479276 32174 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.541210 32120 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:03.733981 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:03.777318 30734 raft_consensus.cc:2368] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3.
W20260709 13:12:03.777580 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 43707.4us
I20260709 13:12:03.778396 30002 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:03.751242 30178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.007s	sys 0.029s
I20260709 13:12:03.703737 31920 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.734480 30183 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
W20260709 13:12:03.757179 30077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.014s
I20260709 13:12:03.757767 32246 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.702243 32198 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.672808 32058 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:03.468287 32139 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.620631 32117 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:03.773607 30705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.016s
W20260709 13:12:03.997793 30077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.000s	sys 0.021s
W20260709 13:12:03.998592 30705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.005s	sys 0.021s
I20260709 13:12:03.825014 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1173) took 1437 ms. Trace:
I20260709 13:12:03.999912 30106 rpcz_store.cc:276] 0709 13:12:02.387305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.407862 (+ 20557us) service_pool.cc:224] Handling call
0709 13:12:03.083834 (+675972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.185757 (+101923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.824779 (+639022us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54002b4150. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:03.824936 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553895680}
W20260709 13:12:03.866266 30150 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.62.190:37953, user_credentials={real_user=slave}} blocked reactor thread for 52229.9us
I20260709 13:12:03.828408 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1270) took 1021 ms. Trace:
I20260709 13:12:04.003216 30038 rpcz_store.cc:276] 0709 13:12:02.806529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.808053 (+  1524us) service_pool.cc:224] Handling call
0709 13:12:02.808468 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.924303 (+115835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.924336 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.924383 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:02.924414 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.828160 (+903746us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540011ce54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:03.828219 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.828358 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265943936}
I20260709 13:12:03.815794 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1179) took 1230 ms. Trace:
I20260709 13:12:03.894480 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1177) took 1413 ms. Trace:
I20260709 13:12:04.008091 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:04.006876 30107 rpcz_store.cc:276] 0709 13:12:02.480846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.860455 (+379609us) service_pool.cc:224] Handling call
0709 13:12:02.860771 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.861122 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:02.966013 (+104891us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.044793 (+ 78780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.045473 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.045637 (+   164us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:03.058892 (+ 13255us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.059148 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.059242 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.894138 (+834896us) raft_consensus.cc:1685] finished
0709 13:12:03.894172 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.894390 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12903,"prepare.queue_time_us":251340,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":11020,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":15064,"thread_start_us":162435,"threads_started":2,"wal-append.queue_time_us":154649}
W20260709 13:12:03.999244 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 805779us
I20260709 13:12:03.778587 30186 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:12:03.827903 30181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1670) took 1383 ms (client timeout 1842 ms). Trace:
W20260709 13:12:04.012249 30181 rpcz_store.cc:269] 0709 13:12:02.445015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.445233 (+   218us) service_pool.cc:224] Handling call
0709 13:12:03.827611 (+1382378us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002fa654. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:03.827819 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546149120}
I20260709 13:12:04.014142 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.013991 32041 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.014079 32233 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:12:04.018258 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1723) took 1091 ms. Trace:
I20260709 13:12:04.019440 32041 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.017786 32117 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.020593 30104 rpcz_store.cc:276] 0709 13:12:02.926432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.224870 (+298438us) service_pool.cc:224] Handling call
0709 13:12:03.225259 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:03.495964 (+270705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.496011 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.563969 (+ 67958us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.917664 (+353695us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:03.946661 (+ 28997us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.946948 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.947063 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.017812 (+ 70749us) raft_consensus.cc:1685] finished
0709 13:12:04.017835 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.018140 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29383,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":466148,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":212,"thread_start_us":490781,"threads_started":2,"wal-append.queue_time_us":391000}
I20260709 13:12:04.023326 32041 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:03.923930 32135 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.951700 31854 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.025626 32101 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.026791 32101 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:03.950377 32249 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:12:03.987910 32055 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.924409 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1278) took 1013 ms. Trace:
I20260709 13:12:04.016320 32139 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.030144 31904 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:04.030833 31904 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.033746 32235 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:03.904196 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1633) took 1057 ms. Trace:
I20260709 13:12:04.035885 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:04.040103 30001 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.037s
W20260709 13:12:04.040665 30001 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.037s
W20260709 13:12:04.041123 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 699249us
I20260709 13:12:04.035683 30030 rpcz_store.cc:276] 0709 13:12:02.846686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.885576 (+ 38890us) service_pool.cc:224] Handling call
0709 13:12:02.885952 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:02.897586 (+ 11634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.897627 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:02.900690 (+  3063us) log.cc:844] Serialized 52 byte log entry
0709 13:12:03.151522 (+250832us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:03.151578 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.151649 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.903868 (+752219us) raft_consensus.cc:1685] finished
0709 13:12:03.903887 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.904098 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15835,"raft.queue_time_us":11957,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6114,"thread_start_us":218242,"threads_started":1,"wal-append.queue_time_us":312390}
I20260709 13:12:03.753612 32145 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.054674 30181 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:04.004946 30110 rpcz_store.cc:276] 0709 13:12:02.585960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.922486 (+336526us) service_pool.cc:224] Handling call
0709 13:12:02.922808 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:03.227067 (+304259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.227101 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.229876 (+  2775us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.334479 (+104603us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:03.334528 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.334600 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.815554 (+480954us) raft_consensus.cc:1685] finished
0709 13:12:03.815577 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.815722 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":835,"raft.queue_time_us":9685,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":18360,"thread_start_us":407184,"threads_started":2,"wal-append.queue_time_us":521990}
W20260709 13:12:04.002393 30178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.007s	sys 0.032s
I20260709 13:12:04.059144 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:03.973600 32152 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:12:04.067077 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:04.015292 32230 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:12:04.084664 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:03.966990 32112 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:04.063061 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 284735us
I20260709 13:12:04.091573 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:04.065475 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:03.824105 29933 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:04.068665 30110 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:03.853127 32068 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.097052 32068 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.071612 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:04.071798 32252 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.073065 32103 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.072712 31869 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.073539 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.819892 32093 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.820940 32211 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.778971 32151 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.819114 32192 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:03.817667 32120 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:03.885233 32232 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.034448 32235 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.085320 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:04.097645 32068 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.055804 32199 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.102041 32145 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:03.764449 32165 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.100384 29933 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:12:04.124933 29933 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:04.098932 32252 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.089037 32152 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.068264 32135 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.029873 32055 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.061249 31904 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.052129 32246 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.085804 32139 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:04.112468 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.128741 29933 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 3, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 34f51764a89048468a6faa21020812b0 (127.28.62.129), no longer has a pending config: VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129), VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130), VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131), VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:12:04.089326 32101 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:04.143544 32101 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:04.143724 29933 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.107213 32103 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.147305 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.147639 32103 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.148478 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:04.149245 30033 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.153333 32242 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.101229 32041 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:04.120186 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:04.117838 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.156431 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.111711 32112 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.122714 32120 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:04.147423 32151 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.106267 32204 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.159548 32204 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.162065 32204 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:04.162580 32204 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.106060 32091 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.157860 32112 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.159457 32151 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.154136 32242 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:03.764703 32220 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.109627 31869 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.144892 32101 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.120518 32232 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.192734 30036 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:04.330492 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.390120 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.029881 30029 rpcz_store.cc:276] 0709 13:12:02.911113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.914176 (+  3063us) service_pool.cc:224] Handling call
0709 13:12:02.931192 (+ 17016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.984170 (+ 52978us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:03.333887 (+349717us) log.cc:844] Serialized 14 byte log entry
0709 13:12:03.774851 (+440964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:03.785682 (+ 10831us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:03.862769 (+ 77087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.901417 (+ 38648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.915358 (+ 13941us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39208,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6018,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":20741,"thread_start_us":578409,"threads_started":2,"wal-append.queue_time_us":312707}
W20260709 13:12:04.301715 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.157234 30183 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:04.165138 29933 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:04.323732 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1672) took 1877 ms (client timeout 1600 ms). Trace:
I20260709 13:12:04.556984 30106 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:04.191896 30185 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:04.211793 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 92002.5us
I20260709 13:12:04.592384 29933 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to <none>, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:04.130674 32093 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.595295 29933 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.366307 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 1735) took 1300 ms. Trace:
I20260709 13:12:04.294075 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43022 (request call id 571) took 1494 ms. Trace:
W20260709 13:12:04.428548 32213 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 1.262s	user 0.016s	sys 0.000s
I20260709 13:12:04.616892 30033 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:04.390043 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:04.607203 30112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.036s
I20260709 13:12:04.605710 30741 rpcz_store.cc:276] 0709 13:12:02.799482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.799678 (+   196us) service_pool.cc:224] Handling call
0709 13:12:04.293806 (+1494128us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54005d02d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:04.293992 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60796672}
W20260709 13:12:04.619624 30112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.013s	sys 0.036s
I20260709 13:12:04.621073 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.239699 32041 raft_consensus.cc:2764] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:12:04.663152 32058 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.012s	sys 0.025s
I20260709 13:12:04.625566 30113 rpcz_store.cc:276] 0709 13:12:03.066019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.182022 (+116003us) service_pool.cc:224] Handling call
0709 13:12:04.366113 (+1184091us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000d3254. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:04.366229 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685302528}
I20260709 13:12:04.212054 32103 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.190392 32246 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.175449 32145 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.431068 32102 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.432624 32144 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.622201 31913 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.365828 32211 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.327090 32199 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.292941 32165 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:04.630759 30152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.004s
W20260709 13:12:04.748322 30152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.005s
I20260709 13:12:04.631466 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:04.730161 32213 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:04.638989 30739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 247) took 1519 ms. Trace:
I20260709 13:12:04.640018 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1273) took 1832 ms. Trace:
I20260709 13:12:04.386694 32187 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:04.644251 30104 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:04.511334 32152 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:04.371109 32235 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.299043 32198 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.363714 32139 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.658403 30105 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:04.430469 32117 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.273053 32055 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.327584 32135 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.433204 32195 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.459187 31920 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:04.660115 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.029s
W20260709 13:12:04.780756 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.029s
W20260709 13:12:04.781368 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 720601us
W20260709 13:12:04.784375 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.427462 32192 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.429412 32252 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.273342 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 413) took 1609 ms. Trace:
I20260709 13:12:04.662442 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:04.680553 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.758335 32084 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.768530 32144 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.367820 32150 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:04.592001 30182 rpcz_store.cc:269] 0709 13:12:02.446432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.606514 (+160082us) service_pool.cc:224] Handling call
0709 13:12:04.323481 (+1716967us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002675d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:04.323642 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290612608}
I20260709 13:12:04.163061 32204 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.739528 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.742828 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.743779 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:04.729979 32058 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.012s	sys 0.025s
I20260709 13:12:04.211359 31893 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.751883 30739 rpcz_store.cc:276] 0709 13:12:03.119743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.119932 (+   189us) service_pool.cc:224] Handling call
0709 13:12:03.122083 (+  2151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.322973 (+200890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.323026 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:03.323116 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:03.323167 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.638702 (+1315535us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400617bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:04.638764 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.638919 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461353216}
I20260709 13:12:04.752779 30032 rpcz_store.cc:276] 0709 13:12:02.807519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.811757 (+  4238us) service_pool.cc:224] Handling call
0709 13:12:02.812111 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.839481 (+ 27370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.839512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.839558 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:02.839597 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.639789 (+1800192us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54003430d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:04.639838 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.639959 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62459136}
I20260709 13:12:04.761833 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.778404 32198 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.743443 32145 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.290957 32090 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.741271 32103 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.746882 31913 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.861492 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.427284 31986 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.835289 30029 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:04.791258 32102 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.769345 32262 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.748615 32211 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.769443 32259 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.750581 32199 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.861598 32090 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:04.834209 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.783788 32135 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.890722 30182 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:04.891654 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.892786 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.834770 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.893850 30034 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:04.894686 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.895810 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.896824 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:04.841951 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 179568us
I20260709 13:12:04.896369 32135 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.850746 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.898885 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.899638 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.899878 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.833480 32041 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.900411 30107 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:04.900662 32041 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.901198 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.901801 30107 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:04.902582 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.902760 32041 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.900426 30180 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:04.903586 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.854180 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.904114 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:04.904578 30112 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:04.854964 32278 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:04.905546 32278 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.791005 32091 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.856863 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.909224 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.910017 30032 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:04.910735 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.855738 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.859684 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.911986 30111 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:04.860802 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:04.913082 30106 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:04.761806 32187 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.792147 32195 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:04.913975 32195 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.915311 32187 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:04.916272 32195 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.780754 32139 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.916806 32187 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:04.826185 32150 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:04.841821 32204 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.843643 32246 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.920100 32150 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.920534 32246 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.921216 32150 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.922684 32246 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.918649 32139 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.924118 32139 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:04.760629 30178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.017s	sys 0.025s
I20260709 13:12:04.795667 32192 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.925704 32187 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.926481 32192 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.852593 32271 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.792480 30733 rpcz_store.cc:276] 0709 13:12:02.664388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.674704 (+ 10316us) service_pool.cc:224] Handling call
0709 13:12:02.732104 (+ 57400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.820856 (+ 88752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.273041 (+1452185us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5400650c54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:04.273246 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162517376}
I20260709 13:12:04.927212 32271 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.927836 32187 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.926757 30034 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:04.862135 32258 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:04.791764 32265 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.930296 32258 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.930411 32265 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:04.889600 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105505us
I20260709 13:12:04.843674 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.933347 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.933490 30704 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:04.934000 30183 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:04.932051 32271 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.934888 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.936044 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.935395 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:04.904656 30180 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.934945 32271 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:04.937776 32271 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.938057 30182 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:04.782094 32117 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.904126 30107 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:04.943495 32258 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:04.942728 32187 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.790593 32261 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.943048 30704 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:04.946789 30032 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:04.857345 32252 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:12:04.931906 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:04.949630 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1680) took 1833 ms. Trace:
I20260709 13:12:04.949973 30183 rpcz_store.cc:276] 0709 13:12:03.115753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.936941 (+1821188us) service_pool.cc:224] Handling call
0709 13:12:04.937235 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.949226 (+ 11991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.949259 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.949314 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:04.949353 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.949445 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.949575 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:04.856092 31893 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.841387 32144 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:04.940973 32271 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:04.977833 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 113295us
I20260709 13:12:04.859265 32198 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.953833 30180 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:04.945364 32261 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.832134 32084 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.994204 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 273) took 1667 ms. Trace:
I20260709 13:12:04.869668 31986 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:04.999804 30180 rpcz_store.cc:276] 0709 13:12:03.327147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.993346 (+1666199us) service_pool.cc:224] Handling call
0709 13:12:04.993669 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.993846 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.993874 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.993915 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:04.993944 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.993998 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.994141 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:04.934015 30178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.018s	sys 0.026s
W20260709 13:12:05.006387 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 107322us
I20260709 13:12:05.007241 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 274) took 1679 ms. Trace:
I20260709 13:12:05.008071 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 272) took 1681 ms. Trace:
I20260709 13:12:05.008597 30183 rpcz_store.cc:276] 0709 13:12:03.326774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.980718 (+1653944us) service_pool.cc:224] Handling call
0709 13:12:05.007588 (+ 26870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.007762 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.007790 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.007831 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.007868 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.007919 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.008019 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.008404 30180 rpcz_store.cc:276] 0709 13:12:03.327461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.004858 (+1677397us) service_pool.cc:224] Handling call
0709 13:12:05.005658 (+   800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.005833 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.005858 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.005900 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.005947 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.006024 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.007028 (+  1004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:04.950027 32151 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.011053 30034 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:12:04.977031 31869 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.004184 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:04.943091 32117 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:04.947438 32242 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:04.879014 32102 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.005483 32270 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.981302 32152 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:12:05.010910 32232 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:04.951097 32090 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:04.886294 32262 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.040565 31921 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.077536 32258 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.040975 30113 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:12:05.025218 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 114627us
I20260709 13:12:04.890002 32259 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:05.069152 32260 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:12:05.132489 32192 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:05.166585 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.214026 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 321) took 1071 ms. Trace:
I20260709 13:12:05.040103 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1850) took 1931 ms. Trace:
I20260709 13:12:05.154822 32195 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.163012 32102 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.068436 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 275) took 1738 ms. Trace:
I20260709 13:12:05.372002 30183 rpcz_store.cc:276] 0709 13:12:03.330334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.042765 (+1712431us) service_pool.cc:224] Handling call
0709 13:12:05.067716 (+ 24951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.067945 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.067982 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.068080 (+    98us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:05.068125 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.068197 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.068355 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.163012 32144 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.052073 32270 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.215335 32259 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.047061 32211 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:05.098644 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 252284us
I20260709 13:12:05.041082 31920 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:05.107170 32258 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.154295 32246 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.051267 32268 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.218128 32103 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.223918 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.039209 32204 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.343s
W20260709 13:12:05.232585 30734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 248) took 2112 ms (client timeout 1898 ms). Trace:
I20260709 13:12:05.247967 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.250808 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.258409 32278 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.264000 31969 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.283725 32112 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.292798 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 320) took 1150 ms. Trace:
I20260709 13:12:05.302155 30180 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:05.408124 30002 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.013s	sys 0.025s
W20260709 13:12:05.408586 30002 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.013s	sys 0.025s
I20260709 13:12:05.309906 32220 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:05.409081 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 531887us
I20260709 13:12:05.314059 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1860) took 2200 ms. Trace:
I20260709 13:12:05.314299 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.314774 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1731) took 2384 ms. Trace:
I20260709 13:12:05.411098 30108 rpcz_store.cc:276] 0709 13:12:02.930805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.337233 (+406428us) service_pool.cc:224] Handling call
0709 13:12:03.462445 (+125212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.478506 (+ 16061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.478560 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:03.478639 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:03.478698 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.314564 (+1835866us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b540012fa54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.314607 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.314721 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36075392}
I20260709 13:12:05.406457 30031 rpcz_store.cc:276] 0709 13:12:04.142303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.153942 (+ 11639us) service_pool.cc:224] Handling call
0709 13:12:04.154424 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:04.744417 (+589993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.744454 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:04.754420 (+  9966us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.857984 (+103564us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:04.858054 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.292145 (+434091us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400177ad4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.292230 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.292310 (+    80us) raft_consensus.cc:1685] finished
0709 13:12:05.292333 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.292695 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239706,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":1058194816,"thread_start_us":232196,"threads_started":2,"wal-append.queue_time_us":128939}
I20260709 13:12:05.316036 30181 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:12:05.316344 32091 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:05.317350 32239 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.395387 32268 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.375506 32195 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.327178 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 1737) took 1327 ms. Trace:
I20260709 13:12:05.434999 30105 rpcz_store.cc:276] 0709 13:12:03.999448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.000412 (+   964us) service_pool.cc:224] Handling call
0709 13:12:05.326910 (+1326498us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400353ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:05.327100 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390860160}
I20260709 13:12:05.328554 32166 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:05.330367 30184 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:05.438738 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 278) took 1989 ms. Trace:
I20260709 13:12:05.439275 30184 rpcz_store.cc:276] 0709 13:12:03.449515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.329526 (+1880011us) service_pool.cc:224] Handling call
0709 13:12:05.329910 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.438429 (+108519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.438668 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.337561 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:05.339198 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1842) took 2921 ms. Trace:
I20260709 13:12:05.050398 32261 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.046397 32265 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.343115 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44710 (request call id 318) took 1201 ms. Trace:
W20260709 13:12:05.139089 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 191274us
I20260709 13:12:05.452721 30036 rpcz_store.cc:276] 0709 13:12:04.141521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.147048 (+  5527us) service_pool.cc:224] Handling call
0709 13:12:05.342941 (+1195893us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54002ef9d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:05.343043 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102378752}
I20260709 13:12:05.344383 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1185) took 1336 ms. Trace:
I20260709 13:12:05.364699 30038 rpcz_store.cc:276] 0709 13:12:04.142652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.145589 (+  2937us) service_pool.cc:224] Handling call
0709 13:12:04.145939 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:04.146332 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.146363 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:04.146870 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.459623 (+312753us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:04.459674 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.459792 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.213769 (+753977us) raft_consensus.cc:1685] finished
0709 13:12:05.213792 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.213959 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2123,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":312326,"threads_started":1,"wal-append.queue_time_us":516479}
W20260709 13:12:05.208720 32068 consensus_meta.cc:287] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.078s	user 0.007s	sys 0.003s
W20260709 13:12:05.373132 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.190196 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:05.462723 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 272602us
W20260709 13:12:05.412731 30707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.001s	sys 0.037s
I20260709 13:12:05.357861 32135 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.378659 32262 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.374719 32192 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.203948 31986 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.203775 32084 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.470273 32084 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:05.470820 32084 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.471485 32192 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.472054 31920 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.472572 31920 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.473048 32084 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.050398 32145 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.077859 31921 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.474949 31920 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.468003 32058 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:05.476083 32187 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:12:05.475967 32058 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.476575 31921 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.476655 32187 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:05.345794 31913 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.438148 32166 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:05.396059 30033 raft_consensus.cc:2410] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:05.225276 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1282) took 1905 ms. Trace:
W20260709 13:12:05.397087 30734 rpcz_store.cc:269] 0709 13:12:03.120133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.120255 (+   122us) service_pool.cc:224] Handling call
0709 13:12:05.232220 (+2111965us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54001c1bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:05.232441 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264699136}
I20260709 13:12:05.371347 32113 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:05.402050 32270 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.042973 32275 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.352s
I20260709 13:12:05.408417 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 277) took 2062 ms. Trace:
I20260709 13:12:05.312059 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.313095 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.412562 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.409816 30185 rpcz_store.cc:276] 0709 13:12:03.113542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.669124 (+555582us) service_pool.cc:224] Handling call
0709 13:12:05.313852 (+1644728us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54000cc6d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:05.313999 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993481472}
I20260709 13:12:05.392700 32244 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:12:05.410758 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.319958 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1861) took 2206 ms. Trace:
I20260709 13:12:05.414330 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.416342 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.325004 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.436426 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1676) took 2321 ms. Trace:
I20260709 13:12:05.403288 31893 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.404542 32090 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.446642 30187 rpcz_store.cc:276] 0709 13:12:02.417992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.418176 (+   184us) service_pool.cc:224] Handling call
0709 13:12:02.418567 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.319841 (+901274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.338868 (+2019027us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54000ca8d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.339119 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925732736}
I20260709 13:12:05.451347 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 281) took 1376 ms. Trace:
I20260709 13:12:05.453234 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.453781 30110 rpcz_store.cc:276] 0709 13:12:04.007711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.099007 (+ 91296us) service_pool.cc:224] Handling call
0709 13:12:04.099377 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.155321 (+ 55944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.155352 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.155393 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:04.155423 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.344199 (+1188776us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b54000474d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.344235 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.344325 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128187264}
I20260709 13:12:05.454943 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.410399 32198 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.463948 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:05.462735 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 453494us
W20260709 13:12:05.377722 32277 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:12:05.425940 32220 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:05.444170 32268 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.204730 32271 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.357617 32200 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:05.482481 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 452822us
I20260709 13:12:05.485587 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.399549 32246 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.434723 32091 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.435029 32239 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:05.482860 32101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.003s	sys 0.033s
W20260709 13:12:05.715360 32101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.005s	sys 0.040s
W20260709 13:12:05.661883 32093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.023s
W20260709 13:12:05.716979 32093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.008s	sys 0.026s
W20260709 13:12:05.487397 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 454050us
W20260709 13:12:05.718984 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.720741 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.720150 30181 rpcz_store.cc:276] 0709 13:12:03.114758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.059645 (+944887us) service_pool.cc:224] Handling call
0709 13:12:05.315780 (+1256135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.414407 (+ 98627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.436113 (+ 21706us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000cc6d0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:05.436326 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888008064}
I20260709 13:12:05.721868 30185 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:05.722231 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1868) took 1618 ms. Trace:
I20260709 13:12:05.722569 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1865) took 1627 ms. Trace:
I20260709 13:12:05.722694 30181 rpcz_store.cc:276] 0709 13:12:04.103556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.721523 (+1617967us) service_pool.cc:224] Handling call
0709 13:12:05.721798 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.721956 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.721979 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.722017 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:05.722046 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.722092 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.722182 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:05.466223 30707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.001s	sys 0.038s
I20260709 13:12:05.519737 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.481588 30037 rpcz_store.cc:276] 0709 13:12:03.319653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.320226 (+   573us) service_pool.cc:224] Handling call
0709 13:12:03.320614 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.712829 (+392215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.224889 (+1512060us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400343ad4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.225187 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688510336}
I20260709 13:12:05.510200 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.734745 30038 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:05.742425 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.744243 30037 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:12:05.735634 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 324985us
I20260709 13:12:05.711572 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.735455 30034 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:05.467998 32109 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.723104 30185 rpcz_store.cc:276] 0709 13:12:04.094995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.721226 (+1626231us) service_pool.cc:224] Handling call
0709 13:12:05.721675 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.722343 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.722516 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.735461 30736 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:05.724035 30184 rpcz_store.cc:276] 0709 13:12:04.075019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.450199 (+1375180us) service_pool.cc:224] Handling call
0709 13:12:05.450627 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.450907 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.450948 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.451007 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.451057 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.451135 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.451274 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.765774 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:05.765708 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.743124 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.466008 32261 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.743352 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.775748 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.736860 30032 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:05.766607 30034 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:05.713251 32298 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:12:05.736992 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.725255 30186 rpcz_store.cc:276] 0709 13:12:03.113774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.058571 (+944797us) service_pool.cc:224] Handling call
0709 13:12:04.058891 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.652200 (+593309us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:04.779203 (+127003us) log.cc:844] Serialized 14 byte log entry
0709 13:12:04.880886 (+101683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.881360 (+   474us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:04.888886 (+  7526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.319734 (+430848us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003b1854. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.319777 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.319902 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44729,"prepare.queue_time_us":206510,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":84984,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1363698432,"thread_start_us":140143,"threads_started":2,"wal-append.queue_time_us":287589}
I20260709 13:12:05.767398 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:05.770340 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 317217us
I20260709 13:12:05.782778 30187 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:05.783198 30704 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:05.770591 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:05.784201 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:05.769894 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 50713.6us
W20260709 13:12:05.612730 32281 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.017s
I20260709 13:12:05.767840 30038 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:12:05.781883 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.785862 30032 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:12:05.781854 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1874) took 1352 ms. Trace:
I20260709 13:12:05.697520 32174 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.787038 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.478011 32287 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:05.771934 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.786391 30186 rpcz_store.cc:276] 0709 13:12:04.429802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.781047 (+1351245us) service_pool.cc:224] Handling call
0709 13:12:05.781340 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.781542 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.781567 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.781611 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:05.781641 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.781690 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.781802 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.799247 30151 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.799348 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.799527 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:05.800993 30185 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.598104 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.735529 30180 rpcz_store.cc:276] 0709 13:12:03.346055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.301142 (+1955087us) service_pool.cc:224] Handling call
0709 13:12:05.301629 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.408084 (+106455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.408345 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.689687 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.766741 32259 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:05.777225 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.539213 31986 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.822258 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.797183 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:05.797297 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.767979 32270 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.576205 32199 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:05.797821 32101 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:05.803797 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.836691 32288 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:12:05.863700 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.764577 32220 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.806622 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.463541 32068 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.810537 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.789940 32261 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.662971 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.792225 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:05.788930 32281 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.024s
I20260709 13:12:05.898829 30032 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:05.899856 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.824299 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.764735 32144 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.825724 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1864) took 2683 ms. Trace:
I20260709 13:12:05.827135 30034 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:05.911517 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.912374 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.912679 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.796809 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.790284 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.914762 30036 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:05.914948 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 124744us
I20260709 13:12:05.795188 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.768677 32198 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:05.911201 30182 rpcz_store.cc:276] 0709 13:12:03.152881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.940818 (+1787937us) service_pool.cc:224] Handling call
0709 13:12:04.948640 (+  7822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.210156 (+261516us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:05.210641 (+   485us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.611699 (+401058us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.611978 (+   279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.612043 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:05.612113 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.716410 (+104297us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18003366a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:05.808810 (+ 92400us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b18003366a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419
0709 13:12:05.825345 (+ 16535us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b5400266bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:05.825438 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.825610 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":215,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":49060,"spinlock_wait_cycles":345192320,"thread_start_us":400199,"threads_started":1,"wal-append.queue_time_us":606382}
I20260709 13:12:05.829188 30038 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
I20260709 13:12:05.921640 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.922305 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.780102 32102 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.481765 32135 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.837644 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.859790 32174 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:12:05.901899 32192 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
W20260709 13:12:05.924825 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 87253.5us
I20260709 13:12:05.925729 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.921677 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:05.838451 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.928195 30031 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:05.929085 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.803440 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1871) took 1694 ms. Trace:
I20260709 13:12:05.930763 30187 rpcz_store.cc:276] 0709 13:12:04.109583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.733948 (+1624365us) service_pool.cc:224] Handling call
0709 13:12:05.782431 (+ 48483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.783381 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.803378 (+ 19997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:05.766127 32200 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.933854 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.369153 30178 rpcz_store.cc:276] 0709 13:12:03.108319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.108425 (+   106us) service_pool.cc:224] Handling call
0709 13:12:03.108696 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.108923 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:03.109300 (+   377us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.015816 (+1906516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.025808 (+  9992us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:05.039780 (+ 13972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.039871 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.040036 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":967,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":53935,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":121,"thread_start_us":1861455,"threads_started":2,"wal-append.queue_time_us":693488,"wal-append.run_cpu_time_us":1667,"wal-append.run_wall_time_us":1108810}
I20260709 13:12:05.935654 30031 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:05.928022 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.787268 32126 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:05.798276 32058 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.817677 32262 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.796392 32258 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.765928 32271 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.814801 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.817888 32112 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:05.877751 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 279) took 1803 ms. Trace:
I20260709 13:12:05.947625 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.947904 30179 rpcz_store.cc:276] 0709 13:12:04.074482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.331305 (+1256823us) service_pool.cc:224] Handling call
0709 13:12:05.331684 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.332193 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.332234 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.332844 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.469204 (+136360us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.469249 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.469325 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.877472 (+408147us) raft_consensus.cc:1685] finished
0709 13:12:05.877498 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.877673 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2967,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":134476,"threads_started":1,"wal-append.queue_time_us":136169}
I20260709 13:12:05.949694 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.880549 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.822484 32259 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:05.759416 32113 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:05.953896 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.884445 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:05.883260 30185 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:05.830976 32269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.012s	sys 0.034s
I20260709 13:12:05.817253 32235 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:12:05.714470 32166 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.895217 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.838295 31986 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.864701 32199 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.910010 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.913973 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.965389 30181 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:05.915653 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.913185 30034 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:05.922703 30182 raft_consensus.cc:2393] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:05.881134 32291 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:05.889858 32195 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:05.879942 32287 raft_consensus.cc:697] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:05.934569 30738 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:05.922262 32285 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:05.865368 32270 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:05.943778 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.957134 32252 raft_consensus.cc:2764] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:05.942808 32262 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:05.946812 32301 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:12:05.874444 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 52696us
I20260709 13:12:05.952416 30186 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:05.922689 32103 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.988204 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:05.946825 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.955207 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.990716 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.956738 30031 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:05.968979 32117 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:05.992059 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45321.5us
I20260709 13:12:05.970178 32291 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.003990 32291 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:05.977448 32084 consensus_queue.cc:1175] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d2f11cccca04a7683da4080ab797bd7" responder_term: 3 status { last_received { term: 3 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 3 index: 4 } }
I20260709 13:12:05.939103 31893 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:06.005510 32135 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.005630 31893 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.006153 31893 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.007175 32261 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:05.977634 32159 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.008049 32159 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:05.941089 32126 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.968286 30038 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:05.943454 32204 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:05.958098 32269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.012s	sys 0.036s
I20260709 13:12:05.972019 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:05.974094 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.923645 32198 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.950008 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.924643 32144 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.957458 32281 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.958333 32259 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:05.938827 32102 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:05.968287 32199 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.883869 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:05.970089 32152 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.993185 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.993359 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:05.995808 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:05.997329 31854 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.002077 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.003140 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.004032 32265 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.010223 30037 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:05.974562 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.011924 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:05.959802 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:05.955729 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 185203us
I20260709 13:12:05.961567 32112 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.012616 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.207368 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:06.362740 30033 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:05.979825 32166 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.362067 30186 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:06.371117 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.362993 30182 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:12:06.371263 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 359386us
W20260709 13:12:06.350097 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 465707us
I20260709 13:12:06.364141 30187 raft_consensus.cc:2410] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:06.062055 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 280) took 1987 ms. Trace:
I20260709 13:12:06.372722 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:06.374972 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.375293 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.373220 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:06.365185 30179 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:06.187937 30108 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:06.186651 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:06.379457 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.062515 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1646) took 1196 ms. Trace:
I20260709 13:12:06.363220 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:06.185019 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:06.368182 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:06.371485 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.183122 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:06.375845 30186 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:06.372692 30183 rpcz_store.cc:276] 0709 13:12:04.074786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.373148 (+1298362us) service_pool.cc:224] Handling call
0709 13:12:05.393430 (+ 20282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.393784 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.393813 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.394341 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.726530 (+332189us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.726585 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.726823 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.061731 (+334908us) raft_consensus.cc:1685] finished
0709 13:12:06.061761 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.061970 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1971,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":5564,"thread_start_us":310294,"threads_started":1,"wal-append.queue_time_us":580123}
I20260709 13:12:05.989753 32262 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:06.363508 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 156257us
I20260709 13:12:06.377805 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.179026 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.323740 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:06.381845 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:06.390108 30034 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:06.181680 30029 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:06.307992 32289 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
W20260709 13:12:06.198369 32301 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:12:06.052258 32200 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.312522 32283 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:06.053993 32300 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
W20260709 13:12:06.052552 31969 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.000s
I20260709 13:12:06.370899 32126 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.397073 32195 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:06.063658 32264 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.398s
I20260709 13:12:06.397585 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:06.398977 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:06.204890 32252 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.308368 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.147269 32091 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.208024 32246 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.372071 32281 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.995319 32117 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:06.009343 32068 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.341693 32220 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.380435 30030 rpcz_store.cc:276] 0709 13:12:04.867691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.276662 (+408971us) service_pool.cc:224] Handling call
0709 13:12:05.277084 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.371746 (+ 94662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.371781 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.372310 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.855727 (+483417us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:05.856353 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.856427 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.062240 (+205813us) raft_consensus.cc:1685] finished
0709 13:12:06.062264 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.062444 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94270,"raft.queue_time_us":95007,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3382,"thread_start_us":478284,"threads_started":1,"wal-append.queue_time_us":596020}
I20260709 13:12:06.361744 32265 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:06.364353 32204 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.369513 31921 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.372782 32199 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.383500 32041 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:05.986897 32285 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:06.441306 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 257014us
I20260709 13:12:06.442440 30035 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:06.145983 32288 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.265s
I20260709 13:12:06.298396 32174 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:12:05.992703 32103 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:06.059667 32268 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:06.446878 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 47996us
W20260709 13:12:06.447479 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.402384 32084 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.413040 32290 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.382603 30178 raft_consensus.cc:2376] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5. Re-sending same reply.
W20260709 13:12:06.442262 32308 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:12:06.411557 32159 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.408712 32258 consensus_queue.cc:1059] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:12:06.447965 32195 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:06.206401 32287 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.446830 32283 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:06.472968 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 124949us
I20260709 13:12:06.581977 32198 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.621091 32262 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.636369 32239 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:06.594695 32109 consensus_meta.cc:287] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.821s	user 0.002s	sys 0.009s
W20260709 13:12:06.606336 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 233651us
I20260709 13:12:06.744177 30187 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:06.599203 32309 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.611s	user 0.002s	sys 0.000s
W20260709 13:12:06.735755 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.620646 32101 consensus_meta.cc:287] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.000s
I20260709 13:12:06.744899 30739 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:06.744047 32290 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.463775 32252 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.777467 32148 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.777693 32233 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.777933 32290 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.778290 32148 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.778620 32233 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.652972 32126 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:06.515970 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.674206 32093 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:06.579102 32307 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:12:06.648033 32152 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.802670 32152 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.803309 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:06.804137 31920 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:06.804518 31920 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.804878 31920 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.464370 32271 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.595064 32270 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.470638 32281 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.457222 32200 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:06.662611 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.745235 32262 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.810654 32268 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.620529 32259 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.813246 32259 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.588904 32112 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:06.591706 32311 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:06.469640 32310 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.778144 32204 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.814404 32310 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.814913 32310 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.817693 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.818876 30735 raft_consensus.cc:2393] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:06.820895 30179 raft_consensus.cc:2410] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:06.823486 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.825845 30704 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:06.827190 30704 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:06.829272 32187 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.830521 32187 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:06.682000 32144 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.832360 32198 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:06.510583 32192 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.657593 32113 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.672268 31986 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:06.791515 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.837510 32252 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.793728 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1687) took 1998 ms. Trace:
I20260709 13:12:06.838622 30184 rpcz_store.cc:276] 0709 13:12:04.795439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.812126 (+1016687us) service_pool.cc:224] Handling call
0709 13:12:05.812567 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.826642 (+ 14075us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:05.826669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.827155 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.986530 (+159375us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:05.986576 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.986641 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.793535 (+806894us) raft_consensus.cc:1685] finished
0709 13:12:06.793551 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.793675 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20304,"raft.queue_time_us":15215,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":27632,"thread_start_us":103934,"threads_started":1,"wal-append.queue_time_us":445293}
I20260709 13:12:06.781042 30741 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:06.472407 32117 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.795039 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:06.784691 32093 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.838201 32135 raft_consensus.cc:1027] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: attempt to promote peer 8d2f11cccca04a7683da4080ab797bd7: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:12:06.842631 32093 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.786686 32265 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.787540 32195 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.788146 32103 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.800315 30185 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
W20260709 13:12:06.614257 32291 consensus_meta.cc:287] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:12:06.801172 32269 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.617592 32102 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:06.599143 31893 consensus_meta.cc:287] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
W20260709 13:12:06.683280 32295 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.805s	user 0.002s	sys 0.002s
I20260709 13:12:06.469172 32145 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.830425 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.860644 32261 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.832861 32198 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.866592 32261 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.778762 32084 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.795866 32126 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.799248 32041 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.885725 32041 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.886886 32285 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.887676 32204 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.890563 32084 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.840193 32199 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.890588 32204 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.792323 32258 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:06.838624 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 70847.8us
I20260709 13:12:06.890961 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1701) took 1053 ms. Trace:
I20260709 13:12:06.779129 32101 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.891892 32258 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:06.893097 32283 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.893505 32258 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.873502 32117 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.894948 32258 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.895754 32199 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.860967 32291 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.897838 32291 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.892076 30185 rpcz_store.cc:276] 0709 13:12:05.837862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.993155 (+155293us) service_pool.cc:224] Handling call
0709 13:12:06.890786 (+897631us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54000cb7d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:06.890899 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002933120}
I20260709 13:12:06.860389 32093 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:06.903158 30739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43022 (request call id 576) took 1659 ms. Trace:
I20260709 13:12:06.953670 30739 rpcz_store.cc:276] 0709 13:12:05.243310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.247606 (+  4296us) service_pool.cc:224] Handling call
0709 13:12:06.902895 (+1655289us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540027bfd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:06.903058 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3097268992}
I20260709 13:12:06.901518 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.956645 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 416) took 1119 ms. Trace:
I20260709 13:12:06.957087 30741 rpcz_store.cc:276] 0709 13:12:05.836837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.836991 (+   154us) service_pool.cc:224] Handling call
0709 13:12:06.956383 (+1119392us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54005d0f54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:06.956571 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107428608}
I20260709 13:12:06.959546 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:06.840193 31920 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.829015 32152 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.961587 32261 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:06.964570 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:06.863973 32269 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.967555 31920 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.865312 31893 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.960953 32093 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:06.963840 32198 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.901569 32195 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.956023 32265 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.986383 32281 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.987100 32195 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.988631 32310 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:06.989568 32148 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.992868 32233 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:06.993920 32265 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:06.995625 32290 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.549988 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:07.034020 30030 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:06.855688 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1648) took 1108 ms. Trace:
W20260709 13:12:06.601643 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 228042us
I20260709 13:12:07.035782 30031 rpcz_store.cc:276] 0709 13:12:05.747006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.996427 (+249421us) service_pool.cc:224] Handling call
0709 13:12:05.996686 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.997035 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:06.060063 (+ 63028us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.854092 (+794029us) log.cc:844] Serialized 14 byte log entry
0709 13:12:06.855383 (+  1291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:06.855428 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:06.855472 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.855532 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.855636 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72211,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":86028,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":28365,"thread_start_us":783770,"threads_started":3,"wal-append.queue_time_us":425383}
I20260709 13:12:07.037509 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:06.853782 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 58818.4us
I20260709 13:12:06.855480 30109 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:07.039640 30029 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.041002 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.050287 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.051812 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:06.965190 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.091027 30735 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:07.093595 32290 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.093083 32093 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:06.974805 32117 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.067533 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.070254 30036 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:12:07.047081 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.048142 30107 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:07.046414 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.074151 31893 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.076296 30079 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:07.076859 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.099584 32288 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.100284 32310 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.109602 30105 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:07.117820 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 71821.7us
I20260709 13:12:07.118340 32195 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:07.118487 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.118901 32195 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:07.119499 32195 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.122651 30733 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:12:07.119257 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.124621 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1306) took 1382 ms. Trace:
W20260709 13:12:07.101862 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 52603.1us
I20260709 13:12:07.125522 30108 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.130262 32204 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:07.131629 32269 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.100324 32281 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.132515 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.131784 32204 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.140298 32204 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.142640 32261 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:06.979192 32103 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.125542 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.146093 30109 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
W20260709 13:12:07.125658 30035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1634) took 4203 ms (client timeout 1641 ms). Trace:
I20260709 13:12:07.127126 30036 rpcz_store.cc:276] 0709 13:12:05.742287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.971772 (+229485us) service_pool.cc:224] Handling call
0709 13:12:05.972036 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.116496 (+1144460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.124054 (+  7558us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540010e5d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:07.124491 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523832704}
I20260709 13:12:07.145689 30185 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:12:07.153542 30035 rpcz_store.cc:269] 0709 13:12:02.900533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.900677 (+   144us) service_pool.cc:224] Handling call
0709 13:12:07.093244 (+4192567us) spinlock_profiling.cc:243] Waited 3.53 s on lock 0x7b54003426d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:07.103831 (+ 10587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8129937792}
W20260709 13:12:07.160275 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 74930.4us
I20260709 13:12:07.161309 32258 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:07.173816 30105 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.181298 32198 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.182626 32198 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:07.186147 32041 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.190696 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.192866 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1885) took 1231 ms. Trace:
W20260709 13:12:07.193776 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.193881 30110 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.197979 30032 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.200599 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1304) took 1616 ms. Trace:
I20260709 13:12:07.201438 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.165267 32269 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.193591 30187 rpcz_store.cc:276] 0709 13:12:05.961366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.374732 (+413366us) service_pool.cc:224] Handling call
0709 13:12:07.192124 (+817392us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54000ccbd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:07.192595 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684585856}
I20260709 13:12:07.201084 30032 rpcz_store.cc:276] 0709 13:12:05.584329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.412248 (+827919us) service_pool.cc:224] Handling call
0709 13:12:06.413744 (+  1496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.198759 (+785015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.200205 (+  1446us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540011ce54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:07.200501 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782811392}
I20260709 13:12:07.205353 32041 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.220389 32261 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.221237 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1703) took 1382 ms. Trace:
I20260709 13:12:07.221755 30179 rpcz_store.cc:276] 0709 13:12:05.838401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.379159 (+540758us) service_pool.cc:224] Handling call
0709 13:12:07.220798 (+841639us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b540004a1d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:07.221060 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012583680}
I20260709 13:12:07.225060 32200 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:07.226490 32200 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.218478 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.232506 30038 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:07.192898 32103 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.224938 30734 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:07.244547 30187 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:07.244992 30004 leader_election.cc:400] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:07.245374 30004 leader_election.cc:403] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:07.254240 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 213683us
I20260709 13:12:07.254496 32200 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.259068 30033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1313) took 1328 ms. Trace:
I20260709 13:12:07.261865 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:07.263499 31854 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:07.263556 30704 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:07.264213 31854 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:07.265856 31854 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.273558 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:07.276153 32281 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.246469 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.283113 32291 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:07.284595 32291 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:07.257243 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.292280 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:07.293479 30035 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.294540 32045 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:07.294962 32045 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.295300 32045 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.302314 30108 raft_consensus.cc:2410] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:07.259706 30033 rpcz_store.cc:276] 0709 13:12:05.930255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.381769 (+451514us) service_pool.cc:224] Handling call
0709 13:12:06.670254 (+288485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.670750 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.670792 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.671377 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.817664 (+146287us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:06.817712 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.817796 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.822182 (+  4386us) raft_consensus.cc:1685] finished
0709 13:12:06.822202 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.258527 (+436325us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540020add0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:07.258882 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24644,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":662643968,"thread_start_us":145873,"threads_started":1,"wal-append.queue_time_us":143561}
I20260709 13:12:07.307247 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.247025 32152 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:07.311743 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 192739us
I20260709 13:12:07.313761 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.314687 32041 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:07.316329 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.316572 30738 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:07.316622 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.317173 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.317803 32103 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.318504 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.316949 32288 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.320084 32288 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:07.320281 30029 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.320438 32288 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:07.321868 30038 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:07.327850 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70848.1us
I20260709 13:12:07.330597 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1318) took 1269 ms. Trace:
I20260709 13:12:07.330765 32244 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:07.331250 32244 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:07.331154 30030 rpcz_store.cc:276] 0709 13:12:06.061373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.479489 (+418116us) service_pool.cc:224] Handling call
0709 13:12:06.516486 (+ 36997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.034985 (+518499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.330239 (+295254us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400343ad4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:07.330534 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187915520}
W20260709 13:12:07.344278 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.341686 31893 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:12:07.347064 30038 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.347433 31893 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.347898 31893 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:07.320662 32293 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:07.360589 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:07.365489 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.321642 32288 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.361269 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:07.368831 30030 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:07.378314 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.358157 32258 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.332581 32244 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.389963 30035 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.398747 30038 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.387087 32258 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.350219 31893 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.406412 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.413224 30108 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:07.413045 32144 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.418282 32144 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.418370 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.418784 32144 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.419245 32244 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.420727 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.420980 30033 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:12:07.421617 30110 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:07.422470 30183 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:07.415617 30035 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.416129 32288 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.444882 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:07.448938 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.449055 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.449194 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.450954 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.452860 32269 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.453253 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.455693 30109 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:07.456990 30108 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.459848 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.460992 32291 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:07.462189 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.462059 32045 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:07.463335 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.463457 32291 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.464869 32293 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:07.470753 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.473701 32117 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:07.472965 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.460901 32041 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.478411 30038 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:07.453337 32269 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.484890 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.489663 30108 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:07.447635 31854 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:07.486500 32103 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.487178 31893 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.488637 32269 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.490077 32117 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.504153 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:07.502808 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.481850 32195 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.486711 32041 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.506181 32291 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:12:07.510378 32041 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.523626 32261 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.526854 32283 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.527360 32283 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:07.528314 32283 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.531664 32317 raft_consensus.cc:3055] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.529695 32144 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.532277 32317 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:07.532701 30107 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:07.532225 32283 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.535243 32195 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.535877 32144 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.537451 32317 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.538826 32317 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.539129 32045 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:07.540320 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.546052 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.546991 30737 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:07.552345 32338 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:07.561642 32281 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:07.565546 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:07.564731 32337 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:07.571017 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.571826 30107 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:07.572461 32267 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.573521 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.574316 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.574524 30105 raft_consensus.cc:2410] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:07.572374 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.577433 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.578320 30110 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:07.573129 32267 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:07.581894 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.582661 30108 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:07.582787 32267 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.584496 32267 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.583377 30035 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.540696 32258 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.607779 30035 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.611093 30109 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:07.610303 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.618247 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.621548 32258 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:07.623133 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57721.3us
I20260709 13:12:07.625741 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.630476 30734 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:07.631155 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.633150 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.634678 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.635855 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.636340 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.636747 30110 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:12:07.636395 32288 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.637127 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.638024 30111 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.637897 32288 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.639008 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.642249 30106 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:07.643253 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.643898 30106 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.644235 32055 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:07.644541 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.644893 32055 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:07.637238 30105 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:07.645624 32291 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:07.646123 32291 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.646538 32291 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.646725 30109 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.638137 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 142) took 9629 ms. Trace:
I20260709 13:12:07.612052 32269 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:07.664463 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 154712us
I20260709 13:12:07.669512 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.670747 30109 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:07.671626 32269 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:07.671962 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.664325 31893 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.672930 30109 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:07.666270 29930 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 reported cstate change: leader changed from <none> to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 3 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:07.625689 32281 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:07.668440 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.668996 30107 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:07.664580 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.675148 30737 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:07.673702 31893 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.679061 31893 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:07.682030 32258 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.683331 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.683771 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.683705 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.684578 30108 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.680476 31893 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.684974 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.687496 30106 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.690045 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:07.691141 30109 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.696476 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.699919 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.660689 32288 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.676494 32281 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:07.709196 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:07.711726 30110 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
W20260709 13:12:07.706441 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51441.7us
W20260709 13:12:07.714962 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.715392 30108 raft_consensus.cc:2393] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:07.714452 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:07.717067 30737 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.719645 30107 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:12:07.724205 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.722702 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.706609 32258 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.712400 32281 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.738165 32126 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.739943 32045 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.740737 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:07.707021 32261 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:12:07.756472 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 66369.8us
W20260709 13:12:07.755636 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 72055.6us
I20260709 13:12:07.758313 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.760320 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.762630 32041 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.763484 32041 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.763916 32041 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:07.757380 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.764310 32041 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.714707 32283 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:12:07.780895 30737 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:07.785075 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.764775 32152 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:07.789528 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.755716 32244 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.794729 32055 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.795075 32113 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.785327 31893 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.654954 29933 rpcz_store.cc:276] 0709 13:11:58.008607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.029315 (+ 20708us) service_pool.cc:224] Handling call
0709 13:12:07.637891 (+9608576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:04.951932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:05.030186 (+ 78254us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:05.030239 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:12:05.030266 (+    27us) tablet.cc:662] Decoding operations
0709 13:12:05.031479 (+  1213us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:05.031557 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:05.031587 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:05.032489 (+   902us) tablet.cc:701] Row locks acquired
0709 13:12:05.032511 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:12:05.340439 (+307928us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b2c0008ad78. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dba0a 00007fcbe49db693 00007fcbe49db631 00007fcbe610e902 00007fcbe610e6dd 00007fcbe9b09243 00007fcbe9b08d58 00007fcbe9b0d9f1 00007fcbe9b0d9a9 00007fcbe9b0d939
0709 13:12:05.340500 (+    61us) write_op.cc:270] Start()
0709 13:12:05.340705 (+   205us) write_op.cc:276] Timestamp: P: 1783602725039015 usec, L: 0
0709 13:12:05.340729 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:05.341472 (+   743us) log.cc:844] Serialized 3369 byte log entry
0709 13:12:06.707065 (+1365593us) op_driver.cc:464] REPLICATION: finished
0709 13:12:06.819020 (+111955us) write_op.cc:301] APPLY: starting
0709 13:12:06.819120 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:06.819341 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:06.819380 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:06.820426 (+  1046us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:06.820667 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:12:06.820715 (+    48us) write_op.cc:312] APPLY: finished
0709 13:12:06.821060 (+   345us) log.cc:844] Serialized 65 byte log entry
0709 13:12:06.864534 (+ 43474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.868183 (+  3649us) write_op.cc:454] Released schema lock
0709 13:12:06.868237 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:06.868846 (+   609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.868880 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":111655,"apply.run_cpu_time_us":3062,"apply.run_wall_time_us":49712,"num_ops":8,"prepare.queue_time_us":227196,"prepare.run_cpu_time_us":45644,"prepare.run_wall_time_us":888532,"raft.queue_time_us":200430,"raft.run_cpu_time_us":2434,"raft.run_wall_time_us":118092,"replication_time_us":1366140,"spinlock_wait_cycles":14610816,"thread_start_us":806416,"threads_started":4,"wal-append.queue_time_us":552400}]]}
I20260709 13:12:07.796355 32204 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:07.810299 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50053.2us
I20260709 13:12:07.799742 32113 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.812517 31920 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:07.800376 32244 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.801000 32152 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:07.818796 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:07.805824 32269 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.825009 30104 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:07.827723 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.829066 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:07.841704 32258 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:07.842401 32258 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:07.842916 32258 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.843216 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:07.849365 32093 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.850458 32093 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:07.850924 32093 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:07.851404 32093 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.809478 32204 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:07.869344 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53628.6us
I20260709 13:12:07.874027 30106 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:07.876055 30109 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:07.817269 32113 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.817282 31920 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:07.882269 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.873433 32204 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:07.890499 30035 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:07.879377 32055 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:07.891748 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 170260us
W20260709 13:12:07.892103 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 49074.1us
I20260709 13:12:07.895469 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:07.885588 31920 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.896863 30187 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.898414 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.926916 32317 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:07.928488 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.929170 30038 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.931856 32093 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.938314 29930 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 4, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.939628 30033 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.941059 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.942040 30029 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.942219 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.942905 30037 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.925750 32055 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:07.946224 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.946419 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:07.946866 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.947533 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:07.949879 31913 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.950196 30033 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:07.950318 31913 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:07.899538 32152 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:07.901183 32348 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:07.958644 30183 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:07.967909 32187 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.968279 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:07.969033 30034 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.970633 32291 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.971665 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.972893 30032 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:07.968395 32187 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:07.974031 32041 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:07.985436 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:07.986565 30032 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:07.990633 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.991827 32041 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:07.996769 32204 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:07.941203 29930 catalog_manager.cc:5697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.999101 29930 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 2 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:08.000313 32261 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.000835 32261 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:08.001735 32291 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.002024 29930 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 4, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.004539 32187 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.006058 32187 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.007305 30030 raft_consensus.cc:2410] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:07.945194 32055 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:08.024199 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.029389 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.037737 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.040725 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:08.043725 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.041899 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:08.048647 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.999075 32204 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.054615 30034 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:08.042698 31854 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:12:08.062003 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.003993 29930 catalog_manager.cc:5697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.023531 32291 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:08.054149 32126 raft_consensus.cc:2764] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:08.068697 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.069693 30034 raft_consensus.cc:2376] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4. Re-sending same reply.
I20260709 13:12:08.064534 32244 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.082361 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.083401 30034 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:08.087278 29930 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.076356 31913 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.074631 32291 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:08.090317 29930 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.091500 31913 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.093042 32291 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.092607 29930 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.097023 29930 catalog_manager.cc:5697] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 3, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:08.100162 31893 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.069126 32261 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.100958 31893 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.105803 31893 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.106590 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.107457 30187 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 2.
W20260709 13:12:08.108188 32356 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.140s	user 0.001s	sys 0.003s
I20260709 13:12:08.111728 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:08.113000 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.100772 29930 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.098757 31920 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.121642 30185 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:08.122982 29930 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.124869 29930 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 2, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.121526 32093 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.132876 31920 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.139626 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:08.140694 30733 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:08.114220 32258 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.079107 32281 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.147547 30029 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.147429 32258 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.149536 30183 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:08.149145 31854 consensus_queue.cc:1059] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:08.150851 32288 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:08.151355 32288 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.151897 32281 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.152531 32288 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.154621 32288 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.156692 32261 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.121526 32113 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.171928 30036 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.173568 32113 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.175045 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:08.175350 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:08.176113 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.176571 32267 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:08.177390 32267 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.179211 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:08.183205 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.183909 30106 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:08.181281 32267 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.186489 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.187273 30185 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:08.190860 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.191457 30185 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.195466 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.196439 30187 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:08.200851 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 313662us
I20260709 13:12:08.212127 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.222275 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.226469 30037 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:08.243033 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.240939 32204 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.255323 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.255666 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.256220 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:08.256610 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.256878 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.257308 30034 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:08.258131 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.258306 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.259900 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.262742 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.263841 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.263445 30037 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:08.267956 30185 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.258057 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.272991 32204 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:08.274248 32204 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.282169 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.270810 30182 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:08.287424 30106 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:08.288702 30180 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:08.289572 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.264650 30029 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.271188 32288 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:08.303575 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.304841 32361 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:12:08.331120 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.344978 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:08.309844 32187 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:08.346515 32187 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:08.346588 32355 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:08.347009 32187 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.348277 30151 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.349054 32355 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:08.349452 32355 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:08.349714 32291 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.349817 32355 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.350606 32291 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.354697 32291 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:08.354955 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:08.355792 30734 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:08.356252 30029 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:08.347973 32187 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.295650 32288 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:08.357728 32288 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.357916 32187 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.361342 32355 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:08.363507 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:08.364923 30151 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.367487 32152 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.368238 32261 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.367851 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.369700 32261 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:08.370289 32261 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:08.370534 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.369686 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.372960 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.376094 30030 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:08.377194 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.367908 32152 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.382350 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.372174 31854 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:08.385725 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.386536 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.373226 32045 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:12:08.402463 30185 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:08.380802 32152 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.387593 32317 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:08.388383 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.373315 32261 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.393164 32355 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.394771 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:08.396335 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.386047 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.401549 30179 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:08.408416 30036 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.405843 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.407428 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.403028 32045 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.409896 32045 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.410880 32045 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.411482 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.412317 30185 raft_consensus.cc:2410] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:08.412282 32045 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.414295 30182 raft_consensus.cc:2410] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:08.413681 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.418141 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.418359 30036 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:08.418880 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.420064 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.420593 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.420722 30035 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:08.421531 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.421705 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.422313 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.422497 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.423960 32126 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.424255 30034 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.425189 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:08.426394 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:12:08.427162 30030 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:12:08.427802 30705 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:08.427212 32317 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:08.430372 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.431618 32317 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.432125 30151 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.432559 32317 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.438066 30180 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:08.440203 32152 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.441536 30178 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:08.442040 32355 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.442627 32355 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:08.443552 32355 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:12:08.445865 32187 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:08.446367 32187 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:08.446727 32187 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.447379 31854 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:08.447825 32126 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:08.448443 31854 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:08.448813 31854 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.449698 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.466372 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.467224 30030 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.467849 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.470338 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.457985 32267 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.476732 32267 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.477802 32267 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.477643 31854 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:08.481415 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.482267 31854 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.484829 32152 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.465039 32126 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:12:08.472808 32258 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.491957 30180 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:08.505236 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.531167 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 60905.6us
I20260709 13:12:08.534003 30002 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.490202 32258 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.518836 32267 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.543459 30180 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.524560 32113 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.550266 32258 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.551059 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.551663 30185 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:08.567408 30001 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.530s (SENT) [suppressed 25 similar messages]
I20260709 13:12:08.571885 30030 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:08.572991 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.573036 30151 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.557893 32045 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:12:08.577777 32045 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:08.578311 32045 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:08.579329 32045 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.573930 32378 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.581542 30733 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:12:08.582036 30733 pending_rounds.cc:85] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 5
W20260709 13:12:08.582129 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.582373 30733 pending_rounds.cc:107] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:12:08.582758 30733 raft_consensus.cc:2889] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.584755 32364 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:08.585492 32364 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:08.586476 32364 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.591558 30185 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:08.581094 32045 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.542001 32187 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.557986 32381 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.603130 30030 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:08.589732 32291 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:12:08.612775 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.600723 30077 connection.cc:256] RPC call timeout handler was delayed by -1.3269669660001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:12:08.614619 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2387669659999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:12:08.615994 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.617753 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.620333 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.620981 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.630028 30180 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.632176 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.632812 30105 raft_consensus.cc:2368] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
I20260709 13:12:08.633524 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.669389 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.669915 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:08.669974 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 108727us
I20260709 13:12:08.670562 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:08.671307 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57390.4us
I20260709 13:12:08.669499 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.686748 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.686673 30106 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:08.686748 30107 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.689057 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.689726 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.689949 32281 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:08.690771 32281 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:08.691335 32281 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:08.693888 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54298
W20260709 13:12:08.694052 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 126666us
I20260709 13:12:08.694504 30030 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:12:08.696954 30105 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.699064 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.699570 30105 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.699649 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.613523 32261 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:12:08.701164 30108 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.702163 30104 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.702105 30111 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.702304 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.618443 32381 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.707415 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.705492 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.708873 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.709740 30030 raft_consensus.cc:2368] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:08.709640 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.710659 30111 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.713708 30105 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:08.714421 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.715930 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.715960 32281 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.717991 32113 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.718272 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.718528 32113 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:08.720943 32113 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.726662 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.727967 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.728261 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.729560 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.729741 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.730433 30181 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:08.729211 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.731657 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.732601 30181 raft_consensus.cc:2410] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:08.732448 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.733274 30179 raft_consensus.cc:2368] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:08.733601 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:08.734957 32385 log.cc:927] Time spent T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.212s	user 0.009s	sys 0.003s
I20260709 13:12:08.735118 30184 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.714154 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.736259 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.736735 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.737689 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.738265 30186 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.716965 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.741868 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.742810 30036 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:08.742962 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.744055 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.744464 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.745071 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.745318 30104 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:08.746219 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.746721 32187 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:08.746943 30109 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:08.748769 32381 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.750392 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:08.751480 30036 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:08.752187 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:08.754827 32288 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:08.757756 30734 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:08.758626 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.759465 30108 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:08.762964 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.765429 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.768491 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.773041 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.774013 30105 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:08.775816 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.776804 30704 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:08.778201 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:08.779454 30186 raft_consensus.cc:2410] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:08.782089 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.782946 30036 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.791478 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.792652 30186 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.806252 30111 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:08.820706 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:08.828950 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.834015 30037 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:08.831420 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.832346 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:08.835940 30031 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.839697 32388 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:08.840252 32388 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.840679 32388 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.846457 30186 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:08.850860 30037 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:08.856110 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.856078 30036 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:08.828533 32258 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.849885 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:08.861621 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:08.868821 30033 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:12:08.866194 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 108166us
I20260709 13:12:08.870659 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.874483 30184 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.875463 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:08.857697 32381 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:08.859741 32288 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:08.872337 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.867774 32267 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:08.844631 32113 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:12:08.889964 30029 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:08.891930 32204 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:08.895766 30031 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:08.880277 32381 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:08.914096 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.872131 32359 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:12:08.909643 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.906018 32258 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:08.924424 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 50413.9us
I20260709 13:12:08.922220 32281 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:08.935801 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 65192.5us
I20260709 13:12:08.886536 32364 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:08.934038 32113 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.928618 32258 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:08.957504 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:08.940629 32281 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.967890 31913 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.959000 32258 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.969017 32281 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.984112 30736 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:12:08.983819 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74264.7us
I20260709 13:12:08.984988 30736 pending_rounds.cc:85] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 5
I20260709 13:12:08.985332 30736 pending_rounds.cc:107] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:12:08.985687 30736 raft_consensus.cc:2889] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:08.988627 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.968536 31913 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:08.992524 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 86175us
I20260709 13:12:08.971150 32113 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:08.997951 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.999794 30002 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:09.005030 30734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:09.005765 31913 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:09.009385 31893 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:09.005820 30734 raft_consensus.cc:606] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:09.009905 31893 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:09.010010 32381 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.010562 32378 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:09.011276 32378 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:09.010979 31893 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.012202 32378 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.012965 32397 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:08.977187 32359 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:12:09.015374 30033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:09.016054 30033 raft_consensus.cc:606] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.016835 30107 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:09.019613 30734 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:09.020781 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:09.034137 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.034307 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:09.041693 30034 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:09.041814 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.041895 30032 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:12:09.045624 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.046733 30033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:09.047255 30033 raft_consensus.cc:606] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.045967 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:09.025174 32397 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:09.057468 30734 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.050184 30037 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:09.045047 31893 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:09.071097 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.061444 32397 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.081825 32291 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:09.060848 32405 consensus_queue.cc:1059] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:09.072850 32364 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.085172 32401 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:09.086061 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 103901us
I20260709 13:12:09.060819 32187 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:12:09.087564 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 66875.8us
I20260709 13:12:09.067265 32281 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:09.119885 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.112061 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 158677us
W20260709 13:12:09.144170 32406 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:12:09.144796 32391 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.257s	user 0.006s	sys 0.000s
I20260709 13:12:09.148092 32403 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:09.068408 32244 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:12:09.165058 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:09.171080 32281 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.172465 30733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:09.172379 32403 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.173384 30733 raft_consensus.cc:606] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.173871 30733 raft_consensus.cc:614] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:09.175350 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:09.177261 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:09.177191 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.117996 32113 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.175112 32403 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:09.178701 30734 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:12:09.179116 30077 leader_election.cc:400] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:09.179597 30077 leader_election.cc:403] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.179679 30734 pending_rounds.cc:85] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 4
I20260709 13:12:09.184072 32411 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.184530 31913 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:09.180951 30734 pending_rounds.cc:107] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:12:09.192220 30734 raft_consensus.cc:2917] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:12:09.153203 32401 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:09.197189 30734 raft_consensus.cc:2889] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.199082 32411 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:09.202603 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:09.208616 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:09.211563 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 69592.7us
I20260709 13:12:09.212790 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.204030 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.214314 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:09.214952 30734 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:09.208843 32244 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:12:09.213939 32381 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEARNER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.224028 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:09.239526 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:09.240826 30031 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:09.201282 32364 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:09.248162 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:09.192773 32388 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:09.257977 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.258225 30705 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:09.210261 32405 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:12:09.245146 32411 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:09.265717 30036 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:09.244915 32364 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.270213 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:09.267818 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 43868.2us
W20260709 13:12:09.272152 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68247.8us
I20260709 13:12:09.283209 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:12:09.268813 32386 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:09.271727 32364 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.272312 32152 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.275012 32281 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:09.280810 32405 consensus_queue.cc:1243] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer ef9ab4d665234a799376bf42ef5d058c log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:12:09.312474 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61636.5us
I20260709 13:12:09.284893 32381 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:12:09.307022 32152 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:09.311506 32386 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:09.384562 32417 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:09.385501 30036 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:09.379489 32400 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.313165 32403 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:12:09.388751 30036 raft_consensus.cc:614] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:09.366609 32152 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.363402 31913 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.408527 32388 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.312922 32401 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.396138 32399 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:09.398561 32187 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.423540 30033 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
W20260709 13:12:09.469763 32414 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:09.422626 32399 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:09.402757 31913 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.418423 32397 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.463114 32288 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.470903 32399 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.497752 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:09.498427 30184 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.513814 32288 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.516508 32364 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.524668 30184 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:09.526291 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:09.532387 32432 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.533245 32432 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.539063 32364 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:09.537176 32432 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.547034 31913 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:09.462648 32187 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:09.541137 32258 consensus_meta.cc:287] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
W20260709 13:12:09.559343 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 279805us
W20260709 13:12:09.561149 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.566696 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 294509us
W20260709 13:12:09.589459 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 181969us
I20260709 13:12:09.553175 32187 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.597577 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:09.622891 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.564709 32381 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:09.624851 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.634928 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.585968 32394 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:12:09.655894 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.583676 32258 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.703658 32258 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.537096 32152 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.707823 32405 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:09.710042 32381 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:09.723635 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 107866us
I20260709 13:12:09.489557 32386 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:09.730486 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.725764 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 140992us
I20260709 13:12:09.728295 32399 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.736076 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.745934 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:09.772897 30035 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:09.761780 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.778908 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:09.780947 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.784010 30034 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:09.784906 30107 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:09.832676 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:09.728353 32152 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:09.848805 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:09.869475 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 81069.7us
I20260709 13:12:09.870728 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.871150 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.871176 32381 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.874176 30113 raft_consensus.cc:2376] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7. Re-sending same reply.
I20260709 13:12:09.778119 32364 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:12:09.883278 30035 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:09.862807 32397 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:09.907896 32424 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.914652 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.915481 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:09.919951 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.928915 32187 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.929570 32187 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.929595 32152 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.930862 32152 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.931339 32152 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.931849 32187 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:09.930751 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:09.939597 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.901111 32426 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.950662 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:09.951529 30037 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:09.959378 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.960088 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.969336 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.970158 30112 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:09.970455 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.970180 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.971874 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.972450 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.973682 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:09.946175 32187 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.974263 30107 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.973707 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:09.975816 30108 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:09.973028 30113 raft_consensus.cc:2376] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5. Re-sending same reply.
I20260709 13:12:09.937772 32424 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.955875 32055 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.957221 32359 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:09.986243 32359 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:09.986164 32055 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:09.987213 32359 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:09.988435 32055 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:09.990104 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:09.983839 32187 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.011713 32438 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:10.012370 32438 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.013659 30108 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:10.015115 32187 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.018155 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.019023 30032 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:10.022205 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.022830 32424 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.024041 30113 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.025463 32438 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.036793 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.042215 32355 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:10.042703 32355 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:10.043610 32355 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.044910 32355 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:10.047508 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 85857.6us
I20260709 13:12:10.057206 30031 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:10.058420 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.061733 30107 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:10.064194 30032 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
W20260709 13:12:10.069793 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.073529 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.073802 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.074488 30031 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 2.
I20260709 13:12:10.074687 30038 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:10.077083 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.077437 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.078361 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.078965 30031 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:10.085516 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 145151us
I20260709 13:12:10.086879 30113 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:10.089061 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:10.096282 32113 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:10.097795 32113 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:10.098274 32113 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:10.099221 32113 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.099777 32445 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.100234 32445 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.100283 32113 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.100672 32445 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.092813 32424 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:10.101348 32424 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.104414 32424 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.107709 32152 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.110805 32426 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:10.112270 29984 auto_rebalancer.cc:893] Removing replace marker failed: Replica 34f51764a89048468a6faa21020812b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:10.112705 29984 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:12:10.113027 29984 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:10.115911 30184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33114
I20260709 13:12:10.116353 32152 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.116484 30184 raft_consensus.cc:606] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:10.116683 32418 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:10.116977 30184 raft_consensus.cc:614] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:10.117117 32418 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:10.117686 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.118287 30104 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.118001 32418 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.119436 32418 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.119529 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:10.120048 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:10.120203 30111 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.120659 30108 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.123024 32187 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.109519 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 324374us
I20260709 13:12:10.130954 32288 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.134537 32187 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.137890 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:10.138206 32388 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.138911 32390 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.142022 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.143517 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.144152 30033 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.138768 30733 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:10.145139 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:10.177729 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.184449 30034 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.184464 30104 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.145144 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:10.187981 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:10.195972 30112 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
W20260709 13:12:10.223961 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.231961 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.233624 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.234323 30184 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.139514 32390 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.234927 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.186416 32244 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:10.238013 30185 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.138788 32388 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:10.246397 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 62832.3us
I20260709 13:12:10.241464 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:10.248477 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 156194us
I20260709 13:12:10.256881 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.257311 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.262531 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.265391 30185 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.248662 32244 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.274622 32187 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.276340 32244 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:10.276944 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.279084 32288 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.279558 32288 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.279958 32288 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.283412 32390 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.247648 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:10.285485 32430 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.289469 32388 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.290378 32411 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:10.290894 32411 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.293136 32411 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.294638 30030 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.301831 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.310179 30031 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:10.322417 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65601.7us
I20260709 13:12:10.323519 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:10.324383 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.326442 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.327732 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 235809us
W20260709 13:12:10.333933 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 79682.6us
W20260709 13:12:10.320753 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 136730us
I20260709 13:12:10.341631 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.347187 30030 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:10.350575 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.350518 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:10.353004 32462 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.353487 32462 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.353807 32462 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.358407 32422 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.357580 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.341075 32450 raft_consensus.cc:1064] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:12:10.370749 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:10.341331 32430 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:10.374980 30077 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.641s (SENT)
I20260709 13:12:10.349882 32113 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.376443 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:10.375523 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 195715us
I20260709 13:12:10.380654 30734 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:10.380561 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:10.381047 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46387.7us
I20260709 13:12:10.381376 30737 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:10.381825 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:10.382424 30738 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:10.384258 29930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 258) took 12423 ms (client timeout 15000 ms). Trace:
I20260709 13:12:10.369992 32422 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.389916 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.390467 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:10.391088 30107 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:10.377914 32444 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.393548 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.394199 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:10.396588 30113 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.411517 29932 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:10.384572 29930 rpcz_store.cc:269] 0709 13:11:57.961164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.961320 (+   156us) service_pool.cc:224] Handling call
0709 13:11:58.452237 (+490917us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:10.384198 (+11931961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:08.559689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:08.691248 (+131559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:08.691306 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:12:08.691328 (+    22us) tablet.cc:662] Decoding operations
0709 13:12:08.828071 (+136743us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:08.828160 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:08.828189 (+    29us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:12:08.870084 (+ 41895us) tablet.cc:701] Row locks acquired
0709 13:12:08.881638 (+ 11554us) write_op.cc:260] PREPARE: finished
0709 13:12:08.901678 (+ 20040us) write_op.cc:270] Start()
0709 13:12:08.901856 (+   178us) write_op.cc:276] Timestamp: P: 1783602728901578 usec, L: 0
0709 13:12:08.901882 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:12:08.956676 (+ 54794us) log.cc:844] Serialized 5256 byte log entry
0709 13:12:09.387097 (+430421us) op_driver.cc:464] REPLICATION: finished
0709 13:12:09.876819 (+489722us) write_op.cc:301] APPLY: starting
0709 13:12:09.901015 (+ 24196us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:09.935146 (+ 34131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:09.935292 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:09.965095 (+ 29803us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:09.965617 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:12:09.965670 (+    53us) write_op.cc:312] APPLY: finished
0709 13:12:09.966075 (+   405us) log.cc:844] Serialized 95 byte log entry
0709 13:12:09.966260 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:09.966395 (+   135us) write_op.cc:454] Released schema lock
0709 13:12:09.966458 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:09.966858 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:09.966889 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59,"reported_tablets":34,"spinlock_wait_cycles":38029568,"child_traces":[["op",{"apply.queue_time_us":397326,"apply.run_cpu_time_us":4898,"apply.run_wall_time_us":105881,"num_ops":13,"prepare.queue_time_us":207051,"prepare.run_cpu_time_us":33435,"prepare.run_wall_time_us":507441,"raft.queue_time_us":144722,"raft.run_cpu_time_us":44370,"raft.run_wall_time_us":398940,"replication_time_us":463006,"thread_start_us":532885,"threads_started":4,"wal-append.queue_time_us":101903}]]}
I20260709 13:12:10.392731 32411 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.413825 32402 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.414259 32402 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:10.414661 32402 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.419308 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.419993 32364 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.420532 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.421463 32291 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.421993 32443 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:10.422425 32443 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:10.422775 32443 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:10.424043 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.422003 32291 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:10.425041 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.412986 29932 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:10.434291 32291 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.434330 29932 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.436864 29932 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.420708 32364 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.440582 32445 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:10.443843 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 68867.1us
W20260709 13:12:10.444839 30077 connection.cc:256] RPC call timeout handler was delayed by -1.9267045060000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31960000000000005s for a response
I20260709 13:12:10.450912 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.442986 29932 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.454181 32444 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:10.454725 32444 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:10.455639 32444 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.459527 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.460706 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.462044 32419 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.452921 29932 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 4, term changed from 3 to 5, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to <none>, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:10.465660 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59325.1us
I20260709 13:12:10.466915 30185 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:10.466493 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:10.466018 29932 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.411228 32288 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.469193 30704 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:10.469573 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.463572 32055 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.461833 32402 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.471827 29932 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 1 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.471191 32466 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.473869 32362 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:10.476186 30077 connection.cc:256] RPC call timeout handler was delayed by -1.9168045060002896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3207s for a response
I20260709 13:12:10.476743 30113 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:10.475876 29932 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.475968 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.476640 32466 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.479656 32464 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:10.480239 32466 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.478304 29932 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129), VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130), VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131), VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:10.488780 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.491302 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.491779 32187 raft_consensus.cc:993] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:10.493357 32402 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.496025 32402 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:10.493194 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.477082 32381 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.484310 32055 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.496428 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.498179 32464 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.515882 32464 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:10.516072 32451 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.202s	user 0.004s	sys 0.000s
I20260709 13:12:10.516872 32399 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.516242 32464 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.498342 32187 raft_consensus.cc:1081] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:10.523813 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.524616 30031 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:10.502703 32364 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.525888 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:10.506938 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.527043 32408 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.527691 32408 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.530635 32288 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.532306 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.533000 30030 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.532909 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:10.511999 32418 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:10.543020 32426 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.542866 32418 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.543362 30004 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:10.543824 32426 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:10.545806 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 49467.2us
I20260709 13:12:10.546190 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.546913 30038 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:10.552897 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.553898 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.553936 30031 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:12:10.555989 32464 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.559150 32464 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.564666 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:10.565483 32418 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.568251 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.570134 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:10.572487 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.574129 32445 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.574379 32408 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.512792 32381 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.575058 32381 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.575402 30150 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.577749 32055 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:10.577910 32460 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.549940 32364 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.578207 32435 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.552752 32430 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.579267 32430 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:10.578972 32435 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.579511 32402 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.579689 32430 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.580078 32402 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.580521 32402 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.583317 32462 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.585690 32466 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.587468 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.588171 30033 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:12:10.590233 30001 leader_election.cc:336] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.530s (SENT)
W20260709 13:12:10.567160 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78453.2us
W20260709 13:12:10.591542 30001 leader_election.cc:336] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.534s (SENT)
I20260709 13:12:10.592147 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:10.564687 32355 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.004s
I20260709 13:12:10.567656 32411 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.618889 32450 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.545032 32426 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.612159 32462 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.610015 32418 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.612226 32399 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:10.614207 32408 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:10.611346 30001 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.546s (SENT)
I20260709 13:12:10.642007 32399 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.654486 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.648490 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.648947 30038 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:10.649169 30107 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:10.656775 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:10.649468 30033 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:10.596555 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.657759 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.658385 30036 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.651007 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.657074 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.661018 30104 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.654018 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:10.615496 32466 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.655118 30184 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:10.655689 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44373us
I20260709 13:12:10.657058 30185 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:10.653770 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.671082 30034 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.671653 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.672143 30180 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:10.669253 30001 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.591s (SENT)
I20260709 13:12:10.677011 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.677552 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.678226 30108 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.679208 30738 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:10.680459 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:10.680850 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:10.681223 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.681602 30738 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:10.681845 30107 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.677871 32462 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.648598 30113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:12:10.685168 32462 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.687593 32462 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.678123 32244 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.647707 32443 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.689296 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.656371 32399 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.714398 30112 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.693780 32430 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:10.697687 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 101194us
I20260709 13:12:10.671995 32411 raft_consensus.cc:2764] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:12:10.700663 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44011.1us
I20260709 13:12:10.721710 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.721856 32463 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:10.722955 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.724190 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.726450 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:10.732959 30032 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:10.704036 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.735014 32456 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:10.709165 30104 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:10.739157 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.711870 30184 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:10.753262 30036 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.667119 32435 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:10.715456 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:10.716045 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46842.6us
W20260709 13:12:10.755625 30001 leader_election.cc:336] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.614s (SENT)
I20260709 13:12:10.756150 30001 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.716570 32408 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.735911 32418 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.739840 32456 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:10.740814 32469 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.743057 32430 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.744289 32381 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.736281 32411 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.747124 30186 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:10.713990 32402 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:10.736016 32438 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.750190 30034 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:10.712025 30107 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:10.709599 30180 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.759904 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:10.766250 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61582.7us
I20260709 13:12:10.767261 30705 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:10.773131 30108 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.773473 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:10.809554 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:10.779429 30001 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.673s (SENT)
I20260709 13:12:10.810389 30108 raft_consensus.cc:2410] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:10.810297 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.790246 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.811404 30036 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:10.769347 32462 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.809633 30738 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:10.812495 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 73412.9us
I20260709 13:12:10.815274 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:10.817421 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:10.817663 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:10.778203 32469 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:10.821115 30001 leader_election.cc:336] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.699s (SENT)
I20260709 13:12:10.788870 32419 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.798967 32443 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:10.832109 30734 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:10.768934 32288 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:12:10.821285 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105940us
I20260709 13:12:10.777452 32464 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:10.821838 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.808249 32418 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:10.834093 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 117734us
I20260709 13:12:10.836608 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:10.814414 32462 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.837532 30036 raft_consensus.cc:2410] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:10.814198 32430 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.826814 32419 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.808033 32408 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:12:10.860560 30185 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:10.860922 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.861459 30184 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:10.821520 32469 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.864298 30179 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:10.866856 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51701.7us
W20260709 13:12:10.867326 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 100166us
I20260709 13:12:10.867643 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:10.869807 30185 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:10.869858 30001 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.736s (SENT)
I20260709 13:12:10.870464 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:10.870723 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:10.837831 30733 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:10.836611 32438 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.874178 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.869634 32443 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.874349 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.875566 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.876338 32388 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.899238 30183 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:10.873831 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.876886 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:10.900555 30036 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.876999 30113 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.875648 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.901317 30113 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.880859 32381 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.880568 32399 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.867475 32419 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.877072 32444 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:12:10.855178 32390 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:10.935113 30150 connection.cc:256] RPC call timeout handler was delayed by -1.4327922179998041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:12:10.846851 32462 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.885800 30034 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:10.885879 32408 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:10.886482 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.939213 30180 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:10.886914 32465 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.879474 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:10.894976 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 62271us
I20260709 13:12:10.879227 30184 raft_consensus.cc:2368] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:10.903138 30112 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:10.906679 30077 leader_election.cc:400] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:10.941661 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.900141 30185 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:12:10.907361 30001 leader_election.cc:336] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.833s (SENT)
I20260709 13:12:10.942178 30004 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:10.942523 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.866557 32463 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:10.953186 32481 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.903803 32430 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:10.933295 32422 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:10.948563 32423 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.906622 32443 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:10.956074 32390 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:10.838219 32362 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:12:10.957738 32463 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:10.957914 32464 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.958668 32463 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:10.957103 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 77708.2us
I20260709 13:12:10.960852 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:10.962186 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:10.962646 32399 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:10.904426 32418 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.942322 30113 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:10.970021 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.970392 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:10.971684 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:10.972265 30108 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.973047 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:10.973708 30738 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.975211 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:10.976714 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.988790 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.990028 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.990538 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:10.990828 30183 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:10.991293 30179 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:10.988811 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 81474.7us
I20260709 13:12:10.992399 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.988983 30182 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:10.994692 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:10.999558 30036 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:10.964038 32408 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:10.837782 32456 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.002262 32408 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.003479 32408 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.913322 32388 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:11.008989 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:11.009639 30180 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.010061 30108 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
W20260709 13:12:11.016076 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:11.016521 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.016469 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:11.017325 30183 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:11.023977 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53698us
W20260709 13:12:11.079089 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.022296 32399 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.004756 32430 raft_consensus.cc:2764] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:12:10.973002 32291 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:12:10.982702 32204 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:12:11.085621 32470 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.010968 32423 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.092053 30738 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:11.106662 32422 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.125939 32422 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.127120 30184 raft_consensus.cc:1217] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Deduplicated request from leader. Original: 1.2->[2.3-4.5]   Dedup: 4.5->[]
I20260709 13:12:11.127730 30184 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: [2.3-4.5]
I20260709 13:12:11.128594 32422 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:11.108817 32402 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:11.088357 32418 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:11.011758 30733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:10.957144 32390 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.022465 30178 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:11.115074 32388 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:11.159569 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 229115us
I20260709 13:12:11.142520 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:11.139111 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.183315 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.185053 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:11.185166 30001 leader_election.cc:336] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.898s (SENT)
W20260709 13:12:11.182690 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 162480us
I20260709 13:12:11.207274 30113 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:11.206537 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:11.201323 30180 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
W20260709 13:12:11.205094 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 182155us
I20260709 13:12:11.131063 32401 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:11.134778 32443 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:11.214365 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.195922 30733 raft_consensus.cc:606] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.194278 32438 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.221840 30733 raft_consensus.cc:614] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:11.195120 32355 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:11.233342 29984 auto_rebalancer.cc:893] Removing replace marker failed: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:11.205863 32484 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.234081 29984 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:12:11.241460 29984 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:11.143500 32469 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.236644 30033 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:11.237561 32418 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:11.252503 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:11.237869 32488 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:11.224403 32470 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:11.235983 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51052us
I20260709 13:12:11.244611 32484 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.220072 32401 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:11.253190 30737 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:11.280242 30737 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:11.240094 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:11.276995 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:11.278136 30734 raft_consensus.cc:2368] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:11.269014 30111 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:11.253087 32490 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:11.265754 31913 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:11.284286 32469 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:11.284607 30740 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:11.281774 30738 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:11.251632 32462 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.281224 30737 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.292429 30737 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.292995 32462 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:11.247916 32355 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:11.294052 32355 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.298599 30736 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:11.301846 30036 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:11.306137 31913 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:11.307078 32484 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:11.308319 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.308075 32401 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.310173 32435 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.310741 32435 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.317689 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:11.318428 30038 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:11.310312 32288 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.324996 30737 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:11.328111 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51212.2us
I20260709 13:12:11.334909 30079 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:11.335775 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:11.272527 32422 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:11.313184 32435 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:11.344647 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:11.345912 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.342896 32244 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:12:11.351681 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:11.346884 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:11.352854 30180 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.353217 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:11.347348 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 133114us
I20260709 13:12:11.361375 32435 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:11.361954 32435 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.362303 32435 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.364398 30002 leader_election.cc:400] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
W20260709 13:12:11.365361 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 147518us
W20260709 13:12:11.367509 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.320685 32470 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.366603 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.338752 32418 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.339421 32480 raft_consensus.cc:2764] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:12:11.375356 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.385389 30180 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:11.343515 32422 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:11.434413 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 58922.4us
I20260709 13:12:11.437701 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:11.441090 30031 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.437915 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:11.442169 30037 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.438175 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:11.443241 30032 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:11.364845 32481 raft_consensus.cc:2764] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:12:11.451749 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 266620us
I20260709 13:12:11.352110 32288 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:11.456568 30001 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.910s (SENT)
I20260709 13:12:11.457085 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.445516 32430 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:11.476958 32430 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.477336 32430 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:11.477597 30001 leader_election.cc:336] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.999s (SENT)
I20260709 13:12:11.478063 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:11.446955 32422 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.439733 32488 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:11.455965 32484 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:11.452723 32411 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:11.491364 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.456871 32465 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:11.456740 32408 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:12:11.488934 32488 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.511821 30031 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:11.500769 32411 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.497092 32113 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:11.514164 32419 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.002s
I20260709 13:12:11.506240 32484 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:11.522363 32488 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:11.539775 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 186650us
I20260709 13:12:11.535398 32411 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:11.546908 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.560516 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:11.565479 32484 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.571456 32399 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.551062 32419 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.556329 32288 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.581810 30187 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:11.582846 32419 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:11.589001 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.590435 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.591442 30104 raft_consensus.cc:2368] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6.
I20260709 13:12:11.575584 32481 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:11.595234 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.596098 30104 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:11.597644 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:11.597769 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 120223us
I20260709 13:12:11.598289 30108 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:12:11.598486 30001 leader_election.cc:336] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.037s (SENT)
I20260709 13:12:11.598888 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.600178 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.600925 30108 raft_consensus.cc:2368] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6.
W20260709 13:12:11.601917 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 143729us
I20260709 13:12:11.603295 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.603543 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.604180 32486 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.604243 30108 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:11.606033 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.606637 30112 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:11.608132 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.608186 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.609638 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.610248 30107 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:11.611488 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.615433 30111 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:11.612444 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.612783 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.616309 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:11.616672 30108 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:12:11.616669 30107 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:12:11.611130 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.594460 32481 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:11.621441 30001 leader_election.cc:336] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.045s (SENT)
I20260709 13:12:11.623473 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.624382 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.624996 30106 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.625689 30153 leader_election.cc:400] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:11.626005 30153 leader_election.cc:403] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.628265 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.629014 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.630573 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.629027 30112 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:11.631235 30108 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:12:11.633124 32503 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:12:11.634472 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:11.636466 32501 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:11.622627 32390 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.605577 32490 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:11.641538 30733 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:11.625144 32481 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.630170 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.650704 30105 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:11.651399 30110 raft_consensus.cc:2368] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4.
W20260709 13:12:11.653661 30001 leader_election.cc:336] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.048s (SENT)
I20260709 13:12:11.654335 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.656570 30031 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:11.658600 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:11.659636 30031 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:11.611121 32497 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.660872 32390 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:11.668231 32490 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.668831 32390 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.667635 30106 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:11.672168 30037 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:11.495859 31913 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:11.674337 30001 leader_election.cc:336] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.053s (SENT)
I20260709 13:12:11.650075 32355 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:11.680312 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:11.652931 32465 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.685858 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.686591 30110 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:11.687487 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.688282 30105 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:11.688460 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.689270 30111 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:11.689165 30107 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:11.689811 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.690315 32399 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.690915 32399 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.692332 32422 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:11.693427 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:11.689445 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:11.694397 30112 raft_consensus.cc:2376] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4. Re-sending same reply.
I20260709 13:12:11.694387 30107 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:11.690526 30110 raft_consensus.cc:2368] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6.
W20260709 13:12:11.696522 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68154.2us
W20260709 13:12:11.700109 30001 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.058s (SENT)
I20260709 13:12:11.700757 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:11.700203 30107 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:11.702216 30106 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:11.704020 30104 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:11.680120 32506 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.705710 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:11.696399 32399 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:11.702150 32438 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.704481 32465 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:11.760550 32422 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:11.763746 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 63666.6us
W20260709 13:12:11.770689 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.877426 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:11.878064 30734 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.922303 30106 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:11.928035 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:11.937063 32518 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:11.947146 32510 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.947768 32510 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.954290 32422 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.954881 32422 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.961354 30734 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:11.955265 32422 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.970053 30738 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:11.970172 30736 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:11.974620 32510 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:11.978171 30111 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:11.978289 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.980616 32486 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:11.990283 32516 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:12:11.724483 32506 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.994944 32506 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:11.996438 32435 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:12:11.996915 32435 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:11.998981 32435 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:12.000576 32495 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:12:11.933192 32512 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.012140 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.013746 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.016319 30109 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:11.877004 32401 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:12.019390 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.020305 30109 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:12.008827 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:12.022291 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 148190us
I20260709 13:12:12.022749 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.023339 30110 raft_consensus.cc:2376] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6. Re-sending same reply.
I20260709 13:12:12.015023 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.026273 30111 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.027051 32362 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:12.052385 32506 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:12.053772 30178 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:12.054133 32506 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:12.016244 32481 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.065129 30113 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:12.042127 30036 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:12.108165 30030 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:12.087277 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.085127 30111 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:12.112097 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.112749 30036 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:12.122557 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:12.123623 30036 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:12:12.074362 32488 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
W20260709 13:12:12.080621 32430 consensus_meta.cc:287] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:12:12.138561 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:12.141345 30001 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.201s (SENT)
W20260709 13:12:12.123986 32411 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.005s
I20260709 13:12:12.164207 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.165673 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:12.166141 32493 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.666s	user 0.007s	sys 0.001s
I20260709 13:12:12.166370 30029 raft_consensus.cc:2368] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:12.167321 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.168010 30029 raft_consensus.cc:2368] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:12.168550 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 347) took 1193 ms. Trace:
W20260709 13:12:12.173267 30001 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.202s (SENT)
I20260709 13:12:12.180001 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.173048 30181 rpcz_store.cc:276] 0709 13:12:10.975272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.975403 (+   131us) service_pool.cc:224] Handling call
0709 13:12:11.008191 (+ 32788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.019546 (+ 11355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.019577 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.081682 (+ 62105us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.228959 (+147277us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:11.229025 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.229134 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.165431 (+936297us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:12.168148 (+  2717us) raft_consensus.cc:1685] finished
0709 13:12:12.168171 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.168425 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2489,"raft.queue_time_us":9434,"raft.run_cpu_time_us":6604,"raft.run_wall_time_us":174603,"spinlock_wait_cycles":6355200,"thread_start_us":142196,"threads_started":1,"wal-append.queue_time_us":359007}
I20260709 13:12:12.185289 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.187736 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:12.134812 32187 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:12:12.167855 32422 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.195703 30036 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:12.154826 32488 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:12.198038 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.158372 32430 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:12.204002 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 124212us
I20260709 13:12:12.171741 32411 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.189642 32481 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.207018 32510 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:12.208608 32498 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:12.213152 30001 leader_election.cc:400] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6.
I20260709 13:12:12.218873 30001 leader_election.cc:403] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:12.216164 32411 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.216157 30108 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:12.216840 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.234239 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.233147 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:12.249593 32422 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.257001 32535 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6.
I20260709 13:12:12.269271 30111 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:12.279699 30106 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.282853 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:12.284215 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:12.285007 30180 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.287531 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:12.294595 32488 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.295182 32430 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.295673 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:12.295805 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:12.294636 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:12.298185 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 65173.7us
I20260709 13:12:12.299075 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:12.299638 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:12.310355 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:12.266227 32423 consensus_queue.cc:1059] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:12:12.312140 31913 consensus_meta.cc:287] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:12:12.301892 32524 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:12.329703 32355 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:12:12.326499 32411 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:12.353060 30031 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:12.379853 30183 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:12.345079 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:12.379293 32430 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:12.386734 32430 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:12.387723 32430 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.388998 32430 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:12.384979 32411 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.293787 32490 consensus_queue.cc:1059] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:12:12.392993 32411 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.393172 32423 raft_consensus.cc:3055] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:12.393633 32423 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:12.394390 32423 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.377782 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:12.397710 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 188572us
I20260709 13:12:12.399935 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.401556 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.402390 30109 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:12.402864 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.403486 30113 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.405081 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.405788 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:12.405982 30109 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:12.408937 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.410087 30111 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:12.412050 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.413252 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.413823 30112 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.416392 30106 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:12.410243 30110 raft_consensus.cc:3055] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.407181 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.418171 30110 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:12.419088 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 161471us
I20260709 13:12:12.423681 30105 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:12.425388 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.432633 30106 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:12.397866 32524 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.421749 30110 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.436764 30737 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:12.437227 30110 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.418296 32355 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:12.447232 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.441314 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.451074 30111 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:12.449816 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:12.432546 32411 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.453217 32411 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.453532 32484 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:12.454223 30187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 1918) took 1593 ms (client timeout 2106 ms). Trace:
W20260709 13:12:12.454682 30187 rpcz_store.cc:269] 0709 13:12:10.860521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.860645 (+   124us) service_pool.cc:224] Handling call
0709 13:12:12.454039 (+1593394us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002684d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:12.454164 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655852928}
I20260709 13:12:12.455317 32411 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.450244 30112 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:12.477440 30150 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.503s (SENT)
W20260709 13:12:12.713133 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.730976 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:12.731453 30106 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:12.641956 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.465134 30113 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:12.466698 30105 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:12:12.735808 30105 pending_rounds.cc:85] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 4
I20260709 13:12:12.738853 30105 pending_rounds.cc:107] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:12:12.446059 32481 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.736760 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 259412us
I20260709 13:12:12.774695 30107 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:12.776793 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:12.755805 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.776938 30105 raft_consensus.cc:2917] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:12:12.777616 30106 raft_consensus.cc:2376] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6. Re-sending same reply.
I20260709 13:12:12.737794 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:12.780480 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:12.721637 32540 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:12:12.438863 32524 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:12.514518 32503 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:12.784610 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.788479 32484 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.531107 32538 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.515321 32355 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:12.790093 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.826169 30105 raft_consensus.cc:2889] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.775341 32411 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.774101 32443 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:12.827953 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.792569 32402 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:12.833668 32402 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.844053 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.842593 32419 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.845829 32484 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.845916 32419 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.847540 30113 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:12.858711 30110 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:12:12.859225 30110 pending_rounds.cc:85] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 1
I20260709 13:12:12.859486 30110 pending_rounds.cc:107] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:12:12.859727 30110 raft_consensus.cc:2889] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.860034 30110 pending_rounds.cc:107] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:12:12.860267 30110 raft_consensus.cc:2889] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.783941 32481 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.866873 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:12.868583 30110 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:12.874521 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:12.879362 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.881660 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:12.882773 30105 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:12.883301 30001 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.865s (SENT)
I20260709 13:12:12.885028 30110 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:12.835634 32411 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:12.831535 32538 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.898191 30105 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:12:12.898537 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 118126us
I20260709 13:12:12.899335 30110 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:12.901639 30106 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:12.900660 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:12.904021 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:12.909235 32419 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.911129 32481 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.885428 32355 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:12.915769 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.918787 30110 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:12.921927 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:12.926963 32512 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:12.927543 32512 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.928242 30181 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.928167 32187 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:12.929592 32402 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.933713 30180 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:12.926273 32537 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.941795 32536 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:12:12.941722 32537 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:12.943229 32411 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:12.943830 32537 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:12.944265 32484 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:12.945976 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:12.946528 30734 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.946682 30035 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:12.927402 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:12.934111 32543 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.931241 32461 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:12:12.998670 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:12.999449 30034 raft_consensus.cc:606] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:12.999845 30034 raft_consensus.cc:614] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:12.994163 30037 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:13.005903 30734 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:13.012657 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36690 (request call id 18) took 1136 ms. Trace:
I20260709 13:12:13.013130 30034 rpcz_store.cc:276] 0709 13:12:11.870682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.998546 (+1127864us) service_pool.cc:224] Handling call
0709 13:12:13.006704 (+  8158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:13.048385 30111 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:13.058588 30108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 1812) took 1371 ms (client timeout 1758 ms). Trace:
W20260709 13:12:13.059147 30108 rpcz_store.cc:269] 0709 13:12:11.687101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.687226 (+   125us) service_pool.cc:224] Handling call
0709 13:12:13.058288 (+1371062us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000a0d54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:13.058470 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213889792}
I20260709 13:12:13.067067 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1815) took 1378 ms. Trace:
I20260709 13:12:13.067682 30104 rpcz_store.cc:276] 0709 13:12:11.688114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.690082 (+  1968us) service_pool.cc:224] Handling call
0709 13:12:11.702792 (+ 12710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.704395 (+  1603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.066742 (+1362347us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400046fd0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:13.066937 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28498816}
I20260709 13:12:13.076680 30038 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:13.076696 30112 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:13.077513 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 388) took 1080 ms. Trace:
I20260709 13:12:13.078013 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 143) took 4804 ms. Trace:
I20260709 13:12:13.077950 30038 rpcz_store.cc:276] 0709 13:12:11.996801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.075959 (+1079158us) service_pool.cc:224] Handling call
0709 13:12:13.076312 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.077215 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.077452 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:13.010398 32512 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:13.078478 29932 rpcz_store.cc:276] 0709 13:12:08.273775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.274134 (+   359us) service_pool.cc:224] Handling call
0709 13:12:13.077909 (+4803775us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:10.556595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:10.557218 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:10.557253 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:12:10.557271 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:10.558306 (+  1035us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:10.558381 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:10.558413 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:12:10.655611 (+ 97198us) tablet.cc:701] Row locks acquired
0709 13:12:10.659009 (+  3398us) write_op.cc:260] PREPARE: finished
0709 13:12:10.666838 (+  7829us) write_op.cc:270] Start()
0709 13:12:10.671325 (+  4487us) write_op.cc:276] Timestamp: P: 1783602730666781 usec, L: 0
0709 13:12:10.671358 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:12:10.740245 (+ 68887us) log.cc:844] Serialized 4386 byte log entry
0709 13:12:10.934292 (+194047us) op_driver.cc:464] REPLICATION: finished
0709 13:12:11.279625 (+345333us) write_op.cc:301] APPLY: starting
0709 13:12:11.287546 (+  7921us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:11.287788 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:11.287914 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:11.289198 (+  1284us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:11.367058 (+ 77860us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:12:11.414784 (+ 47726us) write_op.cc:312] APPLY: finished
0709 13:12:11.496330 (+ 81546us) log.cc:844] Serialized 77 byte log entry
0709 13:12:11.505522 (+  9192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.522558 (+ 17036us) write_op.cc:454] Released schema lock
0709 13:12:11.525440 (+  2882us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:11.572049 (+ 46609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.572118 (+    69us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19045,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":335269,"apply.run_cpu_time_us":4630,"apply.run_wall_time_us":282486,"num_ops":10,"prepare.queue_time_us":54176,"prepare.run_cpu_time_us":4770,"prepare.run_wall_time_us":183998,"replication_time_us":262786,"thread_start_us":324611,"threads_started":2}]]}
I20260709 13:12:13.029090 32187 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:12:13.031816 32538 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:13.100584 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 165150us
I20260709 13:12:13.099083 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:13.083781 32430 consensus_meta.cc:287] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.001s
W20260709 13:12:13.137655 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 233686us
I20260709 13:12:13.143918 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:13.144819 30179 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.149580 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:13.151696 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.154906 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:13.160075 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.164021 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:13.164739 30182 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.164825 30001 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:13.201524 30150 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.606s (SENT)
I20260709 13:12:13.125694 32512 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:13.216603 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 201686us
I20260709 13:12:13.222093 30037 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:13.156520 32430 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:13.156168 32464 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:13.158183 32466 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
W20260709 13:12:13.272415 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.166278 32461 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.252s
I20260709 13:12:13.413887 32430 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.414409 32538 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.386861 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 278909us
W20260709 13:12:13.327890 32544 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:12:13.415072 32538 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.416261 32430 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:13.331553 32546 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:13.417259 32538 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:13.276412 29931 catalog_manager.cc:5697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 1 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:13.417637 32546 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.418363 29931 catalog_manager.cc:5697] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:13.419885 32546 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:13.160075 32490 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.421000 32490 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.411404 30035 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:13.414366 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.208227 32484 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.424535 32464 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.214418 32481 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.428403 32481 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.430656 32464 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:13.431981 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:13.355244 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.423132 32490 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:13.211688 32537 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:13.230755 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:13.452097 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.456543 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.463301 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:13.470709 30105 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.016s
W20260709 13:12:13.504189 30105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.005s	sys 0.017s
W20260709 13:12:13.460050 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44729.4us
I20260709 13:12:13.460819 30179 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:13.413089 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 246400us
I20260709 13:12:13.457599 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:13.508391 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51003.8us
I20260709 13:12:13.469456 29931 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:13.471071 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.487069 30037 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:12:13.487942 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:13.489387 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.469097 32537 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:13.509377 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:13.484629 32512 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:13.514678 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:13.523489 30038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:13.537205 30038 raft_consensus.cc:606] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.521688 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:13.512717 30037 pending_rounds.cc:85] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 4
I20260709 13:12:13.538805 30037 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:12:13.539111 30037 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:13.524534 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 415477us
I20260709 13:12:13.524461 32538 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:13.559593 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.561357 30029 raft_consensus.cc:2368] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.565292 30036 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.566854 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.533310 32430 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.602123 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:13.577236 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 111515us
I20260709 13:12:13.602772 30111 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:13.603307 30077 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:13.531569 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:13.546271 29931 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 4 to 2, term changed from 5 to 3, leader changed from <none> to 34f51764a89048468a6faa21020812b0 (127.28.62.129), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from VOTER to NON_VOTER. New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:12:13.609952 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.610141 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.611331 30077 leader_election.cc:400] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.611702 30077 leader_election.cc:403] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:13.613916 29931 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 4 to 5, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:13.615505 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:13.615412 29931 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:13.550340 32560 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.622498 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:13.626068 30038 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.623278 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:13.623593 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 82934.4us
I20260709 13:12:13.630544 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:13.569648 32546 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.606804 32430 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.605291 32538 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:13.620472 32481 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:13.641299 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:13.636600 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 122070us
I20260709 13:12:13.654693 30038 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:13.624603 32486 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:13.601223 32558 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:12:13.668460 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 57253.4us
I20260709 13:12:13.670228 30077 leader_election.cc:400] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.670544 30077 leader_election.cc:403] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:13.680349 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.642019 32430 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.634270 32426 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:12:13.645408 32559 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:13.676409 32481 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:13.638046 32461 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:12:13.703449 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 161382us
I20260709 13:12:13.707473 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:13.713372 30182 consensus_meta.cc:287] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
I20260709 13:12:13.713816 30182 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
W20260709 13:12:13.691233 32571 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:12:13.719432 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:13.720942 32548 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:12:13.722180 30037 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:12:13.725871 32553 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:12:13.643930 32537 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.731060 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:13.731212 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 73714.7us
I20260709 13:12:13.732694 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:13.733199 30182 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:13.639452 32560 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.776821 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:13.764904 32524 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.938s	user 0.006s	sys 0.007s
I20260709 13:12:13.778415 32524 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.718106 32411 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:13.693840 32462 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:12:13.764902 32578 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.783170 32578 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.677922 32486 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.640009 32512 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.786648 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:13.777796 30037 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:13.787688 30038 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:13.765060 32538 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:13.798563 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.809044 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:13.814826 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 110496us
I20260709 13:12:13.822438 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:13.823400 30038 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:13.767372 32546 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:13.830096 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1938) took 2247 ms. Trace:
I20260709 13:12:13.831779 30184 rpcz_store.cc:276] 0709 13:12:11.583009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.583149 (+   140us) service_pool.cc:224] Handling call
0709 13:12:11.583503 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.583878 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.583904 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.589041 (+  5137us) log.cc:844] Serialized 26 byte log entry
0709 13:12:12.913162 (+1324121us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b180023f440. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:13.094427 (+181265us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:13.094471 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.094538 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.820598 (+726060us) raft_consensus.cc:1685] finished
0709 13:12:13.820631 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.829981 (+  9350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11512,"raft.queue_time_us":3287,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10589,"spinlock_wait_cycles":9755520,"thread_start_us":181084,"threads_started":1,"wal-append.queue_time_us":1858668}
I20260709 13:12:13.818533 32423 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.817726 32481 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:13.841811 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 122466us
W20260709 13:12:13.842857 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 110250us
I20260709 13:12:13.818225 32545 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.852677 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:13.854421 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.865921 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.868387 30077 leader_election.cc:400] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:13.843677 32450 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:13.870837 32556 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:12:13.855634 32583 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.844126 32565 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:13.845744 32578 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.890425 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.855882 32506 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:13.834949 32546 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:13.875924 32559 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:13.928436 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52674us
I20260709 13:12:13.926810 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.859262 32444 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:13.876271 32577 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:13.913539 32419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.014s
I20260709 13:12:13.950196 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:13.933836 32481 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:13.923998 32590 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.959681 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:13.899091 32450 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:13.951879 32419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.018s
W20260709 13:12:13.950547 32566 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:12:13.957957 32564 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:12:13.897378 32575 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:12:13.930051 32506 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.006063 32461 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.027072 32590 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.027504 32584 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.002344 32481 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:14.029422 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1271) took 1435 ms. Trace:
I20260709 13:12:14.029822 32576 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:14.030715 32486 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:13.944658 32589 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:13.939152 31913 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:14.048205 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1283) took 1311 ms. Trace:
I20260709 13:12:13.951538 32577 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:14.058612 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 112088us
W20260709 13:12:14.063141 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 432258us
I20260709 13:12:14.110644 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.111246 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.111891 30038 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
W20260709 13:12:14.115260 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 165141us
I20260709 13:12:14.018247 32484 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.074998 32481 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.107731 30105 rpcz_store.cc:276] 0709 13:12:12.736842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.899224 (+162382us) service_pool.cc:224] Handling call
0709 13:12:12.904029 (+  4805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.504853 (+600824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.504904 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.523325 (+ 18421us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.819046 (+295721us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:13.844467 (+ 25421us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.844649 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.844721 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.032087 (+187366us) raft_consensus.cc:1685] finished
0709 13:12:14.032113 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.047929 (+ 15816us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12657,"prepare.queue_time_us":26468,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4752,"raft.queue_time_us":50344,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":25743,"thread_start_us":815157,"threads_started":2,"wal-append.queue_time_us":396499}
I20260709 13:12:14.067657 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.032089 32551 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.926074 32565 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.071738 30109 rpcz_store.cc:276] 0709 13:12:12.593911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.594100 (+   189us) service_pool.cc:224] Handling call
0709 13:12:13.064499 (+470399us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:13.064762 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.065283 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.065326 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.065972 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.499450 (+433478us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:13.625645 (+126195us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.717170 (+ 91525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.717266 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.029082 (+311816us) raft_consensus.cc:1685] finished
0709 13:12:14.029188 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.029338 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22478,"prepare.queue_time_us":191941,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":151349,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"spinlock_wait_cycles":10590976,"thread_start_us":583534,"threads_started":3,"wal-append.queue_time_us":960577}
I20260709 13:12:14.001816 32443 consensus_queue.cc:1059] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:12:14.087419 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 563861us
I20260709 13:12:14.031927 32507 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:12:14.090716 32547 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:14.091365 32588 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:12:14.092293 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 413) took 1091 ms. Trace:
I20260709 13:12:14.092757 32506 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:14.052104 32574 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.115993 31913 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.090775 32593 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.124827 32466 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:12:13.902839 32583 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.176424 32583 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:14.099136 32505 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:12:14.101498 32430 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.177874 30035 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:14.094834 32546 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:14.051788 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 197531us
W20260709 13:12:14.120740 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 116095us
I20260709 13:12:14.061520 32204 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:12:14.127861 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.185657 32581 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:12:14.186784 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 58963us
I20260709 13:12:14.188493 32430 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.189210 32547 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.189486 32546 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:14.191340 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:14.117266 32470 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.205947 32470 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.207146 32603 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:14.207770 32603 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.208242 32470 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.067865 32461 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.071033 32560 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.153147 30110 rpcz_store.cc:276] 0709 13:12:13.000495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.000672 (+   177us) service_pool.cc:224] Handling call
0709 13:12:13.001007 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:13.008249 (+  7242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.008280 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:13.016798 (+  8518us) log.cc:844] Serialized 52 byte log entry
0709 13:12:13.355677 (+338879us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:13.522897 (+167220us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.537786 (+ 14889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.537948 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.092053 (+554105us) raft_consensus.cc:1685] finished
0709 13:12:14.092074 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.092230 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21229,"prepare.queue_time_us":258359,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":22266,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":23534,"thread_start_us":387595,"threads_started":2,"wal-append.queue_time_us":480374}
I20260709 13:12:14.097978 32594 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.210026 32603 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:14.173478 32600 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.173974 32602 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.210693 32600 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.210991 32602 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.070860 32590 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.151556 32538 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:12:14.194828 30038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:14.218030 30038 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.217049 32411 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.219339 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.219964 30109 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.220207 32524 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:14.220968 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.221976 30113 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:14.127988 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 60426.7us
I20260709 13:12:14.223170 30004 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.196305 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.197703 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.198032 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.198654 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:14.225028 30185 raft_consensus.cc:2368] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:14.115089 32589 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.209683 32594 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.210418 32461 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.172915 32586 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.213128 32600 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.228799 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.233039 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.239425 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.240095 30108 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:14.243057 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 122639us
I20260709 13:12:14.149034 32537 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.243767 30104 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:14.244724 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.229947 32562 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.226334 32602 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.161132 32574 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.247824 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.249545 32520 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:14.250222 32594 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:14.251121 32605 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:12:14.251643 32590 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.179108 32593 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.238654 32586 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.253417 31913 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:14.254804 32577 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:14.236712 32490 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.312912 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.247179 30109 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:14.244099 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.264489 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:14.284197 30113 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:14.232607 32430 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.245784 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.284982 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:14.286015 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.302172 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.296876 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.238420 32512 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.291332 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.311647 30108 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:14.255347 32450 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:14.324323 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.322808 31913 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.326011 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.323916 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.290618 32562 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.327343 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.332013 32574 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.332248 32545 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:14.332816 32545 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:14.333421 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.333640 32490 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.336417 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 416) took 1118 ms. Trace:
I20260709 13:12:14.336859 30106 rpcz_store.cc:276] 0709 13:12:13.217839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.218005 (+   166us) service_pool.cc:224] Handling call
0709 13:12:13.218344 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.218687 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.218716 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.422068 (+203352us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.899809 (+477741us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b18003c9580. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:14.155328 (+255519us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:14.155366 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.155433 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.309786 (+154353us) raft_consensus.cc:1685] finished
0709 13:12:14.309806 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.336330 (+ 26524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":898,"raft.queue_time_us":152489,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":807,"spinlock_wait_cycles":85379968,"thread_start_us":255011,"threads_started":1,"wal-append.queue_time_us":760547}
I20260709 13:12:14.337711 32512 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.338860 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.340056 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.340711 30109 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:14.341728 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.342780 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.344890 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.345511 30113 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:14.346208 30031 raft_consensus.cc:606] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.346617 30031 raft_consensus.cc:614] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:14.324261 32607 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:12:14.325857 31913 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.323283 32597 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.347656 30111 raft_consensus.cc:2376] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6. Re-sending same reply.
I20260709 13:12:14.348415 30104 raft_consensus.cc:2376] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5. Re-sending same reply.
I20260709 13:12:14.313606 30112 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
W20260709 13:12:14.350943 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66119.5us
W20260709 13:12:14.351558 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 49501.4us
I20260709 13:12:14.352351 30107 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:14.360838 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.361747 30734 raft_consensus.cc:2393] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:14.345665 32600 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.295226 32565 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:14.374311 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.286633 32470 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:12:14.379657 30079 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:14.355683 32590 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.364647 32469 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.391213 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.391480 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:14.379091 32411 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.423084 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:14.385808 32543 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.427707 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.428809 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.391819 32469 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.371029 32600 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.418042 32520 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:14.452028 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:14.456875 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.455004 32469 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:14.460155 32614 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:12:14.461586 32589 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.466815 30030 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:14.417768 32583 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.444862 32390 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.502537 32578 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.444063 32590 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:14.501075 30077 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 2.198s (SENT)
I20260709 13:12:14.500685 32589 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.387097 32545 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.503314 32578 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.504165 32620 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:14.436450 32411 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.504776 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.472950 32583 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.519640 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.520351 32583 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.378377 32597 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.454866 32574 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.520744 32554 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:12:14.503098 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 201760us
I20260709 13:12:14.513710 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:14.522614 32597 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.522756 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.523365 32620 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.520903 32411 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:14.527681 32619 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:14.528764 32620 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.517099 32590 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.516417 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.510794 32390 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:14.927367 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 394131us
W20260709 13:12:14.764628 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 102811us
I20260709 13:12:14.761056 32583 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.932548 32583 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.545028 32469 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:14.936510 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:14.938215 32627 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:14.937976 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.939126 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.939631 30733 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:14.940984 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.931545 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:14.944602 32583 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.645306 32581 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.307s
I20260709 13:12:14.952230 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:14.681754 32402 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.770592 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1700) took 1207 ms. Trace:
I20260709 13:12:14.992159 30035 rpcz_store.cc:276] 0709 13:12:13.558793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.558924 (+   131us) service_pool.cc:224] Handling call
0709 13:12:14.762486 (+1203562us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54003e17d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:14.766524 (+  4038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301834112}
I20260709 13:12:14.661510 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:14.697427 32460 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.957993 32562 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.699395 32580 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.835000 32560 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.959815 32390 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.686157 32620 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.589838 32543 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.761888 31913 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:14.681542 32411 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.518208 32589 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:14.960808 32590 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.787873 32559 raft_consensus.cc:3055] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:14.962054 32469 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:14.961261 32545 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.965633 32622 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:15.022728 32622 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.023307 32622 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:14.970892 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.948252 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:15.029017 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 80830.9us
I20260709 13:12:15.030027 30001 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:15.030361 32586 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.031222 32586 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:15.031780 32586 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:14.907693 32625 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:12:15.001072 32460 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.034530 32562 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:15.035123 32562 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.001873 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:15.039791 30038 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:15.041165 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:14.544574 32578 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:14.990149 32481 consensus_meta.cc:287] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.006s
I20260709 13:12:14.712548 32597 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:14.965659 32558 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:15.011669 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:15.008612 32620 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.019071 32462 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.052536 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.035672 32562 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.004607 32560 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.118350 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:15.123708 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.125700 30113 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.125765 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:15.150856 30180 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:15.127507 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.150935 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.129334 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.133594 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.036190 32559 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:15.042080 30104 raft_consensus.cc:2376] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5. Re-sending same reply.
I20260709 13:12:15.155079 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:14.999939 32402 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.144548 32460 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.145159 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.032845 32586 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.134982 32456 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:15.145517 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.130465 32524 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.003373 32580 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.072747 32583 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:15.156742 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:15.011492 32543 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.155128 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:15.185678 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 67448.9us
I20260709 13:12:15.119390 32537 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.036356 32411 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.190577 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.242965 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:15.114292 32578 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.196542 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.197990 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.126447 32594 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.275998 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:15.276124 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:15.187512 32631 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
I20260709 13:12:15.276804 30107 raft_consensus.cc:2376] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6. Re-sending same reply.
I20260709 13:12:15.275359 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1286) took 1033 ms. Trace:
I20260709 13:12:15.151818 32558 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:15.278267 32632 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:15.275836 32594 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.194236 32624 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.277016 30112 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:15.277661 30109 rpcz_store.cc:276] 0709 13:12:14.243365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.344565 (+101200us) service_pool.cc:224] Handling call
0709 13:12:14.358245 (+ 13680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.358434 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.358459 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.358504 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:14.358534 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.358589 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.275185 (+916596us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540036b850. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:15.275295 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30744960}
I20260709 13:12:15.143446 32481 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.273522 32578 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.279421 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.280088 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:15.290375 30107 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:15.281221 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:15.275188 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.293102 30108 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:15.189357 32620 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.141083 32597 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.305872 30113 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:15.145705 32462 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.330233 30106 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:15.335955 32462 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.281996 32634 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:15.348094 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1515) took 1120 ms. Trace:
I20260709 13:12:15.348740 30036 rpcz_store.cc:276] 0709 13:12:14.228032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.228151 (+   119us) service_pool.cc:224] Handling call
0709 13:12:14.228444 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.340073 (+111629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.340109 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.340156 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:14.340187 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.347782 (+1007595us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000efe54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:15.347846 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.348015 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256271104}
I20260709 13:12:15.350005 32634 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:15.360700 32580 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.363945 32402 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.339896 32594 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.340032 30108 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:15.292220 32624 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.315637 32633 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:15.280442 32583 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.231243 32456 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.429653 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:15.264277 32524 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.280203 32537 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:15.455204 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 238172us
I20260709 13:12:15.446352 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:15.423974 32580 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.426468 32594 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:15.285923 32559 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.452637 32426 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:15.469491 30187 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:15.458034 32444 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.476354 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.458774 32603 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:15.477059 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:15.477602 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.478257 30185 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:12:15.478696 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 197554us
I20260709 13:12:15.479614 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:15.472108 32580 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.483863 32580 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.484644 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.485670 32560 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.486924 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.487466 32524 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.488837 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.471909 32594 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.489015 32583 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:15.598547 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.573421 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.636369 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:15.649760 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.528268 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.599258 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.646580 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.493814 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:15.652920 30036 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:12:15.568964 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 89436.4us
I20260709 13:12:15.654616 30077 leader_election.cc:400] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:15.655830 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.491245 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:15.658167 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 473559us
I20260709 13:12:15.661147 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.495862 30034 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:15.612964 30033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1518) took 1382 ms. Trace:
I20260709 13:12:15.651494 30738 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:15.671422 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.685549 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.662667 30033 rpcz_store.cc:276] 0709 13:12:14.230304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.230497 (+   193us) service_pool.cc:224] Handling call
0709 13:12:14.248443 (+ 17946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.422208 (+173765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.422305 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.423198 (+   893us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.655126 (+231928us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:14.678983 (+ 23857us) log.cc:844] Serialized 14 byte log entry
0709 13:12:14.686276 (+  7293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.479898 (+793622us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540022b5d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:15.479949 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.479994 (+    45us) raft_consensus.cc:1685] finished
0709 13:12:15.571224 (+ 91230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.612875 (+ 41651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19237,"prepare.queue_time_us":23319,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":96608,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":72749,"spinlock_wait_cycles":247387904,"thread_start_us":276093,"threads_started":2,"wal-append.queue_time_us":519623}
W20260709 13:12:15.477983 32636 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:12:15.476634 32589 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.475730 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.701045 30734 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:15.474156 32444 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:15.528663 32559 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:15.597105 32411 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.528151 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.708535 30741 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:15.528419 32603 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.623373 32558 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:15.753952 32641 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
I20260709 13:12:15.739466 32444 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.687305 32543 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.769949 32543 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:15.770964 32543 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.699337 32583 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.622875 32562 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.749209 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:15.755672 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 407) took 1241 ms. Trace:
I20260709 13:12:15.748483 32411 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:15.753116 32638 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:12:15.785653 30029 rpcz_store.cc:276] 0709 13:12:14.514337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.147265 (+632928us) service_pool.cc:224] Handling call
0709 13:12:15.147589 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.180986 (+ 33397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.181017 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.181520 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.229040 (+ 47520us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:15.229081 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.229146 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.755473 (+526327us) raft_consensus.cc:1685] finished
0709 13:12:15.755495 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.755617 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32996,"raft.queue_time_us":70249,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":27299,"thread_start_us":47202,"threads_started":1,"wal-append.queue_time_us":273375}
I20260709 13:12:15.753849 32578 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.745676 32481 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:15.804307 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55204.2us
I20260709 13:12:15.756997 32634 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.810757 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 426) took 1121 ms. Trace:
I20260709 13:12:15.811352 30105 rpcz_store.cc:276] 0709 13:12:14.689539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.698079 (+  8540us) service_pool.cc:224] Handling call
0709 13:12:14.698538 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.724649 (+ 26111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.724694 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.968610 (+243916us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.135168 (+166558us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:15.135203 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.135274 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.810527 (+675253us) raft_consensus.cc:1685] finished
0709 13:12:15.810544 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.810687 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25583,"raft.queue_time_us":62834,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1827,"thread_start_us":125980,"threads_started":1,"wal-append.queue_time_us":283344}
I20260709 13:12:15.815018 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.815833 30105 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:15.821242 30034 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:15.825783 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 402) took 1323 ms. Trace:
I20260709 13:12:15.826648 30035 rpcz_store.cc:276] 0709 13:12:14.501814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.144318 (+642504us) service_pool.cc:224] Handling call
0709 13:12:15.144660 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:15.152932 (+  8272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.152984 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:15.181935 (+ 28951us) log.cc:844] Serialized 52 byte log entry
0709 13:12:15.426063 (+244128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:15.816780 (+390717us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.824819 (+  8039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.824977 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.825197 (+   220us) raft_consensus.cc:1685] finished
0709 13:12:15.825248 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.825650 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13806,"raft.queue_time_us":14986,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":18063,"thread_start_us":509406,"threads_started":2,"wal-append.queue_time_us":412493}
I20260709 13:12:15.809154 32606 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:15.808558 32594 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.837796 30105 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:15.800638 32583 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.846570 30108 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:15.805853 32411 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.834867 32606 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:15.824556 32634 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:15.854192 32629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.018s
W20260709 13:12:15.876797 32629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.004s	sys 0.018s
I20260709 13:12:15.865885 32606 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:15.917814 30004 connection.cc:256] RPC call timeout handler was delayed by -1.1551157569999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:12:15.919812 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:15.921609 30150 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.837s (SENT)
I20260709 13:12:15.922115 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:15.924335 32624 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.929690 30004 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:15.913766 32646 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:12:15.934211 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.934630 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.936794 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.936882 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:15.939218 30183 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:15.925457 32460 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:15.951390 32456 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.928071 32578 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:15.970086 32622 consensus_meta.cc:287] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.946s	user 0.014s	sys 0.000s
I20260709 13:12:15.970331 32578 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.970746 32622 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:15.972705 32578 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:15.972616 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.974076 32411 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.975764 32486 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.976553 30033 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:15.976315 32486 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.978485 32486 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:15.978662 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.978974 32486 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:15.979385 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.979487 32486 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:15.960086 32524 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.981487 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 421) took 1423 ms. Trace:
I20260709 13:12:15.970232 32543 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.981906 30110 rpcz_store.cc:276] 0709 13:12:14.557704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.557850 (+   146us) service_pool.cc:224] Handling call
0709 13:12:14.930051 (+372201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.295497 (+365446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.295526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:15.295567 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:15.295605 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.981248 (+685643us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54003057d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:15.981293 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.981432 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839961344}
I20260709 13:12:15.982986 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 401) took 1481 ms. Trace:
I20260709 13:12:15.983343 30038 rpcz_store.cc:276] 0709 13:12:14.501443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.081351 (+579908us) service_pool.cc:224] Handling call
0709 13:12:15.081778 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.113420 (+ 31642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.113449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.129325 (+ 15876us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.645721 (+516396us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:15.645761 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.645831 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.982797 (+336966us) raft_consensus.cc:1685] finished
0709 13:12:15.982814 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.982934 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31169,"raft.queue_time_us":37550,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9746,"thread_start_us":460722,"threads_started":1,"wal-append.queue_time_us":649369}
I20260709 13:12:15.984325 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:15.984890 30106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1289) took 1718 ms (client timeout 1837 ms). Trace:
I20260709 13:12:15.974414 32460 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:12:15.962950 32583 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:15.968725 32621 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 1.206s	user 0.007s	sys 0.000s
I20260709 13:12:15.929632 32594 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:15.952646 32637 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:15.928622 32430 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:16.010803 32430 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:16.011391 30002 connection.cc:256] RPC call timeout handler was delayed by -1.300749309999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 13:12:16.012311 32648 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.012871 32648 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:15.985342 30106 rpcz_store.cc:269] 0709 13:12:14.266636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.338593 (+ 71957us) service_pool.cc:224] Handling call
0709 13:12:15.984686 (+1646093us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b5400397454. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:15.984812 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277978368}
I20260709 13:12:15.985634 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.013279 32430 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.014559 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.015916 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.017030 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.987640 32562 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.989694 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:15.989792 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:15.941541 32652 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:15.953519 32634 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.983224 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.042909 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:15.941963 30004 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:16.044629 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 102760us
I20260709 13:12:16.046777 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:15.943959 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.050484 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.051076 30151 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:15.960510 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.052155 30108 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:16.018026 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36690 (request call id 21) took 1766 ms. Trace:
I20260709 13:12:16.053527 30031 rpcz_store.cc:276] 0709 13:12:14.251720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.264316 (+ 12596us) service_pool.cc:224] Handling call
0709 13:12:16.017825 (+1753509us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b540030af54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60cd853 00007fcbeb09b60a 00007fcbe46217d4 00007fcbe4621762 00007fcbe4621691 00007fcbe462160c 00007fcbe46208c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:16.017938 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73525120}
I20260709 13:12:16.021459 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.055297 30112 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:15.985922 32486 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:15.942826 32624 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.020069 32648 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.029953 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:16.030652 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.029920 30736 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:16.066619 30106 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:16.067198 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.056849 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:16.067564 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 123690us
I20260709 13:12:16.067782 30108 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:16.063292 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:16.068400 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.068482 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:15.997179 32654 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.063850 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.070364 30112 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:16.043668 30110 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:16.065608 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.006716 32655 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.024677 32430 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:16.071676 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.073364 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.073800 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.073679 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.076611 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1296) took 1021 ms. Trace:
I20260709 13:12:16.071614 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.077289 32580 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.077785 32558 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:12:16.081998 32444 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.084416 32444 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:16.087242 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1720) took 1786 ms. Trace:
I20260709 13:12:16.071559 32645 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.089259 32622 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.043440 32626 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.087936 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1301) took 1031 ms. Trace:
I20260709 13:12:16.064939 32589 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.090107 32626 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.090270 30104 rpcz_store.cc:276] 0709 13:12:15.056895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.297622 (+240727us) service_pool.cc:224] Handling call
0709 13:12:15.297992 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.687740 (+389748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.687780 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.688404 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.831541 (+143137us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:15.914829 (+ 83288us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.916229 (+  1400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.916379 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.014738 (+ 98359us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18001fa0e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1
0709 13:12:16.016174 (+  1436us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18001fa0e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:16.087716 (+ 71542us) raft_consensus.cc:1685] finished
0709 13:12:16.087736 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.087878 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16517,"prepare.queue_time_us":79421,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":52661,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10784,"spinlock_wait_cycles":37789056,"thread_start_us":576296,"threads_started":3,"wal-append.queue_time_us":373374}
I20260709 13:12:16.075398 30736 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:16.092303 32626 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.092522 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.071703 32647 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:16.097815 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.098040 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.098323 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.064807 32538 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:12:16.075749 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.095228 30110 raft_consensus.cc:2410] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:16.095570 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.098913 30004 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:16.096316 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.076996 30109 rpcz_store.cc:276] 0709 13:12:15.055488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.283276 (+227788us) service_pool.cc:224] Handling call
0709 13:12:15.283635 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:15.284039 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:15.509440 (+225401us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.846627 (+337187us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:15.863093 (+ 16466us) log.cc:844] Serialized 52 byte log entry
0709 13:12:15.863575 (+   482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:16.064368 (+200793us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.066378 (+  2010us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.076316 (+  9938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.076389 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.076430 (+    41us) raft_consensus.cc:1685] finished
0709 13:12:16.076441 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.076558 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53576,"prepare.queue_time_us":621875,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":129,"raft.queue_time_us":94560,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":20596,"spinlock_wait_cycles":36701312,"thread_start_us":534843,"threads_started":3,"wal-append.queue_time_us":328693}
I20260709 13:12:16.103340 32593 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.104847 32490 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.074009 32642 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.067006 32583 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.074786 32648 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:16.107576 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.088514 30037 rpcz_store.cc:276] 0709 13:12:14.300900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.328128 (+ 27228us) service_pool.cc:224] Handling call
0709 13:12:14.328442 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.345180 (+ 16738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.345210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.345660 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.444180 (+ 98520us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:14.444513 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:12:14.444693 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.444776 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.967952 (+1523176us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:16.086906 (+118954us) raft_consensus.cc:1685] finished
0709 13:12:16.087012 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.087173 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22928,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":134817,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":34925,"spinlock_wait_cycles":113204480,"thread_start_us":98189,"threads_started":1,"wal-append.queue_time_us":277280}
I20260709 13:12:16.043586 32594 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.130596 30112 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:16.132068 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.135407 32578 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:16.125464 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57143.2us
I20260709 13:12:16.154652 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.156435 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.073369 32637 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:16.136626 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.138540 32444 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:16.142716 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.143038 32460 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.151750 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1302) took 1091 ms. Trace:
I20260709 13:12:16.131677 32411 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.161278 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.131470 32456 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.132499 32583 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.169975 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:16.133471 32626 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:16.107509 32647 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:16.131096 32634 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:16.132689 32642 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:16.212939 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:16.064658 32652 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.162803 32204 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:16.215468 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54293.6us
I20260709 13:12:16.173363 32460 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.167990 30113 rpcz_store.cc:276] 0709 13:12:15.060102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.307616 (+247514us) service_pool.cc:224] Handling call
0709 13:12:15.308183 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.657889 (+349706us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:15.894473 (+236584us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.059765 (+165292us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.060169 (+   404us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.060634 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.060768 (+   134us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:16.061197 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.062858 (+  1661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.062937 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.151559 (+ 88622us) raft_consensus.cc:1685] finished
0709 13:12:16.151577 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.151694 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30051,"prepare.queue_time_us":210368,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":116,"raft.queue_time_us":42820,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":352,"spinlock_wait_cycles":23424,"thread_start_us":700722,"threads_started":3,"wal-append.queue_time_us":164382}
I20260709 13:12:16.218152 30031 raft_consensus.cc:606] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.224890 30031 raft_consensus.cc:614] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:16.096776 32430 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.168414 32490 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.136475 32426 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:12:16.168174 32593 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:16.228041 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 151878us
I20260709 13:12:16.226267 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:16.229741 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 161351us
I20260709 13:12:16.213209 32583 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.209235 32637 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:16.087939 32655 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.075726 32654 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.234234 32430 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.234728 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:16.176090 32622 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.236522 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.238418 30106 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:16.211771 32589 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.151654 32648 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:16.264135 32648 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.265007 32652 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.164522 32590 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.211058 32626 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.290305 32626 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.217643 32647 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.294790 32655 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.220312 32642 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.222743 32578 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.297236 32460 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:16.278371 32430 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.308130 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:16.314857 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:16.255721 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 99411.4us
I20260709 13:12:16.262782 32589 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.242827 30104 raft_consensus.cc:2410] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:12:16.262784 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:16.325556 30113 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.254240 32559 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.275048 30109 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:16.226243 32634 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.257952 32645 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:16.240161 32490 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.285588 32637 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.286835 32594 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.253574 32593 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.288911 32654 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.352135 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.323820 32578 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:16.354307 32578 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.355527 32593 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.357702 32578 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.358021 32600 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.360730 32634 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.321966 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.328061 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.266427 32622 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.353571 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.327852 30105 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:16.376255 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:16.278717 32606 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.376861 30112 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:16.373132 30113 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:16.378108 30112 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:16.380229 30112 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:16.374620 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 425) took 1750 ms. Trace:
I20260709 13:12:16.352751 32647 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.382454 30111 rpcz_store.cc:276] 0709 13:12:14.624364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.624504 (+   140us) service_pool.cc:224] Handling call
0709 13:12:14.934854 (+310350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.292731 (+357877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.292763 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:15.292816 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:15.292844 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.374381 (+1081537us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400111a54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:16.374426 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.374558 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822590208}
I20260709 13:12:16.364557 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.335646 32645 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:16.470779 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 225885us
I20260709 13:12:16.533743 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.472198 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.540542 32654 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.541215 32654 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.547580 32512 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.381608 32402 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.551847 32647 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:16.552373 32490 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.554220 32622 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.558032 32654 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.559383 32606 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:16.561415 30182 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:16.557178 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:16.617780 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 145651us
I20260709 13:12:16.619236 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:16.630045 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 265578us
I20260709 13:12:16.673182 32600 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.697223 32606 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:16.373299 32626 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:16.704140 32589 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.708078 32583 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.709731 30105 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.710459 32645 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.712181 32645 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.698438 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.674130 32647 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:16.721124 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 101999us
W20260709 13:12:16.743237 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 517028us
I20260709 13:12:16.745658 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:16.743408 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.751646 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.725075 32589 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.708124 32626 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:16.753146 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:16.776777 32648 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.812003 32648 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.812606 32648 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:16.814821 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 63276.3us
W20260709 13:12:16.815574 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 62516us
I20260709 13:12:16.817830 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:16.816742 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:16.816949 32647 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:16.775835 32600 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.820989 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:16.821498 32589 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:16.826135 32589 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.826649 32589 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.827672 32606 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:16.828172 32606 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:16.828603 32606 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:16.830858 32642 consensus_meta.cc:287] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.003s
I20260709 13:12:16.831456 32642 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.832139 32622 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.833215 30113 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.818933 32626 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:16.849337 30001 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:16.855616 30704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.013s	sys 0.033s
W20260709 13:12:16.859869 30704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.013s	sys 0.034s
W20260709 13:12:16.860154 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 532769us
W20260709 13:12:16.858279 30705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.034s	sys 0.049s
W20260709 13:12:16.862607 30705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.034s	sys 0.049s
W20260709 13:12:16.863557 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 580322us
I20260709 13:12:16.864455 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:16.865754 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.866887 30031 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:16.868130 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:16.868820 30036 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.868992 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.871064 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.872715 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.854813 32692 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:16.852877 32626 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.881503 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.882965 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.883374 30737 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:16.882064 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.880352 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:16.891644 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.892666 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.881183 32626 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.878183 32581 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:16.877185 32692 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.892423 30034 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:16.904553 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.905230 30187 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:16.894745 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.886018 32642 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.876523 32583 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.899715 32537 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.881119 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:16.902139 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1526) took 2507 ms. Trace:
I20260709 13:12:16.921118 30032 rpcz_store.cc:276] 0709 13:12:14.394710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.980508 (+1585798us) service_pool.cc:224] Handling call
0709 13:12:15.980794 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.209675 (+228881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.209709 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:16.209753 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:16.209807 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.901836 (+692029us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540013f954. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:16.901897 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.902063 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525901184}
I20260709 13:12:16.905803 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.907060 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.878252 32683 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.896311 30036 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:16.912009 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.923692 30180 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:16.924031 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:16.912286 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.925096 30187 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:16.902933 32581 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.914376 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.914655 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.910614 32634 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.922948 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.912956 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.928012 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:16.929998 30184 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:16.944555 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:16.955615 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.909694 32692 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.956434 30184 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:16.958909 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.954499 32685 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.957350 32583 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.923262 32554 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.955492 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.957594 32634 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.966286 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.964138 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.967403 30183 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:16.968012 32634 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:16.965646 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.969446 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:16.934044 32581 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.970469 30184 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:16.970501 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.972972 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:16.958235 32654 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:16.968976 32691 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:16.924618 32683 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.971167 32583 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:16.977766 32606 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:17.065721 30705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.910s (SENT) [suppressed 52 similar messages]
I20260709 13:12:17.082069 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.013123 32654 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.081283 32635 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:17.090332 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.094895 32583 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.097095 32606 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.100003 32589 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.076303 32691 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.102198 32507 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:17.104756 32603 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.113866 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.123327 32683 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.125180 32589 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.125595 30038 raft_consensus.cc:2368] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:17.129964 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:17.133988 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.134646 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.135772 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.136396 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.136724 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.137257 30185 raft_consensus.cc:2410] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:12:17.137775 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.137964 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.138906 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:17.140568 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0270408080000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:12:17.110846 32537 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.149919 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.160723 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.162595 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.125620 32691 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.128304 32507 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:17.131868 32562 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.118927 32635 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.182891 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.125998 32648 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.169687 32642 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.172848 32187 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.173907 32589 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.175216 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.165355 32537 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.206125 32683 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.230486 32600 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:17.231376 32600 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.239761 32600 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:17.262167 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 106215us
W20260709 13:12:17.261196 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 195516us
I20260709 13:12:17.183887 32562 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:17.257332 32695 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 13:12:17.269668 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 128644us
I20260709 13:12:17.272684 30002 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.199611 32642 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.274245 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1864) took 1046 ms. Trace:
I20260709 13:12:17.287153 32600 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:17.291297 30002 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.293449 30180 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.294251 32402 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:17.295465 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.304495 32524 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:17.202314 32187 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.202020 32626 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.320379 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 450) took 1655 ms. Trace:
I20260709 13:12:17.255494 32683 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.202728 32589 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.323378 30734 rpcz_store.cc:276] 0709 13:12:15.651061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.651220 (+   159us) service_pool.cc:224] Handling call
0709 13:12:15.678663 (+ 27443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.706416 (+ 27753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.306674 (+1600258us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400780350. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:17.306838 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62339456}
I20260709 13:12:17.324390 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:17.305891 32586 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:17.307343 30111 rpcz_store.cc:276] 0709 13:12:16.227415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.699395 (+471980us) service_pool.cc:224] Handling call
0709 13:12:16.724130 (+ 24735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.724428 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:16.744086 (+ 19658us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.151362 (+407276us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18002485c0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c7323a 00007fcbe60dda2a
0709 13:12:17.273903 (+122541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:17.273955 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:17.274000 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.274067 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.274186 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7060,"prepare.queue_time_us":19764,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1520,"raft.queue_time_us":39994,"spinlock_wait_cycles":10446848,"thread_start_us":115141,"threads_started":1}
I20260709 13:12:17.276278 32622 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:12:17.321465 32524 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:17.328645 32637 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.322268 32402 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:17.400053 32699 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:12:17.264043 32507 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.412329 30183 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:17.404615 32586 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:17.422726 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 100896us
I20260709 13:12:17.419726 32507 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.418581 32586 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.420258 32711 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:17.433210 32701 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.107s	user 0.005s	sys 0.007s
W20260709 13:12:17.433473 32698 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:12:17.434161 32642 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.429177 32654 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.434528 32581 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.435653 32683 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.436390 32635 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.431939 32711 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.429364 32648 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.438901 32589 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.439129 32711 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.429756 32586 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.437093 32692 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:17.474354 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 150903us
I20260709 13:12:17.476471 30032 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:17.481961 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 210291us
I20260709 13:12:17.483613 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1855) took 1539 ms. Trace:
I20260709 13:12:17.484213 30113 rpcz_store.cc:276] 0709 13:12:15.944519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.377884 (+433365us) service_pool.cc:224] Handling call
0709 13:12:16.378239 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.833692 (+455453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.482917 (+649225us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b540038c054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:17.483372 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045916928}
W20260709 13:12:17.487208 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.494165 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.495791 30734 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:17.497641 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.499603 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:17.437292 32581 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:17.505330 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.507829 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1766) took 1571 ms (client timeout 1580 ms). Trace:
W20260709 13:12:17.532783 30182 rpcz_store.cc:269] 0709 13:12:15.935962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.936113 (+   151us) service_pool.cc:224] Handling call
0709 13:12:17.507289 (+1571176us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003b1854. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:17.507548 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336906624}
I20260709 13:12:17.533998 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.534914 32597 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.536110 32626 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.538902 32537 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.539963 32537 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:17.539494 32622 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:17.419128 32524 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.542071 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.542441 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.542860 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 432) took 1802 ms. Trace:
I20260709 13:12:17.542900 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.543473 30110 rpcz_store.cc:276] 0709 13:12:15.740880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.145595 (+404715us) service_pool.cc:224] Handling call
0709 13:12:16.848732 (+703137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.849020 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:16.849047 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:16.849088 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:16.849122 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.849177 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.542477 (+693300us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540029fed0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:17.542656 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551704960}
I20260709 13:12:17.544812 32545 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.519755 32402 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.545845 32545 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.526944 32461 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.551020 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.531143 32642 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.552346 32642 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.555351 32642 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.555573 30181 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:17.556151 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.524729 32355 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:17.558418 32355 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.560330 32603 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.561683 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 1953) took 2440 ms. Trace:
I20260709 13:12:17.561210 32603 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.564652 32603 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:17.531350 32562 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.523034 32187 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.566496 32355 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.550594 32461 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.572526 30002 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.572857 32461 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.562247 30179 rpcz_store.cc:276] 0709 13:12:15.121161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.122150 (+   989us) service_pool.cc:224] Handling call
0709 13:12:15.122570 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.279273 (+156703us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:15.641621 (+362348us) log.cc:844] Serialized 14 byte log entry
0709 13:12:15.818510 (+176889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:15.818806 (+   296us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:15.818874 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.175279 (+1356405us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18003edd00. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419
0709 13:12:17.560956 (+385677us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540004a1d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:17.561054 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.561414 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4408,"prepare.queue_time_us":56252,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":597,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5933,"spinlock_wait_cycles":364509440,"thread_start_us":398724,"threads_started":2,"wal-append.queue_time_us":230964,"wal-append.run_cpu_time_us":1482,"wal-append.run_wall_time_us":1081005}
I20260709 13:12:17.577956 32545 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:17.539963 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.583534 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1851) took 1640 ms. Trace:
I20260709 13:12:17.590058 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.590225 30105 rpcz_store.cc:276] 0709 13:12:15.943123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.376204 (+433081us) service_pool.cc:224] Handling call
0709 13:12:16.376612 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.710210 (+333598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.582834 (+872624us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000d2d54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:17.583257 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765564672}
I20260709 13:12:17.592515 30187 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:17.568912 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.593740 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.594352 30180 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 2.
I20260709 13:12:17.594524 30736 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
W20260709 13:12:17.601455 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 88927.8us
I20260709 13:12:17.590909 30741 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:17.607874 32562 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.612454 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.613847 32562 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:17.509569 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:17.586751 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1859) took 1640 ms. Trace:
I20260709 13:12:17.623476 32583 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.624367 32583 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.583992 32204 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:17.626260 32204 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.599594 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:17.616986 32524 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.641885 30105 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.647485 32204 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.622463 30112 rpcz_store.cc:276] 0709 13:12:15.945758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.380859 (+435101us) service_pool.cc:224] Handling call
0709 13:12:16.923362 (+542503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:16.923572 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:16.923811 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.160791 (+236980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:17.160850 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:17.160894 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.160954 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.586257 (+425303us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54000a1250. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:17.586510 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":554,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":22668,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3405,"spinlock_wait_cycles":1247041408,"thread_start_us":218763,"threads_started":1,"wal-append.queue_time_us":344640}
W20260709 13:12:17.650059 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 140791us
I20260709 13:12:17.619506 32597 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.657616 32683 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:17.658038 30001 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:17.658317 32683 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.658782 32683 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.659202 32692 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.659221 32648 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:17.660180 32648 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:17.660230 32692 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:17.661639 30183 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:17.661981 32648 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.662321 32691 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:17.663028 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 50702.9us
I20260709 13:12:17.665129 32589 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:17.619174 32586 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.672442 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.680699 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:17.681092 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:17.682010 30106 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:17.685338 32586 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:17.687036 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 59754.3us
I20260709 13:12:17.687819 32597 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.691108 32691 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.681957 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.696535 32562 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:17.707168 32700 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.330s	user 0.000s	sys 0.013s
I20260709 13:12:17.710263 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.709435 32562 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.712610 32562 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.712405 30186 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.716619 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1298) took 2660 ms. Trace:
I20260709 13:12:17.717058 30107 rpcz_store.cc:276] 0709 13:12:15.056049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.291486 (+235437us) service_pool.cc:224] Handling call
0709 13:12:15.291883 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.647360 (+355477us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:15.829206 (+181846us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.106625 (+1277419us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800442fc0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c7323a 00007fcbe60dda2a
0709 13:12:17.264584 (+157959us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.536611 (+272027us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b1800442fc0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe5c7b4bc 00007fcbe2fc948b 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287
0709 13:12:17.536857 (+   246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.537908 (+  1051us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.538192 (+   284us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:17.602571 (+ 64379us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.602842 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.602975 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.713432 (+110457us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b1800442fc0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:17.716206 (+  2774us) raft_consensus.cc:1685] finished
0709 13:12:17.716231 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.716427 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37981,"prepare.queue_time_us":227133,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":2261,"raft.queue_time_us":110420,"raft.run_cpu_time_us":564,"raft.run_wall_time_us":19060,"spinlock_wait_cycles":112732544,"thread_start_us":771571,"threads_started":5,"wal-append.queue_time_us":1546586}
I20260709 13:12:17.722786 32626 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:17.724754 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44506.9us
I20260709 13:12:17.731499 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:17.733371 32524 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:17.733923 32524 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:17.733987 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.734473 32524 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.735016 30181 raft_consensus.cc:2410] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:17.736712 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.738878 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:17.743637 32562 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.748330 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.748930 32562 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.749130 30181 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
W20260709 13:12:17.752938 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 71206us
I20260709 13:12:17.753999 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.755812 32562 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:17.756057 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:17.756904 32626 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.765579 30105 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:17.781319 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:17.782521 32603 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.782920 32603 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.783293 32603 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.757718 32524 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.826152 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.826264 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:17.793150 30153 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:17.795207 32703 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.466s	user 0.003s	sys 0.012s
I20260709 13:12:17.785166 32583 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.795840 32622 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:12:17.802623 32589 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:17.808661 32597 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:17.835026 32589 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.832026 32524 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:17.814863 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.815181 32673 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.840605 32589 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.840337 32673 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.842865 32673 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:17.820719 30736 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:12:17.821447 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.822196 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2348120850001578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:12:17.823683 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.846866 30179 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:17.828280 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.834136 32622 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:17.834012 32719 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.812484 32683 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:17.843025 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 50065.4us
I20260709 13:12:17.819914 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:17.853328 30077 connection.cc:256] RPC call timeout handler was delayed by -1.1538280020001821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:12:17.860872 30741 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.853108 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:17.878611 30705 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:17.849956 32622 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:17.868207 30038 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.879333 32589 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:17.879942 32589 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:17.873298 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.880218 32693 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.880755 32693 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:17.874126 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.874908 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.881038 32589 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.881912 30734 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:17.876511 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:17.877444 32694 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:17.883198 32622 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:17.884207 32464 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:17.884590 32464 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:17.884649 32622 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.885637 32464 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:17.886795 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.887042 32464 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.861512 32673 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:17.881217 32693 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.874300 30741 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:17.894695 30004 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:17.921739 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 59308.9us
I20260709 13:12:17.913718 32648 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.925920 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:17.892360 32597 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:17.924561 32648 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:17.927914 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.928058 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.928045 32648 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.934326 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:17.935123 30034 raft_consensus.cc:2376] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7. Re-sending same reply.
I20260709 13:12:17.899547 32673 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:17.943423 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:17.951359 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.952283 30038 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:17.958143 29933 catalog_manager.cc:5697] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:17.960063 29933 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.964968 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:17.967758 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:17.942492 32673 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:18.011687 32708 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:18.012388 32580 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:17.983906 29931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 259) took 11270 ms (client timeout 15000 ms). Trace:
I20260709 13:12:17.987591 32597 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:18.018925 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51758.4us
I20260709 13:12:17.949249 32583 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:17.984871 32717 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:18.047922 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.055030 32712 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:18.033869 32683 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.067534 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.055795 32712 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.074962 32711 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:18.075734 32711 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.079828 30031 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:18.054266 32708 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.069926 32583 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.091794 32708 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.091960 32583 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.096783 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.071056 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.064031 32717 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:18.044482 32648 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.101558 32673 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.109660 30032 raft_consensus.cc:2368] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4.
I20260709 13:12:18.113333 30031 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:18.108871 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.062043 32580 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.120121 30734 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:18.125869 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:18.128039 30737 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:18.018909 29931 rpcz_store.cc:269] 0709 13:12:06.713319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.713524 (+   205us) service_pool.cc:224] Handling call
0709 13:12:07.241499 (+527975us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:17.983585 (+10742086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:14.028385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:14.029014 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:14.029053 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:12:14.029066 (+    13us) tablet.cc:662] Decoding operations
0709 13:12:14.029949 (+   883us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:14.030028 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:14.030069 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:12:14.030868 (+   799us) tablet.cc:701] Row locks acquired
0709 13:12:14.030889 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:14.031097 (+   208us) write_op.cc:270] Start()
0709 13:12:14.031304 (+   207us) write_op.cc:276] Timestamp: P: 1783602734031033 usec, L: 0
0709 13:12:14.031333 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:12:14.099938 (+ 68605us) log.cc:844] Serialized 2540 byte log entry
0709 13:12:14.511873 (+411935us) op_driver.cc:464] REPLICATION: finished
0709 13:12:14.958993 (+447120us) write_op.cc:301] APPLY: starting
0709 13:12:14.959086 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:14.959317 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:14.959483 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:15.156692 (+197209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:15.261894 (+105202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:12:15.283069 (+ 21175us) write_op.cc:312] APPLY: finished
0709 13:12:15.291374 (+  8305us) log.cc:844] Serialized 53 byte log entry
0709 13:12:15.877355 (+585981us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:15.877542 (+   187us) write_op.cc:454] Released schema lock
0709 13:12:15.877612 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:15.878099 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:15.878140 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195934,"reported_tablets":31,"spinlock_wait_cycles":705099136,"child_traces":[["op",{"apply.queue_time_us":445581,"apply.run_cpu_time_us":26672,"apply.run_wall_time_us":919059,"num_ops":6,"prepare.queue_time_us":321625,"prepare.run_cpu_time_us":17040,"prepare.run_wall_time_us":122876,"raft.queue_time_us":220458,"raft.run_cpu_time_us":21789,"raft.run_wall_time_us":370093,"replication_time_us":434391,"spinlock_wait_cycles":2944,"thread_start_us":965638,"threads_started":5,"wal-append.queue_time_us":719711,"wal-append.run_cpu_time_us":23736,"wal-append.run_wall_time_us":2132965}]]}
I20260709 13:12:18.127570 32578 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:18.099856 32603 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.128599 29933 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.140508 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.150000 30031 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:18.153961 30181 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:18.160276 32545 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:18.154004 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:18.158028 32673 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.164750 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.140575 32719 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:18.169966 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.162739 32711 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.168771 29933 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:18.184870 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 86153.7us
I20260709 13:12:18.190608 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.191699 32654 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.157228 31913 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:12:18.220144 32597 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:18.225920 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 62636.5us
I20260709 13:12:18.204869 32693 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.235571 30034 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:18.178583 32717 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.236989 29933 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.239149 29933 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:18.216818 32712 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.244365 32580 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:18.245204 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.251706 30186 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:18.253073 30179 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:18.256314 32507 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:18.256836 32507 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.257928 32507 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.259649 32507 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.213830 32648 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:18.252957 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.265918 32737 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.266443 32737 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.269078 32524 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:18.269536 32524 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.273785 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:18.281558 32733 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:12:18.282703 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.292608 30179 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:18.293531 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.294013 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.296461 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.297076 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.297216 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.297789 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.299196 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.299319 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.299860 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.301472 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.307650 32524 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.312299 32737 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.314369 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.320237 30183 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.319316 32737 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.329509 30741 raft_consensus.cc:1240] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:18.299309 30187 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:12:18.329519 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.332306 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.332949 30182 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:18.314944 32603 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:18.334698 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.335474 32693 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.313799 30186 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:18.349977 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:18.350906 30741 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:18.353706 30182 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:18.353962 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.354130 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:18.354803 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.355577 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.356381 30187 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:18.356652 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.361572 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:18.361686 32580 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.363313 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.363662 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.368080 30037 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:18.363368 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 138720us
I20260709 13:12:18.370909 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.371233 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.372570 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:18.373729 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:18.375385 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.376221 32691 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.377621 32691 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:18.378116 32691 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:18.378144 29933 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 3, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 3 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.379161 32691 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.382073 32524 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.389978 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.398113 30035 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:12:18.380887 29933 catalog_manager.cc:5697] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.404443 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:18.405608 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.409477 32712 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:18.406399 32583 consensus_queue.cc:1059] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:12:18.411657 30032 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:18.411752 32580 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:18.412395 32580 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.412825 32580 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.414119 32597 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:18.414669 32583 raft_consensus.cc:3055] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:18.415129 32583 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:18.415699 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.416020 32583 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.416954 32693 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.417280 32583 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.414685 32597 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.424566 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.422190 29933 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 4 to 5, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:18.431469 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.433205 30179 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:18.438966 32597 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.439630 32711 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:18.440306 32711 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:18.440826 32711 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.441756 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:18.449450 30032 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:18.451643 30183 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:18.442915 32711 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.452584 30187 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:18.456636 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:18.460522 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44979.9us
I20260709 13:12:18.461846 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.461724 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.462852 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.464032 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.464097 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.464437 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.464777 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.465620 30031 raft_consensus.cc:2410] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:18.466723 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.468640 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.471532 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.472141 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:18.475018 30151 leader_election.cc:400] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4.
I20260709 13:12:18.474805 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:18.475376 30151 leader_election.cc:403] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.481287 30077 leader_election.cc:400] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:18.481736 30077 leader_election.cc:403] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.486428 32648 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:18.476434 32711 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:18.505080 32580 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.506731 32739 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4.
I20260709 13:12:18.508383 32736 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:18.476016 29933 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 3, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 3 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.510349 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.512144 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.513746 32597 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.484879 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.514503 32597 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.516074 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.517192 32718 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.517370 32603 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:18.512311 32580 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.512863 32711 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.521972 32736 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:18.522796 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.527382 30110 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.525655 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:18.528293 30112 raft_consensus.cc:2410] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:18.512967 29933 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 2 to 4, term changed from 3 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to <none>, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:18.520987 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.525614 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.529556 32626 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.524670 32673 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:12:18.531090 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.531910 30107 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 3: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:18.532635 32716 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.527966 32736 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.534368 32736 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.535558 32736 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.530122 30151 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.526718 31913 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:18.541647 32603 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.545735 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.546622 30107 raft_consensus.cc:2368] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5.
I20260709 13:12:18.541787 32675 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.543233 31913 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.548584 31913 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.549981 31913 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:18.551901 32693 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.558030 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.560297 32714 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.568823 30110 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:18.569309 30181 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:18.549988 29933 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:18.573736 30705 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.576221 32683 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:18.579288 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.579491 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.585794 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.590401 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:18.569358 32711 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:18.591645 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.589449 32464 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:18.606837 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:18.609651 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.608027 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:18.609596 30110 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:18.589704 32739 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:18.619005 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 77372us
I20260709 13:12:18.608407 32507 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.608801 32673 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:18.630795 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51572.1us
I20260709 13:12:18.631489 30002 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:18.624967 31913 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:18.639590 32507 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:18.639420 31913 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.639923 32545 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:18.644376 32507 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.653854 32719 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.654352 32719 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:18.657594 32673 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:18.658097 32673 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:18.658517 32673 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:18.660344 31913 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:18.662087 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:18.653105 32507 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.671603 32626 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:18.672129 32626 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:18.657286 32719 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.689721 32719 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.700601 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:18.700466 32673 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.701568 32683 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:18.702561 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:18.702872 32673 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:18.703397 30111 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:18.703581 32673 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:18.704125 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:18.704843 30105 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:18.706800 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:18.707897 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.709465 30002 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:18.714310 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.715183 30106 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.712661 32648 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.718321 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:18.719146 32692 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:18.719646 32692 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:18.735895 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 97873us
I20260709 13:12:18.673051 32626 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:18.742731 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 105256us
I20260709 13:12:18.707618 32673 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:18.753752 30151 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.719781 32622 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:18.768301 32626 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.760857 32737 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.789290 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:18.791002 30107 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
W20260709 13:12:18.790937 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 56221.6us
W20260709 13:12:18.791898 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.764711 32622 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:18.799402 30106 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:18.831315 32673 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.844743 30179 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:18.847930 30187 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:18.847870 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.850157 30186 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:18.812011 32736 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:12:18.862668 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.881911 30734 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:18.883728 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:18.893556 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 56902.8us
I20260709 13:12:18.894622 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.895905 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:18.898630 32622 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.902029 30180 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:18.910902 32711 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:18.911401 32580 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:18.912340 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.866302 32583 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:18.846184 32692 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:18.921634 32580 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:18.929553 32597 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:18.958477 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.959640 32626 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:18.943606 32580 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.954871 32748 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:18.955528 32648 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:18.933354 32717 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:18.966190 30185 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:18.972265 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 60004us
I20260709 13:12:18.969818 32739 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.976266 32739 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:18.978281 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.984699 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.986579 30187 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:18.973099 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:18.988744 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.995020 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:18.997222 32597 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:18.997725 32597 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.998092 32597 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:19.006934 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.009867 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.010516 30033 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:18.988075 32507 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.991210 32673 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:19.031842 32580 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:18.991799 32750 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:19.041062 32739 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.016330 32507 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:19.043217 32507 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.044706 32507 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.020732 32711 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.051733 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.053131 32719 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:19.053352 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:19.053656 32719 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.053623 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:19.054219 32719 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.057634 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:19.063616 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:19.064441 32583 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.064698 32711 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.064895 32583 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:19.065361 32583 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.067708 32597 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.052539 32580 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.076597 32597 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.020270 32673 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:19.078334 32673 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.099606 32673 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:19.103466 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.079573 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:19.106253 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 158556us
I20260709 13:12:19.116926 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:19.119966 30033 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:19.122865 32719 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.123926 30002 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:19.130527 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.130743 30184 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:12:19.134682 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:19.114444 32597 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:19.140573 30107 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.132110 32622 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:19.142494 32718 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:19.159415 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:19.160068 30036 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.148518 32583 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.137357 32580 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:19.149471 32597 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.157902 32749 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:12:19.161010 32622 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:19.167549 32597 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.167838 32622 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.131909 32683 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:19.170331 32751 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:19.171293 32751 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:19.175336 32719 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.177074 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:19.159626 32711 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:19.171625 32751 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:19.175848 32749 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:19.183604 32749 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:19.184595 32749 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.186383 32749 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.219537 30029 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:19.233544 32739 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:12:19.265762 30036 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:19.279157 30033 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:12:19.284778 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:19.283386 32583 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.232481 32751 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.284247 32718 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:19.306787 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 172183us
I20260709 13:12:19.301044 32507 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:19.315183 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.322741 32507 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:19.331637 32507 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.309857 32718 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.319932 32751 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.383176 32597 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:19.384367 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 76799.1us
W20260709 13:12:19.390548 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.420928 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:19.422241 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.423429 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.424181 32711 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:19.424479 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:19.424930 32711 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:19.430039   306 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:19.430716 32583 raft_consensus.cc:2764] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:19.430974 32580 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:19.433966 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.437042 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.434949   306 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.437124 32580 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:19.460494 32580 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.465658 32718 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.458109   306 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.481966 30184 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:19.487583 30178 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:19.491822 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.492432 30106 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:19.471180 32545 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.495098 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:19.501698 32597 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.491000 32711 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.503979 32716 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.504427 32716 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.504796 32716 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.500240 32545 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.508363 32545 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.508975 32683 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:12:19.518551 32580 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:19.520841 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.528358 32580 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.482117 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:19.550307 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 150002us
I20260709 13:12:19.554601 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.555507 30178 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
W20260709 13:12:19.567377 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.579885 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 155474us
I20260709 13:12:19.587718 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:19.588601 30734 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
W20260709 13:12:19.313804 32691 consensus_queue.cc:1175] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34f51764a89048468a6faa21020812b0" responder_term: 8 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: [7.9-7.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:19.593621 32716 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.595857 30153 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:19.597584 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.599239 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.594745   306 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.599010 32739 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:19.609530 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 118522us
W20260709 13:12:19.612394 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.623481 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.626750 32739 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.627317 32739 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:19.627770   300 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.390s	user 0.003s	sys 0.006s
I20260709 13:12:19.631700 32716 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.632346 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.633111 30107 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.634758 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:19.637233 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.611090   306 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.641732 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:19.642179 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.642393 30180 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.670090 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.649289 32739 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.672714 29932 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.674444 32739 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.675084 32717 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:19.676421 32673 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:19.674620 29932 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.677013 32673 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.677595 30107 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
W20260709 13:12:19.678719 29933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 242) took 11773 ms (client timeout 15000 ms). Trace:
I20260709 13:12:19.679210 32673 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.679778 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:19.679912 32626 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.681360 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:19.680833 32626 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.681906 30734 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.684345 32626 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.686313 32716 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:19.686919 32716 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:19.687742 32716 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.680332 30180 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:19.691461 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:19.692107 30036 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.691953 29932 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 2 to 6, term changed from 4 to 5, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129), VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130), VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131), VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.694039 29932 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 7, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.698683 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:19.699467 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:19.701627 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.715003 30106 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:19.715598 30036 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:19.716125 30106 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:19.704119 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.716987 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.719225 32739 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:19.720001 32739 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:19.720876 32739 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.705504 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.705790 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.706312 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.706421 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.707213 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:19.709945 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46439.9us
I20260709 13:12:19.714902 30733 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.704377 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.702695 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.723399 32693 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:19.724507 30110 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:19.733891 32751 raft_consensus.cc:3055] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:19.714128 29932 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.729992 30112 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5.
I20260709 13:12:19.734316 32751 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:19.735190 32751 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.736989 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.735630 29932 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6, leader changed from <none> to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.742159 32751 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.742268 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.743420 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.749137 30109 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:19.679101 29933 rpcz_store.cc:269] 0709 13:12:07.975882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.984997 (+  9115us) service_pool.cc:224] Handling call
0709 13:12:19.678635 (+11693638us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:18.940463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:18.941251 (+   788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:18.941303 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:12:18.941324 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:18.942554 (+  1230us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:18.942647 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:18.942678 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:12:18.997937 (+ 55259us) tablet.cc:701] Row locks acquired
0709 13:12:18.997983 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:12:18.998156 (+   173us) write_op.cc:270] Start()
0709 13:12:18.998322 (+   166us) write_op.cc:276] Timestamp: P: 1783602738998092 usec, L: 0
0709 13:12:18.998342 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:18.999075 (+   733us) log.cc:844] Serialized 4825 byte log entry
0709 13:12:19.175476 (+176401us) op_driver.cc:464] REPLICATION: finished
0709 13:12:19.301568 (+126092us) write_op.cc:301] APPLY: starting
0709 13:12:19.308437 (+  6869us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:19.373859 (+ 65422us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:19.374003 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:19.375693 (+  1690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:19.376094 (+   401us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:12:19.376137 (+    43us) write_op.cc:312] APPLY: finished
0709 13:12:19.376517 (+   380us) log.cc:844] Serialized 89 byte log entry
0709 13:12:19.376722 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.376866 (+   144us) write_op.cc:454] Released schema lock
0709 13:12:19.376934 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:19.377327 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.377364 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":184280,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":68846,"apply.run_cpu_time_us":4298,"apply.run_wall_time_us":93971,"num_ops":12,"prepare.queue_time_us":161253,"prepare.run_cpu_time_us":13125,"prepare.run_wall_time_us":69719,"raft.queue_time_us":143633,"raft.run_cpu_time_us":14840,"raft.run_wall_time_us":60980,"replication_time_us":174974,"thread_start_us":222130,"threads_started":4,"wal-append.queue_time_us":10938}]]}
I20260709 13:12:19.752419 30180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:12:19.744151 32673 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.749137 30112 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:19.753237 30180 raft_consensus.cc:606] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:19.753688 32673 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.756494 32673 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:19.747500 30734 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:19.761801 30112 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:12:19.763324 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.771315 30112 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.779599 30180 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:19.780428 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.758378 29932 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.802418 29932 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.804124 29932 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 5, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.825179 30734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:19.829648 30112 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:19.828397 30734 raft_consensus.cc:606] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:12:19.837463 30734 raft_consensus.cc:614] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:19.832670 30109 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:19.840198 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50095us
I20260709 13:12:19.825498 29932 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 5, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.843713 30104 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:19.843950 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:19.845752 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.848321 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.850975 30181 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.857877 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.857916 30104 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.882416 30112 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:19.883810 30109 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.882131 29932 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 5, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.889504 30183 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.891995 30029 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:19.891136 32683 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.893040 32683 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:19.895264 32683 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:19.898514 30104 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:19.901008 30181 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:19.901113 32739 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:19.906749 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.917870 30105 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5.
I20260709 13:12:19.918630 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.919204 30105 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.919946 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.907467 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.921126 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.907773 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.922076 32507 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.922469 32507 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.922904 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.923614 30108 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:19.907155 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.908864 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.908952 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:19.924355 30186 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.910178 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.924520 30733 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.911008 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.925412 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:19.926275 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.926481 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.927340 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.927927   311 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.928369   311 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.928720 30113 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:19.928862 32748 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.929598 32622 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.930024 32622 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.930516 32622 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.928721   311 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.935530 30113 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:12:19.936156 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.911989 29932 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 5, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 5 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.914733 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.914974 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.937274 30109 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:19.907153 32683 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.909729 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.924470 30107 raft_consensus.cc:2376] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5. Re-sending same reply.
I20260709 13:12:19.910413 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.940145 32736 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.942160 30105 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:19.942436 30113 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:19.938073 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.922088 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.943801 30112 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5.
I20260709 13:12:19.938066 29932 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.945413 32748 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:19.946462 30110 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:19.948143 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.949047 30031 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:19.943825 32736 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:19.953677 29932 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:19.944564 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:19.957552 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.931528 32507 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:19.945205 30104 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:19.943599 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:19.966421 30734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:19.967047 30734 raft_consensus.cc:606] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:12:19.967381 30734 raft_consensus.cc:614] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:19.968822 32739 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.971105 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.970060 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:19.969264 32739 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.983565 30733 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:12:19.983953 30733 pending_rounds.cc:85] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 8
I20260709 13:12:19.984850 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.985663 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.987154 32673 consensus_queue.cc:1059] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:19.986526 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:19.984160 30733 pending_rounds.cc:107] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:12:19.989365 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.989774 30733 raft_consensus.cc:2889] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:19.993742 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.994570 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.995326 30186 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:19.990702 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.997367 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:19.978288 32748 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.000070 32748 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.000824 32748 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.000083 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:20.000711 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:20.001963 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.982775 32739 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.006032 32736 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:19.998389 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.012104 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:20.013321 30733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:20.014042 30733 raft_consensus.cc:606] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.015321   311 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.021873 32736 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:20.025493 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.027263   311 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.029385 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:20.033967 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 69180.3us
I20260709 13:12:20.034314 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.036466 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.037148 30036 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:20.038429 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.039024 30733 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.050354 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.050400 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.051774 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.053915 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.055879 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:20.056681 30186 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:20.056954 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.060708   319 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:20.061254   319 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.061738 32622 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.062196   319 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.064038   319 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.068444 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:20.068663 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.069952 32507 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:20.070392 32507 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.070303 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.070842 32507 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.069985 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.083060 32745 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.076784 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.077662 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.086130 30038 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:20.078975 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.079391   306 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.087345   306 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.089534   306 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.092646 30733 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:20.111131 30733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:20.111863 30733 raft_consensus.cc:606] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.115860 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:20.118803 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.118784 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:20.123623 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.126278 30029 raft_consensus.cc:2368] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:20.077029 32748 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.128712 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.129106 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.081466 32507 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.132540 30001 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5.
W20260709 13:12:20.136668 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.136672 32673 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:12:20.140336 32754 raft_consensus.cc:993] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.141031 32754 raft_consensus.cc:1081] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.134596 32717 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.143683   306 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.144632 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.136855   311 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:20.146468   311 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.147934   311 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:20.144348   306 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.155728   306 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.125077 32739 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.162267 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.163177 30038 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.141177 32673 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:12:20.175246 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.173877 32673 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:20.177960 32673 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.178098 32736 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.178510 30108 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:20.178874 32673 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.180222 32673 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.180368 32693 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:20.184514 32507 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:20.172011 32749 raft_consensus.cc:993] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.185511 32749 raft_consensus.cc:1081] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.185731 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.186596 30031 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.187129 30105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:12:20.187695 30105 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:20.188083 30105 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.138492 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.196334 30038 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:20.197746 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.208434 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.216741 30105 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.217202 32711 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.217801 32711 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.219288 32754 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.219921 32754 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:20.220021 32711 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.208562   306 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.222815   306 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.224664 30105 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.224849 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.225668 30741 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:20.225996 30741 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:20.226857 30741 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.227953 32736 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.227999 30741 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.228717 32736 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.231894 32736 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.237855 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:20.241901 30741 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:20.243213 30079 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:20.244107 32711 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:20.245244 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.215469 32603 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.246021 30029 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:20.255779 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:20.224988   306 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:20.267017 30077 connection.cc:256] RPC call timeout handler was delayed by -1.0052377539998361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:12:20.190513 32739 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:20.311635 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 95294.9us
I20260709 13:12:20.284919 32603 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.488509 32603 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.489004 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.489667 30185 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.497560 32716 raft_consensus.cc:993] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.498231 32716 raft_consensus.cc:1081] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:20.501135 30105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:12:20.489056 32603 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.502010 30105 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:20.502461 30105 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.387444 32622 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.302964 32711 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:20.505630 32711 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.437423   338 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.292236 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 153798us
W20260709 13:12:20.440783 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 173537us
I20260709 13:12:20.511930 30105 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.512871 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.513923 30105 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.514724 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.516076 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.516227 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.516845 30734 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.514740 30180 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.517854   310 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.518530   310 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:20.521970 30033 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:20.521248 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.523036 32692 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.525197 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.526015 32692 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.528663 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.529268 30178 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.529656   310 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:20.532135 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.533005   310 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.536657   310 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:20.444566 32691 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.537833 32691 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.538558 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.539347 32683 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.540261 30734 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:20.149324   311 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:20.541427   311 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.541647 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.541808 32691 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.220916 32754 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.450711 32507 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:20.542430 30036 raft_consensus.cc:2393] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:20.542430   311 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.542840 32507 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.544741 30004 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:20.545536   310 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.546185   310 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.545979 32507 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.455343 30181 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:20.547210   310 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.552217   338 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.554502   338 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.554975 30178 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:20.461839 32736 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.592481 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.593355 30737 raft_consensus.cc:3055] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:20.593719 30737 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:20.595083 30737 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.463752 30031 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:20.209506   319 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.467808 32673 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.527724 32692 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.591421 32736 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.456349 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.604303 30185 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:20.604661 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 148386us
I20260709 13:12:20.605099 32736 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:20.566757 32739 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:20.606046   338 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.447031 32748 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.555804 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.551218   311 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.585281 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.585569 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.586823 30180 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:20.608909 30184 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:20.588784 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 132559us
I20260709 13:12:20.599457 30737 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:20.601176 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.602216 32673 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.605506 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.580653 32683 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.616937 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:20.617987 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.618798 32748 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.620524 32673 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:20.623642 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67933.3us
I20260709 13:12:20.626232 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.624799 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.628461 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:20.629206 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.631781 30031 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:20.632899 30741 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:20.634636 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:20.635438 30733 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:20.635813 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:20.636617 30734 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:20.639899 30079 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:20.641871 30153 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.638705 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.645135 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.645125 32739 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.645983 32739 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.646471 32739 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.646932 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.648901 32673 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.649111   306 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.650085   306 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:20.650482   306 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.650846   306 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.629851   338 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.652318   348 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:20.657991 30001 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5.
I20260709 13:12:20.659574 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.660431 30184 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:20.660964 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:20.665601 32736 raft_consensus.cc:2764] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:20.640014 32716 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:12:20.669438 32683 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.671439   310 consensus_queue.cc:1059] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.672314   310 raft_consensus.cc:3055] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:20.672681   310 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.673480   310 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.653312 32737 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:20.674592   310 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.652959   348 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:20.694434 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.695398 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.696066 32622 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.683713   348 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.698676 32683 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.699532 32683 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.697031 32622 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:20.687083 30150 leader_election.cc:336] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.537s (SENT)
I20260709 13:12:20.707267 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.708441 30737 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:20.700789 32683 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:20.711496 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 85373.8us
I20260709 13:12:20.727321 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:20.731609 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44563.8us
I20260709 13:12:20.732795 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:20.733467 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:20.733682 30150 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.770s (SENT)
W20260709 13:12:20.737635 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 97808.7us
I20260709 13:12:20.747473 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.749670 30079 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:20.730691   344 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.713773 32603 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.748775 32711 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.776216 30180 raft_consensus.cc:2368] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
W20260709 13:12:20.771730 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44543.1us
I20260709 13:12:20.774276   350 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:20.751897 32673 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.749706 32622 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.777535 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.789645 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.738517 32739 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.791368 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.794597 30737 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.792759 30036 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.775633 32603 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.792292 32673 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.807098 32673 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.817380 30737 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:20.818825 32711 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.818601 30153 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.819038   338 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:20.820956 30150 leader_election.cc:336] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.723s (SENT)
I20260709 13:12:20.821218   338 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.794108   350 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:20.823652   338 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.823549   350 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.828452 30705 leader_election.cc:400] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
I20260709 13:12:20.828830 30705 leader_election.cc:403] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:20.834182 30150 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.858s (SENT)
I20260709 13:12:20.834726 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:20.773715   306 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:20.851414   353 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:20.852890   306 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:20.860558 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:20.861294 30737 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.874183 30737 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
W20260709 13:12:20.878078 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 100678us
I20260709 13:12:20.879199 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:20.839138   339 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
I20260709 13:12:20.875870 30079 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:20.838915 32754 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.894587 30036 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:20.895587 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:20.896183 30038 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.867463 32745 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.904484 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:20.903402 32673 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.906914 30038 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:20.908636 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.903663 32754 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:20.903473   349 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.910723 32754 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.929531   348 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:20.930151   348 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:20.931018   348 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.933911   349 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.937022 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:20.938665 30077 leader_election.cc:400] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:20.938875 30077 leader_election.cc:403] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.939781 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:20.939988 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:20.940155 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:20.897791   350 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.941743 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:20.944710 30108 raft_consensus.cc:2368] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 3. Current term is 4.
I20260709 13:12:20.945701 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:20.946980 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:20.947549 30105 raft_consensus.cc:2368] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5.
I20260709 13:12:20.948581   350 raft_consensus.cc:697] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:20.954602 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:20.945734   358 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:12:20.944550   338 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.969969 32673 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.943943   306 raft_consensus.cc:2764] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:20.975711 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:20.975945 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:20.976380 30186 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.984025   306 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:20.984612   306 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:20.980468   350 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:20.986770   306 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:20.986934 32739 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:20.991096 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:20.993186 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:20.994181 30108 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:20.995155 32673 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:20.995687 32673 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:20.996523 32673 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.008088   338 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:21.009366 30113 raft_consensus.cc:2368] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:21.030355 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.038800 30113 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:21.041316 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.042269 30113 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:21.046463 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.047974 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.048337 30105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:12:21.048866 30105 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:21.049247 30105 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:21.046746 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 144) took 5563 ms. Trace:
I20260709 13:12:21.049614 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.050560 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.052759 30104 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.047298 30113 raft_consensus.cc:2376] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5. Re-sending same reply.
I20260709 13:12:21.048625 30108 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:21.059875 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.060621 30112 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:21.063802 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.067389 30104 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:21.070138 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.070953 30038 raft_consensus.cc:2368] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:21.071522 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.071885 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.064433 30106 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:21.072980 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.073956 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.075852 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.076457 30107 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.080915 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.081633 30110 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.048991   320 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.082438 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:21.080917 30105 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.087584 30111 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:21.083797 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.084653 30104 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.088421 30031 raft_consensus.cc:2368] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:21.088801 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.089942 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.083392 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:21.087425 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.091593 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.094341 30033 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:21.050037 29932 rpcz_store.cc:276] 0709 13:12:15.481469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.489503 (+  8034us) service_pool.cc:224] Handling call
0709 13:12:21.044909 (+5555406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:20.438908 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:20.439462 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:20.439498 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:12:20.439515 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:20.440801 (+  1286us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:20.440867 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:20.440894 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:12:20.478567 (+ 37673us) tablet.cc:701] Row locks acquired
0709 13:12:20.478583 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:12:20.478732 (+   149us) write_op.cc:270] Start()
0709 13:12:20.478881 (+   149us) write_op.cc:276] Timestamp: P: 1783602740478683 usec, L: 0
0709 13:12:20.478903 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:20.479715 (+   812us) log.cc:844] Serialized 5705 byte log entry
0709 13:12:20.795171 (+315456us) op_driver.cc:464] REPLICATION: finished
0709 13:12:20.991722 (+196551us) write_op.cc:301] APPLY: starting
0709 13:12:20.994108 (+  2386us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:20.998764 (+  4656us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:20.998880 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:21.000489 (+  1609us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:21.000752 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:12:21.000797 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:21.001093 (+   296us) log.cc:844] Serialized 101 byte log entry
0709 13:12:21.001961 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:21.002142 (+   181us) write_op.cc:454] Released schema lock
0709 13:12:21.002198 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:21.002608 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:21.002640 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":389111,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":184612,"apply.run_cpu_time_us":3586,"apply.run_wall_time_us":10862,"num_ops":14,"prepare.queue_time_us":304146,"prepare.run_cpu_time_us":72003,"prepare.run_wall_time_us":271871,"raft.queue_time_us":31674,"raft.run_cpu_time_us":56618,"raft.run_wall_time_us":112123,"replication_time_us":316101,"thread_start_us":597127,"threads_started":4,"wal-append.queue_time_us":281159}]]}
I20260709 13:12:21.100343 30737 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:21.093315 30105 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.113190 29930 catalog_manager.cc:5697] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 1 to 6, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:21.115844 29930 catalog_manager.cc:5697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 6, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:21.082394 32622 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:21.117995 29930 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 6, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:21.094061   320 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:21.121120 29930 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.123884 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.124526 30038 raft_consensus.cc:2368] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:21.122161   320 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:21.090251 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 69066.6us
I20260709 13:12:21.143205 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:21.147022 29930 catalog_manager.cc:5697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 5, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:21.151901 30737 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:21.082316   310 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:12:21.104590 30110 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:21.154531 30150 leader_election.cc:400] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5.
I20260709 13:12:21.158028 30107 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:21.147189 32748 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:12:21.157878 29930 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 5, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:21.176739 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.176019 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.177762 30110 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:21.178130 30113 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:21.174391 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:21.202493 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:21.207193 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:21.204983 32739 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:21.196713   344 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:21.223887 29930 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 5, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.191311   350 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:21.206467 32737 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:21.249962 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54310.7us
I20260709 13:12:21.253472 30033 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:21.207638 32545 consensus_queue.cc:1059] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:12:21.232565 32754 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:21.244388   344 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:21.300271   344 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:21.318339 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:21.319131 30737 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:21.339996 30153 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:21.345707 32545 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:21.346356 32545 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:21.346834 32545 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.309319 32754 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:21.296809 32736 raft_consensus.cc:3055] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:21.361972 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 118698us
I20260709 13:12:21.343154 32692 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.385295 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 160492us
I20260709 13:12:21.385842 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.388149 30031 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:21.365687 32736 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:21.472301 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 85902.2us
W20260709 13:12:21.474301 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 386932us
I20260709 13:12:21.475548 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.503880 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.508790 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.515969 32603 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:21.516567 32603 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:21.479914   367 log.cc:927] Time spent T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:21.385268 32692 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:21.524412   370 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:12:21.554054 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 48643.4us
I20260709 13:12:21.555301 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.564026 32749 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:21.389191 32754 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.592047 32749 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.592629 32749 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.566701   349 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.570178 30733 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:12:21.575042   362 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 13:12:21.576606 32603 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:21.534657   338 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.530156 32736 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.605510 30037 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:21.588452 32545 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:21.620182 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 233193us
W20260709 13:12:21.651170 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 96077.8us
I20260709 13:12:21.658155 30733 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:21.618592 32683 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.664722   338 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:21.704800 30733 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:12:21.707558 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 232297us
I20260709 13:12:21.729502 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.659833   306 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:12:21.767453 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.781843 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:21.782512 30185 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.778477 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.779449 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.772063 30186 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:21.780668 30741 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:21.781109 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.789193 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.669914 32683 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.791107 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.791745 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.797703 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.799468 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:21.800047 30180 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:21.802577 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.804965 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.805308 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.787822   368 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.819832 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:21.787611   338 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:12:21.792248   382 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.808470   349 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.811957 30185 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:21.850642 30031 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:21.771867   394 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.850863 30180 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:21.790815   392 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.815162   366 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:21.852454 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:21.869207 30038 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:12:21.851460 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57017.4us
W20260709 13:12:21.879930 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74696.7us
I20260709 13:12:21.851589   365 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:21.861377   350 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:21.847559   348 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:12:21.881328 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:21.899686   393 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260709 13:12:21.873344   368 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.903649 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:21.901168 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 103983us
I20260709 13:12:21.851574   311 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:12:21.858757 32745 consensus_queue.cc:1059] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:12:21.890230 32545 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:21.915781 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:21.916798 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 66832.1us
I20260709 13:12:21.917691 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:21.873484   394 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.877353   392 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.919490   366 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:21.915549   406 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.934469 30033 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:21.937578 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:21.916420   379 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.931552 32754 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:21.959968 32754 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.961102   311 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:21.950353 32683 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.909487   368 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:21.914240   388 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:12:21.945611   306 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.963089 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:21.959223 32749 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:21.963856   338 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.973285   407 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:12:21.972332 32692 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.964865   311 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:21.983001 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.972450   366 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:21.978679 30111 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:21.980163   368 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.980463 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:21.996130 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:21.980927 32711 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.980212 30104 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.000108 30741 raft_consensus.cc:2368] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9.
I20260709 13:12:22.000757 32737 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:22.001237 32737 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.001724 32737 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.001534 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:22.002625 30185 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:22.002936 30185 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:22.003620 30185 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.005089 30185 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:22.012770 30180 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:22.014323 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:21.982899 30077 leader_election.cc:400] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:21.977325   387 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:21.985327 30108 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:22.024883 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:21.984127 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.025763 30077 leader_election.cc:403] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:21.986516   390 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.410s	user 0.001s	sys 0.004s
I20260709 13:12:21.989629   311 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:21.989818 32754 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:21.990497   366 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:22.032572   379 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:22.036553 30031 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:22.036859   366 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.024133 32749 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.984754   306 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:22.039100   306 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:22.040104   306 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.041955   378 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:21.994143   394 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.994629 30111 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:21.994973   392 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:21.996366 30106 raft_consensus.cc:2393] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:21.980741 30105 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:22.025791 30038 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:22.027310 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44542.8us
I20260709 13:12:22.035207 30036 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:22.055696 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:22.053352 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:22.056439 30180 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.057791 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:22.058815 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:22.059408 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.059868 30077 leader_election.cc:400] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:22.060199 30077 leader_election.cc:403] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.061869 30077 leader_election.cc:400] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:22.062166 30077 leader_election.cc:403] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.065481 30105 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.066606 30111 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:22.066823 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.067328 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.067560 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:22.067751 30104 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:22.068819 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.068079 30109 raft_consensus.cc:2376] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7. Re-sending same reply.
I20260709 13:12:22.069175 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.070914 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.070003 30112 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:22.071525 30111 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:22.056291   306 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.073470 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:22.063381   368 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:22.060953   379 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:22.080185   311 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:12:22.083415 32683 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:22.061429   350 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:22.086912   398 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.087533   398 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.088294 32736 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:22.086930 32737 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.090322 32737 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:22.091773   398 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:22.063988   338 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:22.063931   407 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5.
I20260709 13:12:22.083953 32683 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.097549 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.098479 30113 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:22.100023 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:22.100126 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:22.103816 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:22.105962 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:22.106853 30107 raft_consensus.cc:2393] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:22.108225 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:22.109002 30105 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:22.111538 30038 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:22.115108 30180 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:22.119263 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.119982 30180 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:22.115999 30185 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:22.123556 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:22.125524 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:22.126240 30107 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.129086 30183 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:22.129662 30112 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:22.093580 32683 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.133553 30180 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:22.105634   410 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:22.139273 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.139626 30178 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.142729 30180 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:22.141047 30187 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:22.155499 30107 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:22.112149   310 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.128144   311 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:22.123822 32754 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.109942 32603 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:12:22.107767   392 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:22.107939   348 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:12:22.168690 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.167570 30153 leader_election.cc:400] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9.
I20260709 13:12:22.166457 30705 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:22.173070 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:22.182662 30153 leader_election.cc:403] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.172626 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.123994   379 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:12:22.177513 32754 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.166258   311 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.178923 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.110495 32737 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:12:22.182472 30178 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:22.140076   350 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:12:22.184978 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.163520   310 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.175444   398 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.212168   310 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.206580 32716 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.227373 32716 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.199230   321 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:22.206842   368 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:22.210525   311 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.209872   410 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9.
I20260709 13:12:22.307935   321 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:22.327579   321 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.329545   385 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.330142   385 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.332420   385 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:22.333709 32716 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.337693 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:22.338001   412 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:12:22.372941 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.217063   398 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.374055 30187 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:22.409894 30179 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:22.436305   399 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.446420   310 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.480599 32673 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.500494 32673 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.499603 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:22.506350 32673 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:22.439405   399 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.531347 32754 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:22.532877   420 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:12:22.535405 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 327315us
I20260709 13:12:22.551390 30108 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:22.551741 32750 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.557497 32750 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.557976 32750 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.553306   385 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:12:22.554530   422 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:12:22.566119   399 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:22.567687   398 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:22.568344 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:22.570142   310 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.552361   394 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:12:22.576002 32750 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.580124   310 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.585810   310 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.587610 32750 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.588980   310 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.590845 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:22.591830 30184 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.548676 32683 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.613853 30184 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:22.548041 32673 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:22.600660   311 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.664463   394 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.665254   394 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.667902   394 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.668553 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:22.670648   423 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:22.681150 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:22.682565 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:22.691658   408 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:22.684458 32737 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.692281   408 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:22.692436 32683 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.692607 32737 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.693768   311 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.693271   408 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:22.695070 32737 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:22.700704 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:22.708109 30110 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:22.749722   423 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.750385   423 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.752921   423 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.758082   422 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.758723   422 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:22.769776   425 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:12:22.775487 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 552134us
I20260709 13:12:22.776999   422 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.777243   368 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:22.778388   368 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.748577   394 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.785707   394 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.817354 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:22.821916 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.827016 30035 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:22.828030 30031 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:22.830689 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.831698 30036 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:22.833330   366 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.842000 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.847167 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:22.848421 30032 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10.
I20260709 13:12:22.820370 32711 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.821365   392 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.852449 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.834026   338 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:22.873680 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:22.875423 30151 leader_election.cc:400] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:22.875741 30151 leader_election.cc:403] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.877048 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.834085   366 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.877302 30151 leader_election.cc:400] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10.
I20260709 13:12:22.887989 30151 leader_election.cc:403] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.878106   399 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.892463   394 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:22.893271   348 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.878346   388 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:12:22.865785 32711 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.867285   382 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.905025   382 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:22.862797   392 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.906823   392 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:22.907931   431 log.cc:927] Time spent T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:22.822345 32692 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:12:22.914863 32692 consensus_queue.cc:1243] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer 98b3b699b87245df85d3aa84c13f5691 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:22.916924 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:22.918798 32739 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.936082 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:22.935732 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 58559.7us
I20260709 13:12:22.942349 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:22.959524 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.988436 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:22.992004 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 70695.2us
W20260709 13:12:22.992832 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50258.9us
I20260709 13:12:22.993944 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:22.858062   421 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.003988 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:22.994575 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 73806.1us
I20260709 13:12:23.017771 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.877194 32736 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:23.018673 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:22.919505 32739 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:23.030296 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64884.9us
I20260709 13:12:23.024339 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:23.039487   423 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:22.883834   306 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:23.182680 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:23.033107 32736 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:22.878618   338 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.086676   410 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.156059 32711 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.176769   416 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.195225   390 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:12:23.021492   421 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.062389   349 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:12:23.155821   306 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.211926   348 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10.
I20260709 13:12:23.344111   366 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.364907 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.365939 30108 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:23.197118 32736 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:23.385807 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 362834us
W20260709 13:12:23.315735   430 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:23.395615 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:23.279587   410 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:23.407688 30076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.085s	sys 0.161s
W20260709 13:12:23.411573 30076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.085s	sys 0.161s
W20260709 13:12:23.390040   379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.005s
I20260709 13:12:23.414688 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.300493   350 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:23.370127   435 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:23.424096 30187 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:12:23.430259 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 426417us
I20260709 13:12:23.246706   416 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:23.420817   379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.006s
I20260709 13:12:23.419312   447 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:23.434032   350 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.455090   435 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.614636 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 1950) took 1273 ms. Trace:
I20260709 13:12:23.471678   349 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.670081 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.674295 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:23.523370   441 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:23.676389 30037 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:23.646961 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:23.638618   461 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
W20260709 13:12:23.532143   392 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.005s
W20260709 13:12:23.532455   430 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:12:23.483729   449 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:12:23.696237 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.461922   382 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.672176   447 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.682777 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:23.681216 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 285668us
I20260709 13:12:23.684113 30111 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:23.677390   410 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.717226 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.670744 30113 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:23.534801   399 consensus_meta.cc:287] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.004s
I20260709 13:12:23.668584 30106 rpcz_store.cc:276] 0709 13:12:22.341281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.341492 (+   211us) service_pool.cc:224] Handling call
0709 13:12:22.341918 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.785693 (+443775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.785735 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.786228 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.019516 (+233288us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:23.019581 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.019690 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.512699 (+493009us) raft_consensus.cc:1685] finished
0709 13:12:23.512727 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.614511 (+101784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":453614,"raft.queue_time_us":466662,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3273,"thread_start_us":232894,"threads_started":1,"wal-append.queue_time_us":625860}
I20260709 13:12:23.517717   338 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.690315 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:23.690860 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 290213us
I20260709 13:12:23.633229   459 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.689718 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.515317 32739 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:23.516582   306 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.601300 32711 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.606894   366 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.666929 32737 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.548123   416 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.531253   311 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:23.618048   406 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:23.558336   452 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.760509   406 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.757377   366 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.761018   452 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.763085   406 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.763464   452 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:23.763664 30707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.016s
I20260709 13:12:23.616074   421 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:23.764060 30707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.016s
I20260709 13:12:23.679095 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:23.764338 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.677505   368 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:23.610924   438 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.362s	user 0.003s	sys 0.008s
I20260709 13:12:23.763635   366 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.765571   368 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.765858   421 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:23.755417 32711 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.767704   368 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.767855 32711 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.768635 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:23.769248 30112 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.735668 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.770613 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:23.771185 30113 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.737284 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1780) took 1001 ms. Trace:
I20260709 13:12:23.774598   350 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.742515 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.775995 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.742515 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.778290 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.744103   399 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:23.780272 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.781068 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.744093   459 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.781703 30108 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:23.782758   447 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.783394   459 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:23.783749   435 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:23.784054 30184 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:23.786334 30112 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:23.787289 30184 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.757441 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.760037 32737 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:23.789479   458 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:12:23.791213 32737 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:23.764863 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 85830.4us
I20260709 13:12:23.696811   392 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.741959 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:23.733081   450 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.417s	user 0.004s	sys 0.010s
I20260709 13:12:23.776018   311 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.774765 30038 rpcz_store.cc:276] 0709 13:12:22.735910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.736097 (+   187us) service_pool.cc:224] Handling call
0709 13:12:22.736714 (+   617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.744272 (+  7558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.744304 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.746208 (+  1904us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.863371 (+117163us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:22.984812 (+121441us) log.cc:844] Serialized 14 byte log entry
0709 13:12:23.418061 (+433249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.418190 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.737101 (+318911us) raft_consensus.cc:1685] finished
0709 13:12:23.737117 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.737229 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34365,"prepare.queue_time_us":10522,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":51692,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":37490,"thread_start_us":616185,"threads_started":3,"wal-append.queue_time_us":307028}
I20260709 13:12:23.791416 30113 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:23.791864 30733 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.859858 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:23.863649 30182 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:23.794087 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.792694 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.791890 30183 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:23.838613 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.777273 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.865763 30106 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.871551 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:23.726025   410 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.872699 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:23.867247 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 65124us
I20260709 13:12:23.877439 30178 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:23.878916 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.879505 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:23.881719 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.883015 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.879964 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:23.885553 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 198244us
I20260709 13:12:23.894726 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:23.894762 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 197616us
I20260709 13:12:23.898551 30032 raft_consensus.cc:2368] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:23.864811   447 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.899643 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.900068 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:23.882514   399 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:23.837591   435 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.880726   385 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.891094   368 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.916466 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:23.945607 32736 consensus_meta.cc:287] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.004s
I20260709 13:12:23.946026 32736 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.948362 32736 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:23.949589 30187 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:23.901782   407 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:23.950476   451 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.950883   451 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:23.951458   410 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:23.941916   348 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.951886   451 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:23.952818   348 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.954035   310 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.908800   447 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.954514   310 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:23.954985   348 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:23.956493   447 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:23.908632   399 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:23.957635   399 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.960134 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:23.926733 32711 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:12:23.918596 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:23.906203 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.906524 30105 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:23.904703 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 160958us
I20260709 13:12:23.945209 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:23.964521 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 48283.2us
I20260709 13:12:23.965991 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:23.972900 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:23.975991 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 82488.8us
I20260709 13:12:23.977712 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.908399   455 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:23.992404 30106 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:23.907207   462 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.980711 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:23.995044 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:23.999109 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:24.001186 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:24.000018 30031 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:23.999078 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.025072 30105 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:24.032481 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54710.4us
I20260709 13:12:24.002144 30029 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:23.970573   366 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.911676   452 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:12:24.094998 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:24.095329 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:24.099855 30106 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:24.001003   455 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.998255   447 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.937213   368 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:23.975492   306 consensus_queue.cc:1175] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d2f11cccca04a7683da4080ab797bd7" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:24.001365   451 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.929716   435 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.003466   408 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:12:24.150099   455 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.151259   392 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.176474   310 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:24.206368 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.206856 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.061789   462 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.239166 30113 pending_rounds.cc:85] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 3
I20260709 13:12:24.239584 30113 pending_rounds.cc:107] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:12:24.239869 30113 raft_consensus.cc:2889] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.240698 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1820) took 1239 ms. Trace:
W20260709 13:12:24.241856 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 362406us
I20260709 13:12:24.241209 30179 rpcz_store.cc:276] 0709 13:12:22.997458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.192162 (+194704us) service_pool.cc:224] Handling call
0709 13:12:23.216469 (+ 24307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.216961 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.217000 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.427070 (+210070us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.912079 (+485009us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:23.912447 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.912537 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:24.236868 (+324331us) raft_consensus.cc:1685] finished
0709 13:12:24.236896 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.237059 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53723,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":219296,"threads_started":1,"wal-append.queue_time_us":394568}
I20260709 13:12:24.244868 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:24.245555 30106 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.229329   422 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.262480 30106 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:24.266547 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:24.268427 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 393831us
I20260709 13:12:24.295697   310 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.296348   310 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.299160   310 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.301285 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:24.310748   437 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:24.311041   394 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:24.311609   394 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:24.271409 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:24.312458   394 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.313337 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:24.314694 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:24.270830   392 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.330353 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.332446 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.322103   385 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:24.268884   422 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.348690 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.351116 30108 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:24.359310   473 log.cc:927] Time spent T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 13:12:24.332085   392 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.359577   368 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:24.365670 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51039.9us
I20260709 13:12:24.352237   478 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.365082   435 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.384491   310 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:24.396211   462 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.401623   310 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:24.403401   460 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.931s	user 0.009s	sys 0.005s
I20260709 13:12:24.405025 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:24.419070 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:24.452994 32675 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:24.559098   451 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.453385   483 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:24.452453 30704 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.765s (SENT) [suppressed 31 similar messages]
I20260709 13:12:24.462991 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.560811   483 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:24.463766   467 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.724s	user 0.005s	sys 0.006s
I20260709 13:12:24.562273   306 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:24.469419 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 197023us
I20260709 13:12:24.471686 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 573) took 1015 ms. Trace:
W20260709 13:12:24.473330 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2104) took 1557 ms (client timeout 1679 ms). Trace:
W20260709 13:12:24.496289   481 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:12:24.562866   306 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.563295   483 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:24.496693 30032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54306 (request call id 1706) took 1632 ms (client timeout 2122 ms). Trace:
W20260709 13:12:24.563382 30182 rpcz_store.cc:269] 0709 13:12:22.916381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.916546 (+   165us) service_pool.cc:224] Handling call
0709 13:12:24.473110 (+1556564us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400266bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:24.473260 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989517568}
I20260709 13:12:24.499018   311 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:24.473330   463 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.543s	user 0.011s	sys 0.009s
I20260709 13:12:24.502460   422 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.504559 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1714) took 1053 ms. Trace:
I20260709 13:12:24.565706   416 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.440595   455 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.403093   310 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:24.536755 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 618247us
I20260709 13:12:24.537539   348 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:24.539507 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 505814us
I20260709 13:12:24.546415 30109 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:12:24.584141 30109 pending_rounds.cc:85] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 6
I20260709 13:12:24.558527 32673 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:24.392760   385 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:24.559873   451 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.563143 30104 rpcz_store.cc:276] 0709 13:12:23.456463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.456620 (+   157us) service_pool.cc:224] Handling call
0709 13:12:23.456869 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:23.685711 (+228842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.685740 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:23.685778 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:23.685816 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.471319 (+785503us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000d4154. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:24.471393 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.471596 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525435776}
W20260709 13:12:24.564070 30032 rpcz_store.cc:269] 0709 13:12:22.864735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.864962 (+   227us) service_pool.cc:224] Handling call
0709 13:12:24.496357 (+1631395us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b540011ce54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:24.496575 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196619648}
W20260709 13:12:24.567090 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 148133us
W20260709 13:12:24.558332   399 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.010s
I20260709 13:12:24.592983   399 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.595572   399 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:24.576303 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:24.596764 30113 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:24.576977 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.577020 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:24.597697 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:24.598042 32711 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.598172 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:24.604368   440 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.586586 32692 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:24.606029 32692 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.608381 32692 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.549238 29932 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 7, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:24.591799   385 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.586793   472 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.609973   472 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.610469   472 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.584462 30109 pending_rounds.cc:107] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:12:24.612546 30109 raft_consensus.cc:2889] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.613575 30033 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:24.566321   350 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.569850   366 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.568064 30030 rpcz_store.cc:276] 0709 13:12:23.450846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.452467 (+  1621us) service_pool.cc:224] Handling call
0709 13:12:23.452859 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.547037 (+ 94178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.547068 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.951830 (+404762us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b2c000e1358. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:23.952232 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:12:24.267916 (+315684us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:24.267953 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.503981 (+236028us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b5400332554. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:24.504052 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:24.504110 (+    58us) raft_consensus.cc:1685] finished
0709 13:12:24.504130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.504332 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":425,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"spinlock_wait_cycles":230172928,"thread_start_us":315282,"threads_started":1,"wal-append.queue_time_us":376160}
I20260709 13:12:24.605105   488 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.586393   398 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:24.617820 32673 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:24.616756   306 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.613436   392 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.640357 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1395) took 1603 ms. Trace:
W20260709 13:12:24.640931 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 188683us
I20260709 13:12:24.619145 32711 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.567047 32675 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.643450 30107 rpcz_store.cc:276] 0709 13:12:23.038055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.038442 (+   387us) service_pool.cc:224] Handling call
0709 13:12:23.038907 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.056671 (+ 17764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.056705 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.147296 (+ 90591us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.591949 (+444653us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b180001e160. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:23.739111 (+147162us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:23.739152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.739233 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:24.387364 (+648131us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:24.640053 (+252689us) raft_consensus.cc:1685] finished
0709 13:12:24.640084 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.640281 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17116,"raft.queue_time_us":136083,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":18830,"spinlock_wait_cycles":24413824,"thread_start_us":146945,"threads_started":1,"wal-append.queue_time_us":684740}
W20260709 13:12:24.644788 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 81593.1us
I20260709 13:12:24.622514   387 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:24.585695   416 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:24.657485 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59397.1us
I20260709 13:12:24.658623 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:24.631253   366 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.665556 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.605065   440 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.669809   454 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.670377   454 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:24.670759   366 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.671331 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.622576   350 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.649848   306 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.637470   488 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:24.687119 29930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 259) took 14103 ms (client timeout 15000 ms). Trace:
W20260709 13:12:24.966368 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 231378us
I20260709 13:12:24.676299 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:24.657963 32750 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.742470 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.688519 29932 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 8, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 8 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:25.015537 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.013561 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.015887 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.020898 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.021906 30105 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
W20260709 13:12:24.969044 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 238462us
I20260709 13:12:25.018261 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:24.682554 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:25.022902 30113 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:25.027063 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 344585us
I20260709 13:12:24.690505 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.007126   368 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:24.716962 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:24.687904 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:24.743309 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:25.022609 29932 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 7, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:25.028025 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:24.687378 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:25.036881 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.038985 30112 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:24.722050   451 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.673710 32675 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:24.735678 30179 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:24.676316   416 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.673794 32711 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:25.031430 32754 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.672502   454 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:24.727289   455 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.745028   440 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:24.683410   446 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:24.675073   448 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:25.039104 29932 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:25.041381   379 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:25.106492 29932 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.659147   387 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.007059   459 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:24.674569   392 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.676652   489 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:25.056572 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 369293us
I20260709 13:12:25.096488   495 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.988953   306 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.131501 30151 leader_election.cc:400] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:25.131976 30151 leader_election.cc:403] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:25.107858   448 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:25.001698   462 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:24.681413   375 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:25.020414   366 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:25.097952 30113 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:24.744499   372 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.305s
I20260709 13:12:24.650055   398 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:24.964658 29930 rpcz_store.cc:269] 0709 13:12:10.583483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.583691 (+   208us) service_pool.cc:224] Handling call
0709 13:12:24.687028 (+14103337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:21.529431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:21.571701 (+ 42270us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:21.571745 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:12:21.571766 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:21.572726 (+   960us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:21.572812 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:21.572851 (+    39us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:12:21.573563 (+   712us) tablet.cc:701] Row locks acquired
0709 13:12:21.573590 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:12:21.573740 (+   150us) write_op.cc:270] Start()
0709 13:12:21.573883 (+   143us) write_op.cc:276] Timestamp: P: 1783602741573694 usec, L: 0
0709 13:12:21.573916 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:12:21.574754 (+   838us) log.cc:844] Serialized 2870 byte log entry
0709 13:12:21.859488 (+284734us) op_driver.cc:464] REPLICATION: finished
0709 13:12:21.994989 (+135501us) write_op.cc:301] APPLY: starting
0709 13:12:21.995074 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:21.995253 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:22.051922 (+ 56669us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:22.080000 (+ 28078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:22.080280 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:12:22.080361 (+    81us) write_op.cc:312] APPLY: finished
0709 13:12:22.080673 (+   312us) log.cc:844] Serialized 59 byte log entry
0709 13:12:22.081923 (+  1250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:22.082042 (+   119us) write_op.cc:454] Released schema lock
0709 13:12:22.082089 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:22.082554 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:22.082585 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2846,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":117133,"apply.run_cpu_time_us":6847,"apply.run_wall_time_us":87557,"num_ops":7,"prepare.queue_time_us":198245,"prepare.run_cpu_time_us":4304,"prepare.run_wall_time_us":68942,"replication_time_us":270538,"spinlock_wait_cycles":84736,"thread_start_us":107485,"threads_started":2}]]}
I20260709 13:12:25.137435 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:24.673066 32673 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.024071 32750 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.053730 32754 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.102077 32745 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:25.036587   368 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:24.733671 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:25.101420 32692 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:25.127548 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:25.148733 30151 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:25.139921 30181 raft_consensus.cc:2410] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:25.137024 32737 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:12:25.160521 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 158572us
I20260709 13:12:25.127476   499 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.131024   495 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:25.171185 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 43715.9us
I20260709 13:12:25.109543   379 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:25.153481 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 123538us
I20260709 13:12:25.126878   459 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.167279 32754 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.129747   392 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.185559 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:25.166471 32745 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.175384 30151 leader_election.cc:403] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:25.116758   446 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.189296 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:25.198949 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:25.200852 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:25.159240   366 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.180371   391 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:25.180666   435 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:25.205363 30184 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:25.133653   489 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:25.210269 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 534009us
I20260709 13:12:25.206907 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:25.197803 32745 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.153223   462 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.224581 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:25.210966 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 62954.5us
I20260709 13:12:25.183591   495 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:25.211752 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 213361us
I20260709 13:12:25.199186 32692 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:25.198356   454 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.160583   375 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.209153   422 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:25.207943   455 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:25.231459 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 187305us
I20260709 13:12:25.249749 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.247430 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:25.257946 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.214668   378 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.220758 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.224586   391 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:25.215209   350 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.278924 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.285794 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.286957 30038 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:25.245733   488 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.185001   499 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.261023   478 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:25.255471   497 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.255494   410 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.213053   435 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.188077   448 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.279224   422 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:25.290347   466 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:25.280019   455 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:25.350841 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 136963us
I20260709 13:12:25.279922   454 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.362951   478 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:25.368844 30110 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:25.305246 32739 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.374385 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:25.382234 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 92087.8us
I20260709 13:12:25.313109   399 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.387071   391 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.325676 32736 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.366339   422 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:25.364787   387 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.384743   455 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:25.401808   500 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:12:25.401227 32739 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:25.475073 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 100786us
I20260709 13:12:25.475296 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:25.324397   410 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.500365 30002 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:25.363168   444 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 13:12:25.506299 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:25.324608   497 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.509473 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:25.546012 30038 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:25.537557 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 252543us
I20260709 13:12:25.422117   506 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:25.553707 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 53477.8us
I20260709 13:12:25.556066 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:25.382905   466 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.562162 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:25.506889   306 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.445811   399 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:25.568708 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 354976us
W20260709 13:12:25.566326 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 392017us
I20260709 13:12:25.509963 32750 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:25.574710 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 329542us
W20260709 13:12:25.586716 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 228939us
I20260709 13:12:25.480545 32736 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.456718   391 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.566732   451 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.609095 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:25.570588   392 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.575986   459 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.635627   435 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.624126   398 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.569010   478 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.638827   454 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.624835   451 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.630564   489 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.641759   375 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.633503   499 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.634526   462 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:25.649863 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 95932.4us
I20260709 13:12:25.590950   446 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.599184   366 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.602903   372 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:25.714751 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.711400   375 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:25.725150   509 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:25.727177   509 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.718117 32711 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.689675   306 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.718295   510 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.746243   510 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:25.748546   498 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.784s	user 0.005s	sys 0.008s
I20260709 13:12:25.751744   306 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.728641 32711 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:25.754652   504 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.451s	user 0.010s	sys 0.009s
I20260709 13:12:25.729430   435 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.771746 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 490) took 1037 ms. Trace:
I20260709 13:12:25.772321   435 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.772208 30178 rpcz_store.cc:276] 0709 13:12:24.733825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.735840 (+  2015us) service_pool.cc:224] Handling call
0709 13:12:24.736150 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:24.967489 (+231339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.967554 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:24.969985 (+  2431us) log.cc:844] Serialized 26 byte log entry
0709 13:12:25.150030 (+180045us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:25.150075 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.150151 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:25.753957 (+603806us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:25.771380 (+ 17423us) raft_consensus.cc:1685] finished
0709 13:12:25.771405 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.771675 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6693,"raft.queue_time_us":229793,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11908,"spinlock_wait_cycles":10597120,"thread_start_us":126488,"threads_started":1,"wal-append.queue_time_us":209965}
I20260709 13:12:25.777027 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1835) took 1091 ms. Trace:
W20260709 13:12:25.779695 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.793596   375 consensus_queue.cc:1243] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:25.778398 30184 rpcz_store.cc:276] 0709 13:12:24.685840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.687581 (+  1741us) service_pool.cc:224] Handling call
0709 13:12:25.776784 (+1089203us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000654d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:25.776945 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386451712}
I20260709 13:12:25.805671 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1838) took 1118 ms. Trace:
I20260709 13:12:25.806123 30181 rpcz_store.cc:276] 0709 13:12:24.686978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.716629 (+ 29651us) service_pool.cc:224] Handling call
0709 13:12:25.805389 (+1088760us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002684d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:25.805602 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235541760}
I20260709 13:12:25.816849   372 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.822377   379 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.826797 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 486) took 1097 ms. Trace:
I20260709 13:12:25.827391 30187 rpcz_store.cc:276] 0709 13:12:24.729844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.730650 (+   806us) service_pool.cc:224] Handling call
0709 13:12:24.730951 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:25.173719 (+442768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.173757 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:25.173800 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:25.173837 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.826487 (+652650us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54002977d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:25.826549 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.826717 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017776512}
W20260709 13:12:25.839103 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 283520us
I20260709 13:12:25.867017 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:25.876106 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 288662us
I20260709 13:12:25.887998 32736 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.888386 32739 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.889374   448 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.914556 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:25.921726 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 323195us
I20260709 13:12:25.899475   368 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:25.933795 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 354722us
I20260709 13:12:25.935593 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:25.936319 30038 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:25.938417   402 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:25.939240   402 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:25.925549   391 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.952908   466 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.955261 32675 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:25.956211 32737 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.007s
W20260709 13:12:25.957583 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 47717us
W20260709 13:12:25.957755 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 47876.2us
I20260709 13:12:25.913518   397 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:25.963017   472 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.352s	user 0.009s	sys 0.021s
I20260709 13:12:25.963955   510 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.965224   435 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.965821   306 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:25.966511   399 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:25.967763 32745 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.724s	user 0.018s	sys 0.001s
I20260709 13:12:25.972424   410 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.973537 32711 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.934165   526 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:25.976838   451 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.021411 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.021720 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:26.021843 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:26.023025 30004 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:25.990439 32737 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
W20260709 13:12:26.026628 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 381033us
I20260709 13:12:25.991050   397 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.013507 32745 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.033828   397 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:25.989176 32675 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:26.037473   378 consensus_meta.cc:287] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.007s
I20260709 13:12:26.037926   378 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6.
I20260709 13:12:26.038002   451 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.038504   451 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:25.986353 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:26.039163 30113 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
W20260709 13:12:26.040164 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 53890.9us
I20260709 13:12:26.040587   451 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.041531   402 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.991293   472 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.042111 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:26.044132   472 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.037380 32675 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:25.998034 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.001904 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.010172 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.012699 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.014832 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.018749 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:25.937770   530 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:12:26.051118 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.047668 30110 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:26.047775 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.052139 30004 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:25.985998 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 48613us
I20260709 13:12:26.046657 30108 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:26.054378   372 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.028129   526 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.033784 32745 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:26.061030 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.061741 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.062136 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.067322 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.071226 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.029728   416 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.074206 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.075017 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.079016 32750 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:12:26.093508   505 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.050266   521 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.095991 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.059486   472 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:26.103258 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.068435   378 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:26.091302 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.069617   451 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.143918 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.145669 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:26.126549 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 74506.4us
I20260709 13:12:26.155078 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.199542 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.201045 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.154625   478 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:26.204020   455 consensus_meta.cc:287] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.007s
I20260709 13:12:26.204361 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.204511   455 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.206923   455 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:26.156529 32754 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.950s	user 0.013s	sys 0.020s
I20260709 13:12:26.210083 30037 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:26.210719 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:26.156327   422 consensus_meta.cc:287] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.011s
I20260709 13:12:26.214229 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.215394 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.229048 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:26.229326 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.215052 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.216758 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.219964 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.226003 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.149974   378 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.226881 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.318405 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.154374   410 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.318953 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.319937 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.338985 30733 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:26.319425 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:26.159883   495 consensus_meta.cc:287] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.881s	user 0.015s	sys 0.021s
I20260709 13:12:26.230512 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:26.353124 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 123152us
I20260709 13:12:26.149717   509 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.252552 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:26.355468 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:26.316375 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.356523 30104 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:26.323444 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:26.324086 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.358445 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.324540 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.325918 30181 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:26.200423   535 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.347981 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:26.149520   497 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.360807 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.215060   435 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.368140 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.384316 30182 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
W20260709 13:12:26.371070 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 118644us
I20260709 13:12:26.386271 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.387367 30741 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:26.387789 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.373215 30181 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:26.382283 30733 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:26.388974 30181 pending_rounds.cc:85] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 3
I20260709 13:12:26.389389 30181 pending_rounds.cc:107] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:26.389842 30181 raft_consensus.cc:2889] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:26.389756 30178 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:26.316557   478 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:26.160272   451 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.392033   478 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:26.392670   478 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:26.394837 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.396667 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.397660 30105 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:26.398866   526 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:26.341665   378 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.409309 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.425971 30179 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:26.428944 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.336058 32736 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.225260 32754 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.383354   435 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.736256   435 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:26.471304 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.739336 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.743568 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.722054 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.519913   529 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.641328 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.386270   535 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.499043 30186 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:26.441222   525 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.386847   509 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:26.773593   509 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.774068   509 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.773828 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.774749   535 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.775368 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.359476   410 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.356882   422 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.368242   532 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:26.720166   523 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.725412 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.544323 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.401168   391 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.820807 30029 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:26.497674   521 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.369314   495 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.465950 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.827919 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.828732 30181 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:26.828740 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:26.829730 30107 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:26.741078 30113 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:26.741912 32754 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:26.520088   538 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.749146 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.832923 30180 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:26.833897 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.521272 32736 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.755800 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.710197   440 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.776921 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.778858 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.779459   525 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.777045 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.729562 32603 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:26.787025 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.850216 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.823715 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.851048 30181 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:26.797323   532 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:26.771896   529 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.827329   451 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:26.839679   455 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:26.840570 32736 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:26.841194 30179 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:26.835356   538 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.842278 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.843096 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.818783   391 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.853287 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.855407 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.856642 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.868677 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.870074 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:26.875380 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.831568   521 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.854379   535 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:26.873099 30182 raft_consensus.cc:2393] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:26.812398   523 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.873811 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.857250   532 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:26.845013   495 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:26.891871 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.893476 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.909907 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:26.910849 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.903334 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.857669 32603 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.851795   440 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.906225 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:26.928928   451 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.929595   451 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.930248   538 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:26.896834   478 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:26.932116   451 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.934055   478 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:26.934329 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.936019 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:26.871560   455 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:26.937950 30187 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.030s	sys 0.053s
W20260709 13:12:26.944135 30187 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.031s	sys 0.054s
W20260709 13:12:26.934135   545 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:26.899168   535 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:26.958292 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.049952 30112 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.010277 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:27.056499 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.064785 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 511) took 1133 ms. Trace:
W20260709 13:12:27.066298 30001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.027s
W20260709 13:12:27.067765 30001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.027s
I20260709 13:12:26.959303   509 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.075300 30150 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.011970   422 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.055418   529 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.019304   552 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.065637 30037 rpcz_store.cc:276] 0709 13:12:25.931330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.931455 (+   125us) service_pool.cc:224] Handling call
0709 13:12:25.940020 (+  8565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.217085 (+277065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.054383 (+837298us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400137c54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:27.064699 (+ 10316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620680960}
I20260709 13:12:27.063675   399 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.080397 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.069598   549 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:27.018698   451 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.086897 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.115993 30112 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:27.140159 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1802) took 1044 ms. Trace:
I20260709 13:12:27.140554 30030 rpcz_store.cc:276] 0709 13:12:26.095711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.086505 (+990794us) service_pool.cc:224] Handling call
0709 13:12:27.140099 (+ 53594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:26.990190 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:27.125638 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 204476us
W20260709 13:12:27.136914 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 230780us
I20260709 13:12:27.149844 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.148454 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:27.154992 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74682.3us
I20260709 13:12:27.121742   422 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.156281 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:26.953846   410 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:27.079275   524 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:27.082352   487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.009s	sys 0.019s
I20260709 13:12:27.200647   521 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.125559 32675 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:27.199767 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 62693.4us
I20260709 13:12:27.201294 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:27.201988 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53635.7us
I20260709 13:12:27.198236 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.199010   552 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:27.152462   378 consensus_meta.cc:287] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.005s
I20260709 13:12:27.208463   455 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.208842   378 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.210021   509 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.211370   378 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.212071   535 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.212212 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.206081   525 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.214567 30185 raft_consensus.cc:1240] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:27.217156 32603 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.218554 32603 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.219326 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:27.219686 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 63501.7us
I20260709 13:12:27.219954 30738 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:27.220809 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.221258 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:27.203773 32675 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.222604 30705 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:27.223316 32675 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.224344 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.224794 32675 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:27.225564 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:27.225960 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.227964 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.206622 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.195103 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.221504 30739 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:27.154234 32736 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.230978 30037 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:27.231973 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.232874 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.233515 30109 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:27.233878 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.234730 30104 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:27.233882 30112 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
W20260709 13:12:27.200642   487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.010s	sys 0.019s
I20260709 13:12:27.141340   451 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:27.251763 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 187025us
I20260709 13:12:27.253124 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.225241 32675 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:27.269846 32675 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.272406 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:27.141607   549 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.275154   549 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.255736 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.148324   399 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.259019   487 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.259135 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.263398 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.240214 32603 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.288335 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:27.267233 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 60703.1us
I20260709 13:12:27.240487   525 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:27.279170 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55787.8us
I20260709 13:12:27.281602 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1791) took 1216 ms. Trace:
I20260709 13:12:27.290875 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.281610   549 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:27.285485 30037 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:27.202527   394 consensus_queue.cc:1059] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:12:27.291072 30036 rpcz_store.cc:276] 0709 13:12:26.064960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.214458 (+1149498us) service_pool.cc:224] Handling call
0709 13:12:27.281534 (+ 67076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.243361   535 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.307224 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.310011 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.311141 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:27.312664 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.293946 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:27.294696 32739 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.297895 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.298202   558 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:27.298545 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:27.313838   535 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.314229 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.319047 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.315798   459 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.320052   459 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.313709   566 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.320488   459 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.321590 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.323025   509 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.323115 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.324049 30036 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:27.326444 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1768) took 1109 ms. Trace:
I20260709 13:12:27.326817 30037 rpcz_store.cc:276] 0709 13:12:26.216706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.325616 (+1108910us) service_pool.cc:224] Handling call
0709 13:12:27.325912 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.326084 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.326113 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.326163 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:27.326222 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.326277 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.326390 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.328569 32675 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.330029 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.325244 32739 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.330788 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1789) took 1301 ms. Trace:
I20260709 13:12:27.331166 30031 rpcz_store.cc:276] 0709 13:12:26.029565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.329774 (+1300209us) service_pool.cc:224] Handling call
0709 13:12:27.330733 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.330292   459 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.298687   394 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:27.333670   394 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:27.334194   459 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.334551   394 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.299505   391 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.299851 30030 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.301440   399 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:27.336189   501 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:27.280126   440 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.331487 30704 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:27.336791   501 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.294749   527 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.301996   368 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.339715 30181 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:27.339978 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.340811 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:27.351677 30179 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:27.341311 30187 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:27.352252   574 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.342007 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:27.352717   574 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:27.353124   574 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.354846 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.351148 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1793) took 1277 ms. Trace:
I20260709 13:12:27.356007 30183 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:27.356199 30035 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:27.356024 30034 rpcz_store.cc:276] 0709 13:12:26.073864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.339698 (+1265834us) service_pool.cc:224] Handling call
0709 13:12:27.351092 (+ 11394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.314211 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.328580 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1769) took 1111 ms. Trace:
I20260709 13:12:27.359596 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:27.343560 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 47244.8us
I20260709 13:12:27.359637 30037 rpcz_store.cc:276] 0709 13:12:26.216997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.327768 (+1110771us) service_pool.cc:224] Handling call
0709 13:12:27.328070 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.328240 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.328276 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.328331 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:27.328368 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.328422 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.328530 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:27.362305 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48171.4us
I20260709 13:12:27.364380 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.364610   510 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:27.365793   501 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.366465 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.366617 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:27.364372 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:27.371593   510 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.373167 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.344825 30033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1781) took 1338 ms. Trace:
I20260709 13:12:27.360195 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.370198 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 505) took 1496 ms. Trace:
I20260709 13:12:27.374372 30029 rpcz_store.cc:276] 0709 13:12:25.873710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.873805 (+    95us) service_pool.cc:224] Handling call
0709 13:12:25.874054 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.824570 (+950516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.369980 (+545410us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540020bcd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:27.370141 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176867200}
I20260709 13:12:27.375517 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1435) took 1161 ms. Trace:
I20260709 13:12:27.375921 30105 rpcz_store.cc:276] 0709 13:12:26.214652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.214798 (+   146us) service_pool.cc:224] Handling call
0709 13:12:27.375337 (+1160539us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540007bf54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:27.375466 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384214912}
I20260709 13:12:27.375490 30035 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:27.377712 30033 rpcz_store.cc:276] 0709 13:12:26.006448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.324061 (+1317613us) service_pool.cc:224] Handling call
0709 13:12:27.324329 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.344467 (+ 20138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.344499 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.344542 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:27.344575 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.344636 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.344765 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.378750   526 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:27.378516   532 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.379168   526 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:27.380108   526 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.380908   532 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.359127 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.340253   394 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.386801 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.387197 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.388332 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.387023   573 consensus_queue.cc:1059] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:27.389174 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:27.389139 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.406417 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.391584 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:27.465736 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 76533.7us
I20260709 13:12:27.411357 30153 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:27.412035 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2005) took 1007 ms. Trace:
I20260709 13:12:27.470355 30106 rpcz_store.cc:276] 0709 13:12:26.404183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.405122 (+   939us) service_pool.cc:224] Handling call
0709 13:12:27.411322 (+1006200us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:27.411538 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.411720 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.411743 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.411836 (+    93us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:27.411862 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.411902 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.411985 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6400256}
I20260709 13:12:27.480547 30030 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:27.391963 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:27.494385 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 88071.5us
I20260709 13:12:27.495644 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.468302 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:27.514739 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46529us
W20260709 13:12:27.515875 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.516530   454 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:27.390955 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.510712   368 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:27.512524   537 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.510941   533 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.515369   538 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.382318   526 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.528816 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:27.532838 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 170886us
I20260709 13:12:27.536725 30111 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:27.536446 30105 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:27.548588 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.548643 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.558650 30107 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:27.550506 30104 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.389606   573 raft_consensus.cc:3055] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:12:27.560038 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46763.9us
W20260709 13:12:27.561594 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 150404us
I20260709 13:12:27.562350 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:27.563592 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.560741 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:27.570753 30112 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:27.515369 32692 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:27.526926   472 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.578094 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.554993   559 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:27.582310   559 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.584225   506 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.584506 32675 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:27.559621   573 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:27.587349 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:27.589162   549 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:27.589491 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:27.590468 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.591514   399 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.591935   399 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.592370   571 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:27.593968   571 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:27.594067 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:27.594472   571 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:27.594901 30112 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:27.595800   422 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:27.596065   571 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.553968   510 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.599609 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:27.600143   510 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.586091   573 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.600811 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.601683   573 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.579744 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:27.604095 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.605795 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.606289 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.606554 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.607673 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.604635 30184 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
I20260709 13:12:27.609557 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.589660   549 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:27.615796   510 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.616680   483 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.617241   483 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.615849 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:27.592593   399 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.614527 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.616067 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.619396 30031 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 4: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:27.619618 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.575287   459 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.575505 32739 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.623471 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.638777 30035 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:27.625304 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.616168   549 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.641041 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.615849 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.642349 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 401) took 1198 ms. Trace:
I20260709 13:12:27.636268 30107 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:27.642736 30733 rpcz_store.cc:276] 0709 13:12:26.443792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.443932 (+   140us) service_pool.cc:224] Handling call
0709 13:12:27.625085 (+1181153us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:27.642280 (+ 17195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43989376}
I20260709 13:12:27.652642 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.615983   532 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.633682   459 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:27.631814   506 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.572618   574 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.579578 32692 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.641656 32739 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:27.665592 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.610620   472 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.663046   459 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.678282 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.658489   440 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:27.680095 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.680462 30738 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.687377 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.691212 30034 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:27.676817 32739 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.691799 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:27.795979 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 104067us
I20260709 13:12:27.786576 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:27.790598 30036 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:27.798331 30038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1794) took 1708 ms (client timeout 2005 ms). Trace:
W20260709 13:12:27.798979 30038 rpcz_store.cc:269] 0709 13:12:26.089983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.785748 (+1695765us) service_pool.cc:224] Handling call
0709 13:12:27.798213 (+ 12465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.800351 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1784) took 1793 ms. Trace:
I20260709 13:12:27.801384 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:27.804410 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.807842 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:27.800922 30036 rpcz_store.cc:276] 0709 13:12:26.007366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.324590 (+1317224us) service_pool.cc:224] Handling call
0709 13:12:27.789850 (+465260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:27.798415 (+  8565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.800024 (+  1609us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54002eefd0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:27.800238 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068769664}
I20260709 13:12:27.824507 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:27.699539 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79988.5us
W20260709 13:12:27.838086 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 159019us
I20260709 13:12:27.842592 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:27.858325 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.860469 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:27.717293 32692 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.692634   368 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.688687   440 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.731233   399 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.731750   472 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.716209   483 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.690770   497 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.672994   506 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.908828   399 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.686137   509 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.733062   523 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:27.924955   375 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:27.925896   375 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:27.689150   533 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.703071   559 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:27.693054   566 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.730623   574 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:27.696172   579 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.714632   584 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:27.940477   584 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:27.886235 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78761.5us
I20260709 13:12:27.942519   451 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.942781   505 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:27.943671   472 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:27.944139 32675 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:27.944540   506 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.886593   459 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.945559 32675 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:27.946128 32675 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:27.947875   459 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.947608 32675 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.919848   510 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.949656   510 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:27.950286   510 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.950697   435 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.955049   495 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:27.955685   495 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:27.900662   536 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.956444   536 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.956983   536 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.663869   532 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.960824   532 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:27.927119 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:27.929023   535 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:27.931468 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 78061.6us
W20260709 13:12:27.966012 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 56902.3us
I20260709 13:12:27.966660 30153 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:27.968173 30153 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:27.968971 30107 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:27.969702   397 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.969884   534 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.926218   523 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:27.942404 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.937779 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 145) took 6128 ms. Trace:
I20260709 13:12:27.941123   584 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:27.979557 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:27.969007 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:27.987314   509 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.977152 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:27.973150 29932 rpcz_store.cc:276] 0709 13:12:21.809358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.809588 (+   230us) service_pool.cc:224] Handling call
0709 13:12:22.044078 (+234490us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:27.937374 (+5893296us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:25.368187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:25.620610 (+252423us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:25.620646 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:12:25.620666 (+    20us) tablet.cc:662] Decoding operations
0709 13:12:25.621355 (+   689us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:25.621450 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:25.621475 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:25.622086 (+   611us) tablet.cc:701] Row locks acquired
0709 13:12:25.622110 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:12:25.622277 (+   167us) write_op.cc:270] Start()
0709 13:12:25.622404 (+   127us) write_op.cc:276] Timestamp: P: 1783602745622224 usec, L: 0
0709 13:12:25.622437 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:12:25.775043 (+152606us) log.cc:844] Serialized 2069 byte log entry
0709 13:12:26.806857 (+1031814us) op_driver.cc:464] REPLICATION: finished
0709 13:12:27.159836 (+352979us) write_op.cc:301] APPLY: starting
0709 13:12:27.203475 (+ 43639us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:27.251406 (+ 47931us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:27.294183 (+ 42777us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:27.352290 (+ 58107us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:27.352515 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:12:27.352560 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:27.352825 (+   265us) log.cc:844] Serialized 47 byte log entry
0709 13:12:27.353001 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:27.353094 (+    93us) write_op.cc:454] Released schema lock
0709 13:12:27.353143 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:27.353613 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:27.353643 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":853,"mutex_wait_us":1831147,"reported_tablets":9,"spinlock_wait_cycles":114918144,"child_traces":[["op",{"apply.queue_time_us":319847,"apply.run_cpu_time_us":13991,"apply.run_wall_time_us":204755,"num_ops":5,"prepare.queue_time_us":186041,"prepare.run_cpu_time_us":116004,"prepare.run_wall_time_us":741632,"raft.queue_time_us":392906,"raft.run_cpu_time_us":13619,"raft.run_wall_time_us":261442,"replication_time_us":1184238,"thread_start_us":1100626,"threads_started":4,"wal-append.queue_time_us":618032}]]}
I20260709 13:12:27.987347   478 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:12:27.943671   505 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.996513   505 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:27.997052   577 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.336s	user 0.003s	sys 0.000s
I20260709 13:12:27.975920   375 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:27.998580   579 consensus_queue.cc:1059] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.054466   579 raft_consensus.cc:3055] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.054998   579 raft_consensus.cc:740] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:28.056353   579 consensus_queue.cc:260] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:27.957257   495 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.058375   579 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:28.001528 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:28.003268   582 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
I20260709 13:12:28.006104   416 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:28.008138   509 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.009801 30736 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:28.067901 32675 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:28.015033 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 47114.9us
I20260709 13:12:28.016546 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.019887   559 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.081634 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:28.082139   509 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.082435   559 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.082953   559 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:28.082787 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 66448.3us
I20260709 13:12:28.084278 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.084076   559 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.085208   509 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.021908 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:28.023353 30038 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:28.026779 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.028319 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.089059 30187 raft_consensus.cc:2410] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:28.028653 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:28.089735   495 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.029276 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.090679 30179 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:28.033016 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.034919 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.036496 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.092413 30186 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:28.037185   588 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.038357 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.039595 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.040138 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.040660 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.043560   440 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.095836 30732 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:28.068536   581 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:28.069774 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68628.9us
I20260709 13:12:28.091768 30181 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.051707 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.011543 32739 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:28.107007 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.111024 30738 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:28.117781 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.036455   435 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.119896   440 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:28.123600 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.124045   440 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.127029 32736 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.127830 32736 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.131714   549 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.132400   448 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:28.133687 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.134202   510 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.136925   559 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.139804 32739 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.140998 30150 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.142714 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:28.144908 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.146083 29933 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 4 to 5, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.137705   368 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:12:28.150310   584 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.152807   584 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.153658 30004 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:28.155648   416 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:28.156148   416 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:28.156002   536 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.156642   416 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:28.160471   394 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.007s
I20260709 13:12:28.146113 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.156755   387 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:28.165272   368 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:28.165984 32736 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:28.134497 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.148167 29933 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.167869 30079 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:28.171340   510 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.150799   440 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.179327   536 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.179637   454 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:28.202091   454 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:28.202514 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.193589   368 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:28.199244 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78497.9us
I20260709 13:12:28.184952 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.193332   387 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:28.204677   454 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:28.211118 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 43497.8us
I20260709 13:12:28.210809   387 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.213672   440 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.213769 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.214680   440 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:28.215107   440 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:28.215341 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:28.216554 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 101248us
I20260709 13:12:28.218096 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:28.206460 29933 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.218164   536 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.215409   562 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:28.219650   562 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:28.219221   536 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.220095   562 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:28.220412   454 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.219129   509 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:28.224515   509 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:28.224812   536 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.204100 30181 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:28.215488   440 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.223858 30183 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:28.227851 32737 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.238556 30112 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.228215   368 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.227768 29933 catalog_manager.cc:5697] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 4 to 5, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.230350 30186 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.231818 30180 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:28.232218   509 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.267768 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.269618 30036 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:28.273193 29933 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 4 to 7, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.277261 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:28.282914 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.292207 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.292536 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.294492   549 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.295873 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:28.281252   368 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.252992   581 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:28.300765 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.303159 32736 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:28.305187 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.307176 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:28.299422 29933 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.321167 30111 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:28.321388 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:28.324637 32736 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:28.325178 32736 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:28.315685   591 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:28.327553   591 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.329262 30733 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:28.326318 32736 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.338429 32736 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.341744 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.353609   591 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.355135 30179 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.356209 30705 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.359364 30183 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.364607 29933 catalog_manager.cc:5697] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 6, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.373885   579 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.374799 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.377341 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.380146 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:28.381453 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.382799   538 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.383213   538 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:28.383533   562 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.387877 30737 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:28.387995 29933 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 1 to 5, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:28.393432   510 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:28.394817   510 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:28.395176   510 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:28.384234   538 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.396325   510 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.403204   538 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.403671 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.404007 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:28.404569 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.399619 29933 catalog_manager.cc:5697] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 3 to 4, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 4 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.408780 29933 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
W20260709 13:12:28.409860 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53728us
I20260709 13:12:28.410066 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.412683 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:28.404224   510 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:28.415016 30108 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:28.417743 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.418612 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.419214 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.419931 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.427490 30184 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:28.422860 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:12:28.425840   509 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.428686 30179 raft_consensus.cc:606] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.404918   440 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.430325 32675 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.436408 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.440558 30179 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.446038 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:28.447175 30180 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:28.445329 30737 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 3.
I20260709 13:12:28.449568 30079 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:28.450027 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:28.408432   416 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.454576 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:28.456867 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.442507   387 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.461046 30105 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:28.462002 30153 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:28.443253   562 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.464219 32675 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:28.465942 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.468581 30032 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:28.468732 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.456207   375 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.475368   416 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.454335   536 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.453734   440 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.481688 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:28.483883 30111 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:28.485023 30183 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:28.485201 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.486428 30733 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.498764 32737 consensus_queue.cc:1059] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:28.500375   398 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:28.483541   495 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.500813   398 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:28.502158 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:28.505256 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.508432 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.510898 30109 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:28.485932   536 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:28.515852   509 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:28.496732   448 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.517233   591 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:28.523156 30184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
W20260709 13:12:28.526523   573 consensus_queue.cc:1175] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef9ab4d665234a799376bf42ef5d058c" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 5 } }
I20260709 13:12:28.488574   562 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:28.489617   375 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:12:28.535491 30184 raft_consensus.cc:606] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.537051 30704 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:28.539363 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.522691   584 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:28.555583 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.561584   530 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:28.565443   591 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.566082   591 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:28.566699 30737 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.567121   591 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:28.584785 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.590380 32736 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:28.590867 32736 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:28.591710 32736 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.551043   398 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.597750   549 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:28.568971   536 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.627059   505 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:28.611188 32736 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.633738 30180 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:28.598191   558 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:12:28.649892 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.637101   387 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:28.659971 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.674746 30185 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:28.672487 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 120300us
I20260709 13:12:28.691529 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:28.693949 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.698832 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.699757   549 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:28.700800   549 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:28.708211 30180 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:28.683357   530 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:28.703281   505 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:12:28.715968 30034 raft_consensus.cc:2393] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:28.732290 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.711774   454 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.719185 32675 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:28.757455 32675 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:28.745853 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.756693   448 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:28.764067   448 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.767993   530 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.724032   549 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:12:28.771494   448 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:28.772228   598 log.cc:927] Time spent T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:12:28.801575 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 115178us
W20260709 13:12:28.808861 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 165793us
I20260709 13:12:28.762487   454 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.817473   559 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:12:28.828284 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.807968   549 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:28.840924 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.847955 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:28.848855 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.849452 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:28.848341 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:28.851418 30187 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:28.851114 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:28.853284 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 135009us
I20260709 13:12:28.858289 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.858443   505 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:28.862296   505 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.864634   505 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:28.866547 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 47750.6us
I20260709 13:12:28.867465 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:28.868796   608 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:28.871189   454 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:28.869282   608 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:28.872123   608 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.875613 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.885552   559 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:28.886602   559 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:28.887818   559 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.889539   368 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:28.893837   368 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:28.894449   368 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.829284 32675 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.898221   558 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.898712   558 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:28.900137   549 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:28.899696   558 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:28.920780 30111 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:12:28.924504 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 66306.3us
W20260709 13:12:28.924230 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 56902.6us
I20260709 13:12:28.925115 30032 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:28.925381 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.928632 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:28.928830 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.929109 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:28.937944 30186 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:28.913911   398 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.910916   368 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:28.925978   558 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.944191 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:28.945916 30185 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:28.932143 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:28.948926   394 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.954918   608 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.943964   549 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:28.962924   549 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:28.963874   549 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.964709 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.958684   394 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:28.965813   454 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.966439   394 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:28.967407 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:28.967928   394 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.968364 32736 raft_consensus.cc:993] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:28.968797 32736 raft_consensus.cc:1081] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:28.969552 32675 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.971273   591 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.972882 32737 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:28.976187 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:28.976864 30029 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:28.956180   615 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.952584   538 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:12:28.958045 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 82562.3us
I20260709 13:12:28.995873 30737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:28.984642 30732 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:28.949025   581 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:12:29.006299 30151 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:29.009001 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.015324 30038 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:28.991155   454 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:29.017350 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 50083.6us
I20260709 13:12:29.028283   608 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:29.034823 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 90716.7us
I20260709 13:12:29.036262 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.013798 32737 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:29.060118   618 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:29.047508 32737 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.048385   375 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:12:29.065363 32737 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.048456   509 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.066139   612 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:29.066663   612 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:29.066730 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61655.8us
I20260709 13:12:29.067803   612 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.035090   608 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.068221 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.062672   398 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:29.087926 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 55123.8us
W20260709 13:12:29.094991 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.099994 32737 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.106556 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.108433   509 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.108632 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.111672   368 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:29.113758   616 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:12:29.114552   368 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.115185   368 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.115914 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.116552 30038 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.117578   368 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.079077   612 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:29.132349 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:29.133142 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.076337   608 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.109602   509 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:29.144027   509 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:29.152350   509 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:29.152949 32737 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.162916 30733 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:29.166110 30737 raft_consensus.cc:606] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.166500 30737 raft_consensus.cc:614] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.168680   608 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.139778   609 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.170336 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.171227   607 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:29.173889 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.174091   613 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:12:29.178073 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:29.146476   558 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:29.179348   558 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.192173 30111 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:29.189664 32737 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.197223 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:29.197505   591 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:29.198118 30738 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:29.196584 32737 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:29.198980 32737 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.196741   558 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:29.201615   368 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:29.202813   368 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:29.203024 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.204087   612 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.206046 30153 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:29.206913   612 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:29.207484   612 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:29.209889 30185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:12:29.210561 30185 raft_consensus.cc:606] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.210722 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.210966 30185 raft_consensus.cc:614] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.213250 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.215224 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.216506 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.219144 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.219738 30112 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:29.222393 30108 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:29.224887 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.225602   607 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.203218   368 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:29.226172   607 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.226709   368 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.208469   612 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.228132   368 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:29.230185 30738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:29.230835 30738 raft_consensus.cc:606] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.231227 30738 raft_consensus.cc:614] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:29.231459   509 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.234614 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:29.246008 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.258311 30186 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:29.261807 30106 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:29.262943 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.263695 30030 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:29.265655 30110 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:29.256582 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:29.271837 30151 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:29.272565 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.272753 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.273332 30110 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:29.204500 30038 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:29.282784 30151 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:29.283660   607 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.290421   509 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:29.289810   562 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.295715 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.316825 30106 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:29.309122 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.312273 30112 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:29.284080   454 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:29.298342 30187 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.326610 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:29.296551   375 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:29.330536 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 293983us
I20260709 13:12:29.342967 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.323195   591 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.305341 32737 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.343775   509 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.333098   559 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.330348   454 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.350872   538 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.351167 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.352349   394 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.354091 30186 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:29.354759   505 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:29.360003 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 90140.6us
W20260709 13:12:29.350057   625 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:29.345271   375 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:29.396020 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.376175   454 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.402015 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.378461   549 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:29.411027 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59949.1us
I20260709 13:12:29.371657   591 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.421427 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:29.424921 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.425773 30110 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:29.429168 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:29.425787 30183 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:29.382630   584 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:12:29.381361   509 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.380699   538 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.438330 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.439438 30179 raft_consensus.cc:2410] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:29.414772   536 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.418438   608 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.450106   619 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.469923 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:29.416918   549 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.471371 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.439968   394 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.476614 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.436889 32675 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:12:29.469077   416 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.492619   536 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.495198 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.475106   394 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:29.472625   630 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:29.535003   630 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.424943   375 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.484892   641 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:29.512955   644 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:29.513862 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:29.480297   573 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.519665   591 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.522534   538 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.525218   509 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.505355   416 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:29.473553   619 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.502252 30183 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:29.538221   641 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:29.562369   394 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.564260   549 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:29.564337   394 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:29.569636 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 55858.1us
I20260709 13:12:29.571393   645 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:29.578822   416 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.596258   645 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.574188 32737 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.560376   536 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:29.577412   619 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:29.577940   641 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:29.591286 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 178140us
I20260709 13:12:29.601630 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.540954   454 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:29.606927 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 108070us
I20260709 13:12:29.634411   530 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:29.634915   530 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:29.635198 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.635844   530 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.636510 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:29.613696   536 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:29.638149   536 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.642114 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.600858   558 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:29.643364 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:29.642812 30104 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:29.650079 30181 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:29.650316 30738 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:12:29.637117   530 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:29.652793 30079 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:29.644824 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.660887 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:29.661600 30738 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 3.
I20260709 13:12:29.664636   619 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.668998 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.670758 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.671386 30038 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:29.672590 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.674099 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.675859 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.676574 30038 raft_consensus.cc:2393] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:29.677508 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.680932 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:29.652439   509 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:29.682596 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46182.9us
I20260709 13:12:29.682946 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.683786 30108 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:29.684870 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:29.681993 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:29.642175   645 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:29.689543   647 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:29.691077   647 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:29.691546   647 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.691574   619 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:29.691992   647 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.692101   619 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:29.662752   644 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.693202   644 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:29.689092 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.679771 30105 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.698024 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.687215   495 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.701184 30704 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:29.653389   655 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.698670 30186 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:29.706310 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.663839   630 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:29.714368 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.693919   584 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.716346 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:29.721720 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.696638   644 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.693029   619 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:29.717170   656 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:12:29.708742   645 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.694507   615 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:12:29.727062 30036 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:29.720571 32675 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:29.719229   584 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:29.743165 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 48397.3us
I20260709 13:12:29.747347 30004 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:29.750854   454 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.716182   495 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.748757 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.753273 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.740702 32675 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.742287   562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60992 (request call id 1) took 1261 ms. Trace:
I20260709 13:12:29.819092   581 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.818403   562 rpcz_store.cc:276] 0709 13:12:28.474734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.475393 (+   659us) service_pool.cc:224] Handling call
0709 13:12:28.558639 (+ 83246us) log.cc:844] Serialized 501 byte log entry
0709 13:12:28.730954 (+172315us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b540042ff20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe604c142 00007fcbe602ceaa 00007fcbe6033d53 00007fcbe6033cd9 00007fcbe6033c69 00007fcbe6033c31 00007fcbe6032dfd 000000000038f354 000000000038f199 00007fcbe2fe6475
0709 13:12:28.825580 (+ 94626us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b18000d6900. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe6053b26 00007fcbe604d49a 00007fcbe604c714
0709 13:12:28.845825 (+ 20245us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b540042ff20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe6053b26 00007fcbe604d49a 00007fcbe604c714 00007fcbe602ceaa 00007fcbe6033d53 00007fcbe6033cd9 00007fcbe6033c69 00007fcbe6033c31 00007fcbe6032dfd 000000000038f354
0709 13:12:28.924914 (+ 79089us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4c0043e340. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe439fa20 00007fcbe43b0a29 00007fcbe43b113f 00007fcbe43752ab 00007fcbe43a2f3c 00007fcbe43a33fe 00007fcbe463050b 00007fcbe602f381 00007fcbe602d26b 00007fcbe6033d53 00007fcbe6033cd9
0709 13:12:29.731088 (+806174us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3953,"raft.queue_time_us":5590,"raft.run_cpu_time_us":9892,"raft.run_wall_time_us":410280,"spinlock_wait_cycles":45518336,"thread_start_us":124673,"threads_started":1,"wal-append.queue_time_us":243114}
I20260709 13:12:29.819629   581 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.820544 29923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c1b7d91eea54fb4990789f41041df86 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:29.746030   573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60992 (request call id 0) took 1266 ms. Trace:
I20260709 13:12:29.820919   647 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.821411   573 rpcz_store.cc:276] 0709 13:12:28.474409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.487502 (+ 13093us) service_pool.cc:224] Handling call
0709 13:12:28.580850 (+ 93348us) log.cc:844] Serialized 501 byte log entry
0709 13:12:29.740502 (+1159652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28358,"raft.queue_time_us":28865,"raft.run_cpu_time_us":1960,"raft.run_wall_time_us":73780,"thread_start_us":155857,"threads_started":1,"wal-append.queue_time_us":231806}
I20260709 13:12:29.822770   652 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.823489 29923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 76d91f22e2654dd1ae5451605e7a3b23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:29.823324   652 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.825888   495 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.826117   581 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.827577   652 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.829365 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:29.829981 30733 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:29.826777   641 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:29.835204   639 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.346s	user 0.002s	sys 0.002s
I20260709 13:12:29.837507   549 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:29.838011   549 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:29.748066   584 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.750699   633 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:29.840040   633 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:29.840453   633 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.840803 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.841504 30033 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:29.841881   667 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.842434   667 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.843514   641 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:29.767431 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.755251   619 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.844938 30180 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:29.845424   667 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.845960   667 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.846426   667 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.761034   509 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:29.796684 30030 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:29.799505 30038 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:29.785728 32675 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:29.849830   667 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.850349   667 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.850767   667 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.803768 30185 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:29.804664   645 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.854307   645 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.755151   558 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:29.856174   558 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.856338   645 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.856568   558 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:29.807168   368 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.857220   368 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.808917 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.811627 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.859318   368 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.859645 30032 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:29.862031 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.809573 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.787638 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:29.863999 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 76461.9us
I20260709 13:12:29.864120 29930 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.865433   368 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.835137 30187 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:29.865904 29930 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 7, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.849040   509 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:29.847808   641 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.869709   641 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.869228   509 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.864718 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.815718   536 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.852682   667 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.882201   584 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.880270   641 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:29.877678   368 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.889087   536 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:29.890451 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61065.3us
I20260709 13:12:29.894162 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.894398 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.915146   644 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.917094 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:29.903597 30111 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:29.901775 30104 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:29.905839 30105 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:29.906760   647 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:29.906483   549 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.894861 29930 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.938077 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.938617 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.938678 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.939405 30104 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.909011 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:29.902913 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.896258 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.926199 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.924762 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.917564   619 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.886967 32675 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:29.933591 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.942504 29930 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:29.939492 30106 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:29.940961 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.946128 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:29.936270   666 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:29.947170 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.947204 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.958146 30733 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:29.947911 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.948594 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.959643 30113 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:29.948513 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.954739 30109 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.955582 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.956737 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.960516 30185 raft_consensus.cc:2393] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:29.958472 30187 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:29.923221   536 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:29.938167 30111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:12:29.966471 30111 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.966775 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:29.967036 30111 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:29.969071 30107 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.969822 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.966423 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:29.972379 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.986358 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:29.987442 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:29.990336 30038 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:29.996096 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:29.961315   394 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:29.999152 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:29.956115   645 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.963383 29930 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 3, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:30.010407 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:30.008651 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:30.004249 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.015471 30113 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:29.957566   618 consensus_queue.cc:1175] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef9ab4d665234a799376bf42ef5d058c" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 13:12:29.966333   651 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:29.994415   647 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:29.988694   549 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.025840 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:29.957561   666 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.021142 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.005560   394 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:29.963169   619 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.004632   646 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:30.037636 30186 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:29.986012   536 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:29.972681   495 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:12:30.045447 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 74518.3us
I20260709 13:12:30.046532 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 243) took 9558 ms. Trace:
I20260709 13:12:30.028200   454 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.054422 30038 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:30.056020 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:30.059456   642 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:12:30.063053   670 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:30.063689   670 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.066226   614 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:30.066412   670 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.042708   666 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.028630   647 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:30.052912 30111 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.059033 30182 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
W20260709 13:12:30.076340 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.046124   394 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.041069   368 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:30.039173   651 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:30.050698 29933 rpcz_store.cc:276] 0709 13:12:20.481516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.481705 (+   189us) service_pool.cc:224] Handling call
0709 13:12:20.717176 (+235471us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:30.040090 (+9322914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:28.773496 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:28.774172 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:28.774225 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:12:28.774245 (+    20us) tablet.cc:662] Decoding operations
0709 13:12:28.842783 (+ 68538us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:28.859297 (+ 16514us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:28.860246 (+   949us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:12:28.863035 (+  2789us) tablet.cc:701] Row locks acquired
0709 13:12:28.863120 (+    85us) write_op.cc:260] PREPARE: finished
0709 13:12:28.863290 (+   170us) write_op.cc:270] Start()
0709 13:12:28.863442 (+   152us) write_op.cc:276] Timestamp: P: 1783602748863225 usec, L: 0
0709 13:12:28.863464 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:28.864115 (+   651us) log.cc:844] Serialized 4030 byte log entry
0709 13:12:29.262864 (+398749us) op_driver.cc:464] REPLICATION: finished
0709 13:12:29.426731 (+163867us) write_op.cc:301] APPLY: starting
0709 13:12:29.426820 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:29.427051 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:29.427164 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:29.515178 (+ 88014us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d032a 00007fcbe6055f14 00007fcbe6055ec3 00007fcbe6055e38 00007fcbe6055df3 00007fcbe60550dc 00007fcbe607ee16 00007fcbe6066cbb 00007fcbe605139d 00007fcbe6054d75
0709 13:12:29.515414 (+   236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:29.515863 (+   449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:12:29.515919 (+    56us) write_op.cc:312] APPLY: finished
0709 13:12:29.516324 (+   405us) log.cc:844] Serialized 77 byte log entry
0709 13:12:29.516539 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:29.516666 (+   127us) write_op.cc:454] Released schema lock
0709 13:12:29.516733 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:29.517213 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:29.517246 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21709,"reported_tablets":33,"spinlock_wait_cycles":491065600,"child_traces":[["op",{"apply.queue_time_us":150825,"apply.run_cpu_time_us":4657,"apply.run_wall_time_us":90439,"num_ops":10,"prepare.queue_time_us":140778,"prepare.run_cpu_time_us":15366,"prepare.run_wall_time_us":153283,"raft.queue_time_us":82829,"raft.run_cpu_time_us":31756,"raft.run_wall_time_us":257173,"replication_time_us":399227,"spinlock_wait_cycles":10241280,"thread_start_us":240806,"threads_started":4,"wal-append.queue_time_us":89103}]]}
I20260709 13:12:30.118074 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.045166   641 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.118810 30107 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:30.026842   645 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.125470 30108 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:30.128868 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 142585us
I20260709 13:12:30.057816   454 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.139439   454 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.146077   536 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.151232 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:30.151932 30738 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:30.153122 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:30.154052   630 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.154477   630 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.154886   630 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.156598   602 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.157224   602 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.127946 30111 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.082641   647 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.160298 30104 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
W20260709 13:12:30.124224 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 123033us
I20260709 13:12:30.130280 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:30.130266 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74808.5us
I20260709 13:12:30.131626   614 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:30.134292   391 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.135888   619 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.137689   584 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.137874 30112 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:30.057454   646 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.120232   654 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.138952   645 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:30.154047 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:30.162627 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:30.130952 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:30.164397 30109 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:30.172096 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:30.210793 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48247.9us
I20260709 13:12:30.175709 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.175235   536 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.199113   646 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.199995   651 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.201020   495 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:30.201611   654 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.204790   633 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.205704 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.222728 30029 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:30.178249   391 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.175239   644 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.172326 30108 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:30.211675 30107 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.212162 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:30.212651 30738 raft_consensus.cc:2368] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:12:30.164641   602 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.233270 30704 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:30.221973 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68185us
I20260709 13:12:30.240289 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:30.234061   663 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:30.234797   622 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:30.235975   391 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:30.179558   558 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.255895 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:30.263532 30079 leader_election.cc:400] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:12:30.264067 30079 leader_election.cc:403] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:30.271811 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.274070 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.244818   644 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:30.282274 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.283959 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.290537 30106 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.295068 30109 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:30.298087 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.298760 30109 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:30.266979   509 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:30.278668   581 raft_consensus.cc:2804] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:30.313102 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.318933 30107 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:30.314445 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.323644 30110 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:30.325865 30704 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:30.302191 30732 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:30.328178 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.302289   495 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:30.330910   669 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:12:30.333585   581 raft_consensus.cc:697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:30.287719   391 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.252895   676 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:12:30.281050   573 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:30.338133 30106 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:12:30.352092 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 58044.5us
I20260709 13:12:30.302902   615 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.334228   584 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:30.301369   673 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.365006 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.438584 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:30.439235 30733 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:30.439388 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74490.1us
I20260709 13:12:30.381561   591 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.383502   654 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.320487   619 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:12:30.384786   655 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:30.269655   614 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.386543 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:30.445940 30183 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:30.446090 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.438023 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:30.440333 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.438125 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:30.443675   398 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:30.452451 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:30.454074 30179 raft_consensus.cc:3060] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:30.445003 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 207667us
I20260709 13:12:30.366124   573 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.364080   454 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.362453   669 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:12:30.444298   655 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:30.469023 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 174349us
I20260709 13:12:30.470134 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:30.472071 32675 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:30.465061   657 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.436975   394 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.464793   654 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:30.505357 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65126.9us
I20260709 13:12:30.449023   584 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:30.376377   666 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.447646   591 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.466675   536 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.468619   602 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.530117 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:30.540221   559 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.540750   559 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:30.565562 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173525us
I20260709 13:12:30.528368   654 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.528136   633 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.571697   607 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:30.560256 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:30.579196 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67599.4us
I20260709 13:12:30.581271 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.583072 30179 raft_consensus.cc:2468] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:30.444878   581 consensus_queue.cc:237] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.528350   673 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:30.587195 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.533236   602 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:30.587941 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 136825us
I20260709 13:12:30.590623 30112 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:30.579038   636 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:30.508611   676 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:12:30.541779   495 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:30.598501 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:30.601770 30108 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:30.589957   558 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.610212   538 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:30.610877   394 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.603736 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.608001   495 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:30.574410   559 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.613564 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.645082 30732 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:30.615844   549 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.000s
I20260709 13:12:30.650461   559 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.650852   666 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:30.620823   538 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.651949   538 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.618474 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:30.654104 30112 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:30.593195   684 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:30.657228   684 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.657768   684 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.608928   584 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.658128   573 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:30.595191   607 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:30.661010   454 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:30.617799   591 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:30.650485   682 consensus_queue.cc:1175] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98b3b699b87245df85d3aa84c13f5691" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 13:12:30.592833 32675 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.595734   602 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.664422 30704 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:30.668298 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:30.677390 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74098.5us
I20260709 13:12:30.677821 30733 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:30.678431   591 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.677862 30107 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:30.678901   591 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.679003 30153 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:30.680766   591 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.682330 30153 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:30.683503   398 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:30.683902   398 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.684253   398 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:30.670200   647 consensus_meta.cc:287] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:12:30.685607   607 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.686152   647 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.688489   647 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.688668 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:30.689366 30186 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:30.692049 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:30.692803 30186 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:30.692437   398 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.694830   398 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.695957   652 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:30.701083   630 consensus_meta.cc:287] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 13:12:30.697259   655 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.696979   530 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:30.715997 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51674.6us
I20260709 13:12:30.680068 32675 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.710505   630 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.711302 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:30.716931 30738 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:30.721692 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.722764 30739 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:30.730902 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67628.1us
I20260709 13:12:30.735818 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.736150 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:30.741115 30108 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:30.744656 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.745677 30738 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:30.750710   538 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.761026 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.762406 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:30.763118 30111 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.769044 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.772096 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.773037 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.768127 30106 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:30.778221 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.778410 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.757210   692 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:30.782141 30736 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:30.734473   682 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:30.772011   655 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.800643 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:30.801295 30733 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.802938 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:30.783957   630 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.809439 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:30.810945 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.811612 30029 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:30.813059 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.816016 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.816861 30111 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:30.818672 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:30.819044 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:30.819514 30036 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.821785 30034 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:30.791061   692 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:30.815258 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:30.800643   530 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:30.766083   495 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:30.826772 30184 raft_consensus.cc:2368] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:12:30.828552 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.830248 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:30.863772 30733 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:30.834573 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:30.830232 30038 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:30.821033   607 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.898202   657 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:31.270788   607 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:31.230042   602 consensus_meta.cc:287] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:12:30.815538   612 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.224218   536 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.273056 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 474828us
I20260709 13:12:30.814198   679 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.088465 30036 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:30.906186   692 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.334227 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:30.820809   694 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:12:30.900231   654 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:30.829533   619 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:31.277222 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:31.289832 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 489954us
I20260709 13:12:31.290932 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.330494 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:31.335055 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:31.346849 30184 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:31.290304 30732 consensus_meta.cc:287] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
I20260709 13:12:30.882462   630 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.353463 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:31.354130 30110 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:31.348423 30182 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:31.346251 30034 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:31.260051   643 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.347492 30184 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:31.342391   619 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:31.350523 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.360684 30186 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:30.907871 32675 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.115927   454 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:31.364046   705 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.364339   559 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.364219   454 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.364671   705 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.365051   559 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.367058   705 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.367442   622 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.367734   705 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.367897   559 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.368077   622 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.368392   705 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.369581   657 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.370183   657 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.372668   657 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.374310 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:31.375017 30038 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:31.302368   602 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:30.899255   615 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.447s
I20260709 13:12:31.276196   607 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.359375 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:31.344427   591 consensus_meta.cc:287] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.004s
I20260709 13:12:31.290009   644 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:31.342309   700 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.396495 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:31.397953 30034 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.387868 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:31.398008 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.378521 30184 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.399580 30184 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:31.331025   536 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.399940   591 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.402938 30109 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:31.382335   559 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.403957   536 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.404325   591 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.404590   536 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:31.353156 30732 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:31.405190 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.405047   696 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:31.405898   696 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.406294   696 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.406332 30740 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:12:31.312742   530 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.408887 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:31.336606   612 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.362288   663 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.414392 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:31.426452 30186 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.432629 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:31.400260   615 consensus_queue.cc:1243] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:12:31.417963   684 consensus_meta.cc:287] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.004s
I20260709 13:12:31.433329 30109 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.433755 30738 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:31.363391   630 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.348002   679 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.410235   697 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:31.413590   681 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.441643 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 110484us
I20260709 13:12:31.424093   607 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.450390   704 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.456398   704 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.451098   618 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.452132 30182 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:31.404420   559 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.409511   644 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.432716   538 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.356329   643 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.474189 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:31.475449 30186 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:31.471225 30032 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:31.480657 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:31.459703 30036 raft_consensus.cc:2955] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:31.486315   654 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:31.486840   654 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.487175   654 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.487767 30109 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:31.411656   700 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.427999   691 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:12:31.459614   536 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.468044   642 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.457031   697 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.510844 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.517120 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:31.518108 30181 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.467921   669 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.477314   675 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:31.504105   704 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.446390   684 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.476692   398 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.440325   663 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:31.563452 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 204180us
I20260709 13:12:31.569970 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.572436   663 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.475584   607 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.523069   536 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.574512 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:31.576283 30184 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:31.512148   652 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.466218   681 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.473270   618 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.578694 30185 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:31.582891 30034 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
W20260709 13:12:31.565217   712 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:12:31.586185 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 177386us
I20260709 13:12:31.591162 30186 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:31.599406 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:31.563728 30181 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
W20260709 13:12:31.575066 30077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.530s (SENT) [suppressed 16 similar messages]
I20260709 13:12:31.585602 30029 raft_consensus.cc:2955] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 3 to 6, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:31.621357 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 175983us
I20260709 13:12:31.623560 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:31.575884   675 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:31.599017   657 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.603902   454 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.548823   669 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.528661   642 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.580003   398 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:31.627262   706 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:12:31.610536   622 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:31.638108 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 126515us
W20260709 13:12:31.647419 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.629415   704 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.650344 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.650743 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:31.635093   612 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.635308   558 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:31.686700   549 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.686836   559 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.687252   622 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.687749   643 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.692312 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.636624   657 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.629779   703 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.246s
I20260709 13:12:31.693475   713 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:31.690032 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.649734   530 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.703545 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:31.685098 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.692960 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.683652   538 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:12:31.716241 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 141210us
I20260709 13:12:31.717455 30184 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:31.719081 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.719257 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:31.719777 30180 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:31.719959   721 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:31.720063   669 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.719800 30033 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:31.720744   721 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:31.721633   538 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:31.721817   721 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.722703   538 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:31.726228 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.712666   549 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.729993 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:31.729432 30732 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:31.740207 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:31.870350 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.730757 30036 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.828670 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.867188 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:31.870484 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 130412us
I20260709 13:12:31.823467 30181 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:31.710440   704 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:31.893697 30036 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:31.713506   683 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.813181   644 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.694087   675 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.803858   558 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.730587   630 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.896096   684 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.898748   642 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.899626   681 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.889864   697 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:31.902313   711 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
W20260709 13:12:31.903044   714 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:12:31.895545   663 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.735118   713 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.906872   654 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.876828   591 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:31.935114   655 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.133s	user 0.012s	sys 0.001s
I20260709 13:12:31.920939   727 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.935845   727 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.923352   558 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.876997   549 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.850396   700 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.880872   536 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.713295   622 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.918532   618 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.920728   644 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.914556   731 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.934317   669 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:31.935307   591 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:31.733287   679 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:31.988570 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:31.951802 30183 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:32.002039   536 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.002730   536 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.922024   683 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.010329 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:31.995441   710 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
W20260709 13:12:31.987756   696 consensus_meta.cc:287] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 13:12:31.940397   652 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:31.942008   591 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.940464   657 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:32.021019 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.987346   558 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.020694 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:31.991063   732 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.025532 30185 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:31.994544   727 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.028894   536 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.022114   655 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.033782   655 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.034199   655 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.015455   697 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.035100   697 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.035517   697 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.036192 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.940573   644 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:31.941744   669 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.040172   416 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:32.031742   654 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:31.986598   713 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.032631   732 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.042690 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.044888 30180 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.045678 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.046274 30185 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:32.046164 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:31.938640   663 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.024046   696 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.050500   619 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.051739   619 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:32.052095   696 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:32.059540   683 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.059689   607 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:31.940702   731 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.060111   663 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.061340 30740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 766) took 1348 ms. Trace:
I20260709 13:12:32.062532 30740 rpcz_store.cc:276] 0709 13:12:30.712518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.748184 (+ 35666us) service_pool.cc:224] Handling call
0709 13:12:31.405978 (+657794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.410359 (+  4381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.061112 (+650753us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400527450. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:32.061251 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512062336}
I20260709 13:12:32.044343   416 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:32.072569   655 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:31.947916   704 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.069294   614 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.082628   644 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.083874   416 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.086107   713 consensus_queue.cc:1059] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:12:32.094738   716 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.097448   683 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.114262   732 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.114534   683 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.116741   683 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.101245   731 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.093802   679 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.103565 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:32.048695   669 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.108018 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.109236 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.112030 30180 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:32.112805 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:32.113926   713 raft_consensus.cc:3055] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:32.113600   716 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.098702   697 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.112727   614 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.117735 30108 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.110292   696 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.127341 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:32.117436   679 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.203655   716 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:32.203960   738 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:12:32.228552 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 101325us
I20260709 13:12:32.112274   608 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.238003 30034 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:12:32.239782 30034 pending_rounds.cc:85] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 5
I20260709 13:12:32.231632   607 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.241703   607 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.243973   607 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.245740   669 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.246380   622 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.246325   669 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.247040   726 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.247478   726 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.120750   713 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:32.228788   416 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.240171 30034 pending_rounds.cc:107] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:12:32.274855 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.288015   669 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.292295 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.293310 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.292920 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:32.350481 30180 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.355456 30108 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:32.247954   726 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.356513 30034 raft_consensus.cc:2889] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:32.260032   731 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.228770   647 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:12:32.236663   692 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:32.385296 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.237771   697 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.259757   727 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:12:32.348812   394 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.367739   614 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.359278 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.394470   394 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.368856   655 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.288789   644 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.374183 30077 leader_election.cc:400] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:12:32.283612   716 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:12:32.375007 30180 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:32.375643   679 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.376747   713 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.412187   713 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.382330   647 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:32.382726   731 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.385097 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.390838 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:32.393218   591 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.403179 30030 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:32.396853   394 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.347105 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:32.264597   608 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:32.469946 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.526039 30031 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.484470 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:32.490535 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.465801 29930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 146) took 3336 ms. Trace:
I20260709 13:12:32.527552 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:32.526125 30029 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:32.528158 30185 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:32.518833 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 310835us
I20260709 13:12:32.521806 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:32.237254   696 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.534708 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:32.536569 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.538148 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:32.385766   692 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.533658 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:32.543671 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:32.552211 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:32.553102 30110 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.554840 30113 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:32.557683 30036 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.443027   654 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.556267 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:32.597450 30113 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:32.442677   647 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:32.531613   669 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:12:32.563042   608 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.602711 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:32.476862   724 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.469121   705 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.534458   536 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:32.565840   573 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:32.605718 30739 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:32.567384 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:32.570276   736 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:32.571090   591 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.572757 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.442723   679 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.574747 30036 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:32.574679 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.575320 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.527853 29930 rpcz_store.cc:276] 0709 13:12:29.090205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.114933 (+ 24728us) service_pool.cc:224] Handling call
0709 13:12:32.416363 (+3301430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:30.239454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:30.292478 (+ 53024us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:30.299019 (+  6541us) write_op.cc:435] Acquired schema lock
0709 13:12:30.301868 (+  2849us) tablet.cc:662] Decoding operations
0709 13:12:30.480472 (+178604us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:30.480586 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:30.480627 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:30.505482 (+ 24855us) tablet.cc:701] Row locks acquired
0709 13:12:30.508431 (+  2949us) write_op.cc:260] PREPARE: finished
0709 13:12:30.533713 (+ 25282us) write_op.cc:270] Start()
0709 13:12:30.568420 (+ 34707us) write_op.cc:276] Timestamp: P: 1783602750530955 usec, L: 0
0709 13:12:30.568449 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:12:30.569140 (+   691us) log.cc:844] Serialized 2132 byte log entry
0709 13:12:31.690173 (+1121033us) op_driver.cc:464] REPLICATION: finished
0709 13:12:32.024403 (+334230us) write_op.cc:301] APPLY: starting
0709 13:12:32.041808 (+ 17405us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:32.061833 (+ 20025us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:32.070857 (+  9024us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:32.071827 (+   970us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:32.072055 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:12:32.072104 (+    49us) write_op.cc:312] APPLY: finished
0709 13:12:32.072393 (+   289us) log.cc:844] Serialized 47 byte log entry
0709 13:12:32.072576 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:32.072680 (+   104us) write_op.cc:454] Released schema lock
0709 13:12:32.072717 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:32.112232 (+ 39515us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:32.115695 (+  3463us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24666,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":316239,"apply.run_cpu_time_us":3373,"apply.run_wall_time_us":77100,"num_ops":5,"prepare.queue_time_us":167026,"prepare.run_cpu_time_us":8676,"prepare.run_wall_time_us":365630,"raft.queue_time_us":204620,"raft.run_cpu_time_us":36416,"raft.run_wall_time_us":292816,"replication_time_us":1077127,"thread_start_us":522020,"threads_started":4,"wal-append.queue_time_us":111079}]]}
I20260709 13:12:32.576326 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.610631 30032 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:32.576999 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.610708 30004 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:32.577659 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.578392 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.574766   731 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.582654 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:32.582881 30732 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.583658 30031 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:32.584264 30740 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:32.584187 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:32.584941 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:32.585146   652 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.586015 30185 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:32.664307 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.585939 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:32.665491 30738 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:32.665912 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.667335 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:32.668372 30104 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:32.482259   657 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.414271   607 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:32.466467   727 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:32.527094   391 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:32.601257 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:32.558957   692 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.413823   644 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.606549 30107 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:32.608023 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:32.613574 30033 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:32.600265   654 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:32.643802 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 157291us
I20260709 13:12:32.669852 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:32.664350 30733 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:32.604100   669 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.662879 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:32.674115 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.676227 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:32.600940   394 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:32.671255   573 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:32.679749 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:32.683439 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 75474.3us
I20260709 13:12:32.644618   730 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:32.642227   736 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:32.664206   679 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.606076   724 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.685664 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:32.877095   584 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:32.684067   647 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.911619   584 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.912278   647 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.912484 30183 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:32.912935 30741 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:32.913941   584 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.674962   727 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:32.915138   654 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:32.915818   654 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:32.916322   654 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.678375   657 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.918489   736 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.918609   573 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:32.886456 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 322072us
I20260709 13:12:32.922245 30104 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.704455 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:32.789248 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.924000 30107 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.923381 30738 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.689839 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:32.715891 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.910343 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:32.679195   536 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.917585   669 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:32.916209   727 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.060503 30738 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:32.671397   731 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:32.933216 30110 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:33.082367 30030 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:33.025207 30109 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:32.908910 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.008311 30104 raft_consensus.cc:2410] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:12:32.989715 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 68430.9us
I20260709 13:12:32.692364 30004 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:32.927510 30737 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.082967 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.084625 30107 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:33.087528 30110 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:33.085562 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.088964 30104 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:33.088073 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.093437 30110 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:32.883827   705 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:32.694839   682 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:32.694041   607 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:33.086390   746 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:12:33.058130 30732 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:32.677728   652 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.034205   654 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:32.881865   608 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.037456   740 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:33.081936   731 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:33.034374   719 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.114500   394 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:12:33.117790   752 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:12:33.102559   705 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.119642   607 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.082558   748 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.115665   696 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.116387   682 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:33.132929   657 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.104707   679 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:32.681856   391 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.116043   727 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.086597   536 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:32.751045 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.126927   644 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.125815 30737 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:33.138854   654 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.181018   654 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.184609   654 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:33.202219 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 131200us
I20260709 13:12:33.133548   740 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.133157   608 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:33.211467 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 302616us
I20260709 13:12:33.212642 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.145123   719 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.202983   644 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.202028   724 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.237139 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.210300   736 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.150954   748 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:33.243304 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 551035us
I20260709 13:12:33.204420   730 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:33.258070 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.269806 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2207) took 1755 ms. Trace:
I20260709 13:12:33.270318 30179 rpcz_store.cc:276] 0709 13:12:31.488215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.488423 (+   208us) service_pool.cc:224] Handling call
0709 13:12:31.488702 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.524372 (+ 35670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.524400 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.524441 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:31.524487 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.242959 (+1718472us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54000cbcd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:33.243007 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.243140 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81558912}
I20260709 13:12:33.222462   749 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:33.268508 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:33.284672 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.234210   709 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:12:33.269300   726 consensus_meta.cc:287] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.878s	user 0.006s	sys 0.005s
I20260709 13:12:33.264003   724 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.190122   731 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:33.297654 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 94716.6us
I20260709 13:12:33.280357   750 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:33.298784 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.303857   748 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.304893   754 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:33.305598   669 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.311652   391 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:33.313820   751 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:12:33.297978   753 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.318426   608 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.319880   608 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:33.325706 30035 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:33.306767   679 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.325712   647 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:33.327070   647 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:33.327946   647 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.229429   644 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.309417 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.371107 30110 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:12:33.372735 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 138851us
I20260709 13:12:33.230532   682 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:33.379154 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 69881.4us
I20260709 13:12:33.380007 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:33.378422 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 60551us
I20260709 13:12:33.333876   652 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.286481   749 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.291697   726 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.377183   731 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.354928   763 raft_consensus.cc:2764] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:33.400619 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:33.400352 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 154761us
W20260709 13:12:33.400480 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 92576.5us
I20260709 13:12:33.402750 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.403899 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.385464   753 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:33.414491 30034 raft_consensus.cc:2368] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:33.417591   391 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.418394   391 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.419456 30004 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.422173   391 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.426326   748 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.391196   652 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.404892   394 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:33.395130   705 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.436596 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.442312 30183 raft_consensus.cc:2393] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:33.429363 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.400848   756 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:33.442838   394 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.465548   398 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.415258   683 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:12:33.439214   602 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.447898   657 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.472571 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.466370 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.457242   753 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:33.476132 30110 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:33.455003   705 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.456744   536 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.465237   750 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:33.464250   760 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:33.470377   394 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.490336   719 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.445060   652 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:33.493774   692 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.800s	user 0.001s	sys 0.010s
I20260709 13:12:33.494215   692 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.495172   652 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.496583 30737 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:33.497157   644 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.483446   750 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.502305   692 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.503393   750 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.507289 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.508435 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.509038 30108 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:33.511546 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.481539   772 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.512844   705 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.513172   772 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.515575   772 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.401088   730 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.515931   705 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.467396   607 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:33.517815   607 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.519870   607 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:33.469777   761 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.520555   761 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.522470   726 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.522921   761 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.473390   740 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.523277   754 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:33.523790   754 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:33.525630 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.526221 30186 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:33.526844 30186 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:33.446383   748 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.487656   749 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.512064   760 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.481571 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.543320   692 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.553112 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.554242 30185 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.546599 30110 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:33.556429 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.557657 30739 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.559227 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.560463 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.560768 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.561247 30182 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:33.562536 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:33.563367 30181 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:33.564620 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.566109 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.566651 30108 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:33.567325 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.568038 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.568259 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.568817 30187 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.524562   754 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.571393   754 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.577756 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.578510 30108 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:33.581902 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.479813   657 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.578497 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1504) took 1031 ms. Trace:
I20260709 13:12:33.583482 30112 rpcz_store.cc:276] 0709 13:12:32.547270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.549880 (+  2610us) service_pool.cc:224] Handling call
0709 13:12:33.254001 (+704121us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:33.254226 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.259334 (+  5108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.259381 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.260006 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:12:33.388389 (+128383us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:33.409646 (+ 21257us) log.cc:844] Serialized 14 byte log entry
0709 13:12:33.409947 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.410051 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.563334 (+153283us) raft_consensus.cc:1685] finished
0709 13:12:33.578267 (+ 14933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.578434 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50117,"prepare.queue_time_us":17481,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":26780,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12228,"spinlock_wait_cycles":53931648,"thread_start_us":94967,"threads_started":1,"wal-append.queue_time_us":184248}
I20260709 13:12:33.591254   760 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.482574   753 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.592803   657 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.594038   753 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:33.595057 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:33.596374 30112 raft_consensus.cc:2376] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6. Re-sending same reply.
I20260709 13:12:33.555593 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.604681 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.605381 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.605801 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:33.605564 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 186368us
I20260709 13:12:33.611728 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.612627 30110 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:33.583078   644 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:33.616971 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.617659 30112 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:33.617439 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.618620 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.618757 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.620277 30183 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.620784 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:33.622272 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.608780   753 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.615784   644 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.628355 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.628942   644 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:33.630682 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.634824 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.638415 30153 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:33.640477 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.641263 30186 raft_consensus.cc:2368] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9.
I20260709 13:12:33.641417   748 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.642006   748 raft_consensus.cc:2764] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:33.622849   607 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:33.643464   607 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:33.644397   607 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.645524 30032 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:12:33.646281 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.628737 30079 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:33.648451   749 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:33.648870   749 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.648983 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:33.649150 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.649907 30030 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:33.622807   778 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.650655 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.651038 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.651645 30030 raft_consensus.cc:1813] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Handling vote request from an unknown peer ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.652014 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:33.652221 30030 raft_consensus.cc:2410] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:33.652127 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:33.654309 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:33.654846 30031 raft_consensus.cc:2376] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6. Re-sending same reply.
I20260709 13:12:33.655083 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.655637 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.655858 30037 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
I20260709 13:12:33.656154 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.656294 30031 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:33.656759 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.657366 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.657379 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.653712 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.649830 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.661509   756 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:33.649843 30038 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:33.666026 30739 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:33.650717   778 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.658411   719 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:33.658859 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:33.653177 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.659457   705 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:33.658277   720 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:33.650012   753 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.661320 30036 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:33.653100 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.626456 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.722050 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.727766   731 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.721776 30182 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:33.741878   731 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.716454   777 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:33.743700   777 consensus_queue.cc:1243] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:33.744741   777 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:33.719065 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.746045   682 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.732287 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1507) took 1184 ms. Trace:
I20260709 13:12:33.746646   682 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.746950 30106 rpcz_store.cc:276] 0709 13:12:32.548278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.550684 (+  2406us) service_pool.cc:224] Handling call
0709 13:12:33.731504 (+1180820us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:33.731709 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.731897 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.731926 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:33.731969 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:33.732006 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.732056 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.732187 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7137536}
I20260709 13:12:33.749478 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.751336 30030 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:33.751888 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.644869   644 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.745283   777 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:33.749522   682 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.699115   778 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.780092 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 667) took 1219 ms. Trace:
I20260709 13:12:33.780269   731 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.753974 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54306 (request call id 1898) took 1180 ms. Trace:
I20260709 13:12:33.780332   644 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.754390 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.781836 30110 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:33.780521 30113 rpcz_store.cc:276] 0709 13:12:32.560900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.605452 (+ 44552us) service_pool.cc:224] Handling call
0709 13:12:32.667908 (+ 62456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.668117 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.668144 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:32.674353 (+  6209us) log.cc:844] Serialized 26 byte log entry
0709 13:12:33.045040 (+370687us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:33.045095 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.045198 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.779205 (+734007us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b24004334a8. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2e6c9c4 00007fcbe2e6aacb 00007fcbe3025dc9 00007fcbe3025a55 00007fcbe3024fb0 00007fcbe5c9b488 00007fcbe5c9bbe8 00007fcbe5c73398 00007fcbe5c6e76a 00007fcbe5c6dbb6
0709 13:12:33.779804 (+   599us) raft_consensus.cc:1685] finished
0709 13:12:33.779825 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.780030 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163573120,"thread_start_us":339771,"threads_started":1,"wal-append.queue_time_us":406981}
I20260709 13:12:33.782761 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.782966 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.783155 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.783576 30110 raft_consensus.cc:2410] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:33.783679 30113 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:33.784400 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.784473 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.784869 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:33.785036 30110 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:33.721647 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.788523 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:33.789129 30185 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:12:33.624598 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.755964 30112 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:33.790588 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.789438 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:33.790580 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.791502 30110 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.791777 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.792343 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.792970 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.794178 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.794281 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.795147 30036 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:33.796419 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.756481 30029 raft_consensus.cc:2368] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:33.757144 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.758123 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33114 (request call id 75) took 2668 ms. Trace:
I20260709 13:12:33.758934 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.798017 30184 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:33.798390 30186 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:33.798473 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.762596 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.764986 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.755105   753 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:33.723304 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1518) took 1119 ms. Trace:
I20260709 13:12:33.737159 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2242) took 1176 ms. Trace:
W20260709 13:12:33.768950 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 110158us
W20260709 13:12:33.727847 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.769053 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.771706 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.602782   394 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.658118 30031 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:33.786689   391 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:33.787688 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1509) took 1238 ms. Trace:
I20260709 13:12:33.789196 30739 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:33.789309 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.755635 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:33.759585 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.785213 30108 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:33.766373 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:33.769449   705 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:33.797765 30178 rpcz_store.cc:276] 0709 13:12:31.089653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.725911 (+636258us) service_pool.cc:224] Handling call
0709 13:12:33.757812 (+2031901us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400267fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d9735 00007fcbe60d19fa 00007fcbeb0994c9 00007fcbe4615c54 00007fcbe4615be2 00007fcbe4615b11 00007fcbe4615a8c 00007fcbe4614d42 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:33.758030 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625398016}
W20260709 13:12:33.882074 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.800995 30113 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:33.869480 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59326.6us
I20260709 13:12:33.867257 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.649308   749 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.920389 30180 rpcz_store.cc:276] 0709 13:12:32.560292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.560563 (+   271us) service_pool.cc:224] Handling call
0709 13:12:32.560951 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.918530 (+357579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.918562 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.918606 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:32.918641 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.736807 (+818166us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001eb4d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:33.736871 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.737073 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821863680}
W20260709 13:12:33.866209 30705 connection.cc:256] RPC call timeout handler was delayed by -1.3902505080000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:12:33.915056 30105 raft_consensus.cc:2410] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:33.934481 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.933630 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1505) took 1386 ms. Trace:
I20260709 13:12:33.937888 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.939479 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.917788 30109 rpcz_store.cc:276] 0709 13:12:32.606710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.663875 (+ 57165us) service_pool.cc:224] Handling call
0709 13:12:33.723027 (+1059152us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400131fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:33.723190 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246957312}
I20260709 13:12:33.942566 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.781195 30034 rpcz_store.cc:276] 0709 13:12:32.573872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.574428 (+   556us) service_pool.cc:224] Handling call
0709 13:12:33.753729 (+1179301us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540010f9d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:33.753875 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850637696}
I20260709 13:12:33.916983 30106 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:33.919667 30187 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.920122 30183 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:33.865887 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.920630 30112 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:33.947369 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.921197 30036 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:33.949097 30036 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:33.799526 30104 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:33.927222 30110 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:33.916400 30111 rpcz_store.cc:276] 0709 13:12:32.548971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.551145 (+  2174us) service_pool.cc:224] Handling call
0709 13:12:33.781202 (+1230057us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:33.781375 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.787363 (+  5988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.787390 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:33.787434 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:33.787464 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.787520 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.787634 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6266240}
I20260709 13:12:33.935551 30105 rpcz_store.cc:276] 0709 13:12:32.547533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.550259 (+  2726us) service_pool.cc:224] Handling call
0709 13:12:33.755477 (+1205218us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:33.933565 (+178088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7927552}
I20260709 13:12:33.788187   681 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.951527 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:33.969457 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.971004 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.954396 30111 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:33.954535 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:33.956000 30032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54306 (request call id 1904) took 1380 ms (client timeout 1527 ms). Trace:
I20260709 13:12:33.954445 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.957350 30110 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.974572 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:33.960382 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.961000 30112 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:33.961705 30108 raft_consensus.cc:1217] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:12:33.978579 30108 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:33.962474 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.962361 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.699755   719 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:33.919165   652 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.979811 30035 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:33.980751 30106 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:33.980458 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:33.974304 30032 rpcz_store.cc:269] 0709 13:12:32.575573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.645816 (+ 70243us) service_pool.cc:224] Handling call
0709 13:12:33.946399 (+1300583us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400138154. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:33.955950 (+  9551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659112320}
I20260709 13:12:33.987541 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:33.988073 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:33.988256 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.988849 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:33.989364 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.984113 30183 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:33.975082 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.991532 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.992028 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.992457 30036 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:33.992947 30038 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:33.992730   652 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:33.997915 30109 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:33.998569 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.999608 30038 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:34.000422 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.000722   394 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.001008 30038 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.981820   681 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:33.979893   744 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.003716 30032 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:34.003814   744 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.005736 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.006862 30180 raft_consensus.cc:1275] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:34.007085 30734 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:34.007513 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.002425 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.009083 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:33.997756 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.010947 30736 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.002182 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.005980 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:33.927675   391 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:34.013331 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.016279 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.021998 30036 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:33.931967   705 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:33.721586   727 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.010758 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:33.964237 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:34.037815 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:34.038102 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 79370us
I20260709 13:12:34.028057 30107 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:34.028120 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:34.028481 30739 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:34.028985 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.040498 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:34.040629 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:34.040838 30106 raft_consensus.cc:2410] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:34.006944   744 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:34.042649 30178 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:33.996824   652 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.045548 30737 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:34.063036 30138 heartbeater.cc:646] Failed to heartbeat to 127.28.62.190:37953 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.62.190:37953 timed out after 15.000s (SENT)
I20260709 13:12:34.070003 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:34.071935 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61336.2us
I20260709 13:12:34.072746 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.073911 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.036366   682 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.074915   763 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:34.075726   763 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:33.992385   764 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.078090 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.044195 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.083196 30109 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:34.083015 30001 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.087181 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.089903 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.096329 30183 raft_consensus.cc:2368] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9.
I20260709 13:12:34.099265 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.026544   391 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.102313 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.114141 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.116637 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:34.120426 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.122073 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.126382 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.130043 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:34.132203 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49276.6us
I20260709 13:12:34.132943 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.133170 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.134166 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.136364 30001 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.094158   761 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:34.103173   772 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.094420   758 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:34.150044 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.163367 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.204882 30739 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:34.148999   703 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.158092   608 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.158183   713 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.210575 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.157231 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:34.101236   644 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:34.127967   756 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:34.214133   756 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:34.214658   765 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.214787   756 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.159621 30736 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
W20260709 13:12:34.209185 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45930.7us
I20260709 13:12:34.203729   730 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.077055   763 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.216457 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.145318   725 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.209326 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.149601   732 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.228241 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:34.204504   758 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:34.231739 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.087460   727 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.233589 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:34.208349   683 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.151219   761 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:34.236892 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.240299 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.241904 30151 leader_election.cc:400] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:34.243357 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.243587 30151 leader_election.cc:403] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:34.244200 30034 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:34.238387   758 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:34.251109   683 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.256544 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.260587 30113 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:34.267962 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.232652   753 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.230939   765 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.281083 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:34.238230   608 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.239552   562 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:34.239527   454 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.301506   454 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.302366   454 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.302552   758 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.288087 30033 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:34.305722   758 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.290366 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.245386   730 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.307092   730 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.266582   647 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:34.295711   785 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:12:34.284438   732 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.310577   732 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.312964   732 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.299772   726 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:34.313968   726 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:34.314533 30031 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:34.314859   726 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.283275   753 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:34.316409   753 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.216694   719 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.317432   683 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.243307   654 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:12:34.320406   647 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:34.321275   647 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:34.321378   654 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.321682   647 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:34.321892   725 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:34.322608   647 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.323820   647 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.324621   725 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:34.272984   761 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.278656   721 raft_consensus.cc:2764] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:12:34.333809 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46008.2us
I20260709 13:12:34.284260   630 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:34.293923   682 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:34.377311 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.337692   630 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:34.339388   744 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:12:34.394490   727 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.325877   765 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.395442   753 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.400086   749 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.375818   682 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:34.413486   785 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:34.411360   630 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.457643 30111 raft_consensus.cc:2393] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:34.451978 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 294854us
I20260709 13:12:34.459486 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:34.463004 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:34.472841 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.481529 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 235050us
I20260709 13:12:34.483371 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.435985   682 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.484467 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:34.485206 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:34.485159 30031 raft_consensus.cc:606] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.486735 30031 raft_consensus.cc:614] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:34.486657 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.451071   654 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:34.492116 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.493024   794 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.494266 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.495312   794 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.497053 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:34.501206 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:34.501963 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 262602us
I20260709 13:12:34.482734   679 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:34.503024 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:34.503628 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 157167us
I20260709 13:12:34.504504 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:34.452338   391 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.490370   732 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:34.508991 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.490589   731 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:34.489701   657 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.538829 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.539824 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:34.542794 30179 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:34.546197 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45229us
I20260709 13:12:34.500874   719 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.549849 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:34.500164   562 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:34.554666   749 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.505012   679 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.535161   703 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.564589   756 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.576278 30181 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:34.537062   794 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.591403   391 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.545382   731 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:34.566674   454 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.541762   732 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:34.581820   679 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.521767   763 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:34.600970 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 98317.2us
I20260709 13:12:34.608992   398 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.632045 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.636693   756 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.616358   765 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.615830   562 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.606642   657 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:34.621273   681 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:34.622105   791 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:34.584179   719 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.627629   753 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.609774   731 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.613199   732 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.647459 30705 leader_election.cc:400] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9.
W20260709 13:12:34.670027 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 131293us
W20260709 13:12:34.649760 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 146801us
I20260709 13:12:34.671666 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.671929 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.581527   795 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:12:34.646438 30735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.056s	sys 0.076s
I20260709 13:12:34.647075   657 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.700237   657 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.658015   454 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:34.658562 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 558) took 1017 ms. Trace:
I20260709 13:12:34.705156 30181 rpcz_store.cc:276] 0709 13:12:33.641233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.671049 (+ 29816us) service_pool.cc:224] Handling call
0709 13:12:33.932015 (+260966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.596205 (+664190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.658307 (+ 62102us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002977d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:34.658496 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481057152}
I20260709 13:12:34.667943 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.672688 30179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:12:34.673135 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.706624 30179 raft_consensus.cc:606] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.609723   703 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.708001   398 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.708122 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.675935 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.709357   398 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.678570 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.715135 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.687542 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.693818   753 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.697256 30113 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:34.698501 30106 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:34.652580   719 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.710299 30153 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.721777 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.711310 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.724007 30705 leader_election.cc:400] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9.
I20260709 13:12:34.724362 30705 leader_election.cc:403] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:34.710637 30034 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:12:34.676420   705 consensus_meta.cc:287] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.007s
W20260709 13:12:34.731534 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 184382us
I20260709 13:12:34.725154 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.727144 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:34.684878 30735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.056s	sys 0.076s
I20260709 13:12:34.732271 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:34.735378 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.724555   398 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.734272   652 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.741228   809 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9.
I20260709 13:12:34.735965   786 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.743129   777 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.744295   777 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.737944   705 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.747234   705 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.726835   644 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.748221   749 raft_consensus.cc:2764] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:34.711498   584 consensus_queue.cc:1048] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:34.750581 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 565) took 1097 ms. Trace:
I20260709 13:12:34.750885   803 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.751266   807 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.751783   803 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:34.739384 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.754812   761 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.757459 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.710865   744 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.729795   713 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.761693   808 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.763159   808 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.763557   808 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.766471 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.766587 30733 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:34.751029 30735 rpcz_store.cc:276] 0709 13:12:33.652699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.653491 (+   792us) service_pool.cc:224] Handling call
0709 13:12:33.653830 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:33.656222 (+  2392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:33.656263 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:33.656787 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:12:34.750159 (+1093372us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:34.750226 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.750317 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:34.750362 (+    45us) raft_consensus.cc:1685] finished
0709 13:12:34.750372 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.750520 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1270,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2982,"thread_start_us":1077407,"threads_started":1,"wal-append.queue_time_us":638480}
I20260709 13:12:34.767796 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.770571   630 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.771371   761 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:34.771838 30037 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:34.777541   749 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:34.778219   749 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.791050 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.791536 30037 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:34.766594 30736 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:34.798343 30030 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:34.761770 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88e3e05564894b51b12ceb093978f695"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:34.800401 30031 raft_consensus.cc:606] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.709940   703 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.760236   584 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.804955 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:34.805585 30031 raft_consensus.cc:606] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.807053 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.808948 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:34.809310 30732 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:34.809561 30741 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:34.810654   679 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.811929   682 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.813630 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54306 (request call id 1907) took 1166 ms. Trace:
I20260709 13:12:34.828199 30035 rpcz_store.cc:276] 0709 13:12:33.647537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.649584 (+  2047us) service_pool.cc:224] Handling call
0709 13:12:34.813277 (+1163693us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400288cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:34.813551 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693489536}
W20260709 13:12:34.829945 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 90636.4us
I20260709 13:12:34.830757 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.816320   732 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.817924   652 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.820664   749 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.809590 30736 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:34.823495 30179 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:34.840960 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.825193 30181 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:34.826355 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66279.9us
I20260709 13:12:34.848205 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:34.834419   644 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.834877 30032 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:34.849031   713 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:34.849612   807 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:34.850006   807 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.850414   807 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.834993   630 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.764289   657 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.848805 30031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:34.851300 30031 raft_consensus.cc:606] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.851472   630 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:34.852460   657 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:34.853941 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.854244 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.854563 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.854849 30109 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:34.837591 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.838838 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.855782 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.856818 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:34.857625 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.857698 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.858814 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:34.859308 30112 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:34.860841 30031 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:34.861670 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.863638 30035 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:34.827286   719 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.864907 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.865219 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:34.839848   679 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:34.830713 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 73645.3us
I20260709 13:12:34.883457 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:34.837137   808 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:34.842164 30038 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:34.824995 30185 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:34.850160   713 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:34.854709 30104 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:34.855336 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:34.890236 30110 raft_consensus.cc:1813] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Handling vote request from an unknown peer ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:34.890949 30110 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:34.867151 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:34.834594   584 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:34.868217 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.837095   682 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.895607 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:34.908149 30106 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:34.909183   808 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:34.910032   584 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:34.910463   584 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:34.911355   584 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:34.912532 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.914546   719 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:34.914979 30029 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:34.915326 30029 pending_rounds.cc:85] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 7
I20260709 13:12:34.915539 30029 pending_rounds.cc:107] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:34.915763 30029 raft_consensus.cc:2889] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:34.827685   731 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:34.918480 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50333.6us
I20260709 13:12:34.919595 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.928578 30038 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.929141 30705 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:34.930248   696 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:34.931619   696 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:34.912618   584 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.887130   754 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.927155   732 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.940665 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.960246 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.941314   804 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:34.943895 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 48395.2us
I20260709 13:12:34.944643   774 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:34.945655 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.946153   682 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.947070 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:34.947953   731 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:34.948508 30111 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:34.948113   787 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:34.889398   681 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:12:34.948962   748 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:34.933099   803 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:34.958187 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:34.958092   801 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:34.889003   725 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:34.957340 30038 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:12:34.933058   654 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:35.070623 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.082033 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:35.084203 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 137161us
I20260709 13:12:35.108619 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.114880 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.117322 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:35.119372 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.119472 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.120275 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.120502 30038 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:34.937613   753 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.123183 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.123898 30035 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:12:35.123931 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.125314 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.126072 30109 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:34.939553   696 consensus_queue.cc:1059] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 13:12:35.122035   654 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:35.127398 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.127669 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.128328 30107 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:35.128360 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.129225 30106 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:35.133292 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.133545 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.134162 30032 raft_consensus.cc:2393] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:35.139951 30037 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:35.140343 30037 pending_rounds.cc:85] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 6
I20260709 13:12:35.140638 30037 pending_rounds.cc:107] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:12:35.140415 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 58542.8us
I20260709 13:12:35.140925 30037 raft_consensus.cc:2889] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.138909 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:35.141850 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.143036 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.144073 30038 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:35.151520 30105 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:35.150645 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:34.960448   808 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 13:12:35.161368   657 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:35.162746   808 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:35.163130   808 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:35.164099   808 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.081672   562 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:34.990456   691 consensus_queue.cc:1059] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:12:35.122813   720 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:34.995110   530 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:12:35.095120   774 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:35.166996 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:34.949959   807 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.109258   731 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.145251   644 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.990186   652 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 13:12:35.135037   654 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:35.135274   749 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.140753   630 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:35.194175 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.194994 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:34.960723   754 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.188197   774 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:35.195739 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.084662   748 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.207809 30105 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:35.166406   398 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:35.168128   756 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:35.179906 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.167719   811 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.126719   682 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.249526   679 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.247161   808 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:35.293097 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:35.254669 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 300018us
I20260709 13:12:35.255565 30111 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:35.208935   795 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:35.167371   703 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:12:35.171618   796 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:35.255384   787 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:35.293931 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 99831.2us
I20260709 13:12:35.211464   731 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.299327 30032 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:35.282076   630 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:35.283219   756 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.280346   618 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.256839   644 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:35.331116   815 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:35.331650   607 raft_consensus.cc:3055] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:35.332208   607 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:35.333029 30104 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:35.333702   822 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:35.334205   822 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:35.335314   822 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.336915   822 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:35.263525   713 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.300817   725 raft_consensus.cc:993] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:35.261951   749 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.299764   811 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:35.331773   644 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.326208   727 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.309973 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.295311 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.278048   398 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:35.291236   679 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.312913   787 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.309087   795 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:35.355301 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45413.7us
I20260709 13:12:35.326642   756 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:35.370407 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 75190.2us
I20260709 13:12:35.383162 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.398149 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.400707   748 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:35.402127   754 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.405234   807 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.405599   630 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.407195   731 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:35.374190   727 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.374922   644 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.409927   644 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.410866   749 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:35.412185   644 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.416090   682 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.418819   679 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.419682 30110 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:12:35.420073 30110 pending_rounds.cc:85] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:12:35.420286 30110 pending_rounds.cc:107] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:12:35.420506 30110 raft_consensus.cc:2889] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.376025   391 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:35.371292   765 raft_consensus.cc:1081] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:35.422806   727 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:35.370540   398 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:35.374179   719 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.424760   795 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.355926   713 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.427482   756 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.379527   787 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:35.431504   654 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.429132   713 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.433586   811 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.434059   654 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:35.442363   756 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:35.451938 30736 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:35.454496 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64578.8us
I20260709 13:12:35.459586 30185 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:35.459738 30179 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:35.468132 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 483304us
W20260709 13:12:35.468396 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 70400.1us
I20260709 13:12:35.469362 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.475855 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:35.486382 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 337746us
I20260709 13:12:35.504796 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:35.344619   607 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.512183 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.528342 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.539994 30077 leader_election.cc:400] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:12:35.540454 30077 leader_election.cc:403] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:35.542958 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.505837   756 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.550371 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.506217   796 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:35.571134   756 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.571470 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:35.584794 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.573879   727 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:35.534149   810 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.601589 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.582783 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.602416 30180 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 4: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:35.603341 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.584120 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.585700 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.605607 30187 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:35.586373 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.538643   644 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.549152   731 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.607702 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.608659 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.562623   807 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.513830   713 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:12:35.514078   584 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:35.614136 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.551120   801 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:12:35.545909   749 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.534047   679 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:35.615305 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 43960.6us
I20260709 13:12:35.615269 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.631215 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.631901 30184 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:35.632911 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:35.586014   748 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.575488   732 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.639552 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.626092 30736 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:35.598855   727 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:35.610827   810 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:35.633864 30184 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:35.641695 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:35.648115 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.648782 30001 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:35.618611   720 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:35.653564 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:35.656524 30733 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:35.658385 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.659045 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.659278 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.655478 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.648190 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:35.659775 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.659935 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:35.659870 30035 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:35.662417 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:35.620038   829 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.659180 30032 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
W20260709 13:12:35.697424 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.761600 30187 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:35.762807 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:35.773391 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 111496us
I20260709 13:12:35.774571   836 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:35.775339   836 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.776734 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.627562   749 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:35.778115 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.765257 30187 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:35.785712 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 237859us
I20260709 13:12:35.793026 30004 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:35.617645   644 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:35.645867   691 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:35.650765   810 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:35.791533 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 173010us
I20260709 13:12:35.649588   777 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.809661 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.804868 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.666992   682 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.807750 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.814046 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:35.814330 30110 raft_consensus.cc:2376] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7. Re-sending same reply.
I20260709 13:12:35.663920   679 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.666549   761 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.813476 30106 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:35.819824 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:35.815197 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.816037 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:35.823513 30113 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:35.828779 30107 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:35.830569 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:35.831231 30737 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:35.794514   749 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.652660   807 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 13:12:35.839530 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:35.930197 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 266198us
I20260709 13:12:35.956596 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:35.957062 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 161179us
W20260709 13:12:35.958212 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 144237us
I20260709 13:12:35.959132 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:35.794008   719 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:12:35.966728 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 136281us
W20260709 13:12:35.962935 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 122267us
I20260709 13:12:35.814067   682 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.980631 30077 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:35.817582   761 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.953764   703 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.966322   830 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:12:35.962019   713 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:35.953878   732 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:35.961629   777 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:36.020115 30004 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:35.971481   843 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:35.989528   682 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.814460   691 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.838832   398 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:35.989923   761 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.838212   679 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.031324   833 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:35.828413   727 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.029345   713 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:35.989028   765 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:36.047295   861 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:36.038944   843 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:36.063850   808 consensus_meta.cc:287] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.001s
I20260709 13:12:36.003670   829 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:12:36.093516 30178 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:36.099303 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 572) took 1138 ms. Trace:
W20260709 13:12:36.075553   774 consensus_meta.cc:287] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.000s
I20260709 13:12:36.099706 30029 rpcz_store.cc:276] 0709 13:12:34.951286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.951441 (+   155us) service_pool.cc:224] Handling call
0709 13:12:34.994530 (+ 43089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:34.995032 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.995073 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.079709 (+ 84636us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.337914 (+258205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:35.337958 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.338030 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.089299 (+751269us) raft_consensus.cc:1685] finished
0709 13:12:36.089319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.089501 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":586,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":12014,"thread_start_us":190097,"threads_started":1,"wal-append.queue_time_us":367687}
I20260709 13:12:36.065331   833 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.077207   713 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.114467   756 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:36.118685   813 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.818s	user 0.002s	sys 0.010s
I20260709 13:12:36.108779   725 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:36.089016   727 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:36.122012   846 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
I20260709 13:12:36.123521   644 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:36.124032   812 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.956s	user 0.000s	sys 0.002s
I20260709 13:12:36.128633 30106 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:36.028858   703 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.109560 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.111248   833 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.121177   725 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:36.039896   732 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.016285   720 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:36.233425 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.189666 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2126) took 1077 ms. Trace:
I20260709 13:12:36.153368 30184 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
W20260709 13:12:36.460119 30105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2120) took 1603 ms (client timeout 1702 ms). Trace:
W20260709 13:12:36.460912 30105 rpcz_store.cc:269] 0709 13:12:34.856509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.856609 (+   100us) service_pool.cc:224] Handling call
0709 13:12:36.459914 (+1603305us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540036b854. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:36.460047 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676504960}
W20260709 13:12:36.154099 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.459929 30111 rpcz_store.cc:276] 0709 13:12:35.112323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.112519 (+   196us) service_pool.cc:224] Handling call
0709 13:12:35.112932 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.294736 (+181804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.144755 (+850019us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400131fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:36.189567 (+ 44812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327402880}
I20260709 13:12:36.470234 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:36.476114   721 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:36.474689 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 494142us
I20260709 13:12:36.479620 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:36.474164 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.481033 30178 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:12:36.140954   787 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.006s
W20260709 13:12:36.348690   847 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.383s	user 0.001s	sys 0.001s
W20260709 13:12:36.244415   838 log.cc:927] Time spent T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
I20260709 13:12:36.214618   644 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:36.414700   860 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:12:36.314335   727 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:36.450304   864 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.269347   777 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:36.214883   829 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:36.246243   679 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.476616   721 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:36.564172 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.468263   454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.002s	sys 0.024s
I20260709 13:12:36.108681   774 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.381106   732 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.334410   841 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:36.303171   731 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.003s
I20260709 13:12:36.523458   691 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.521730   787 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.539526   727 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.248020   398 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.540225 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.317154   713 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.540699 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 571) took 1155 ms. Trace:
I20260709 13:12:36.302951   765 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:36.594992   765 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.488976 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:36.598841 30178 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:36.144882   725 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:36.481792   748 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.541651   644 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.221468   859 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.345s
I20260709 13:12:36.556541   861 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:36.573576   454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.003s	sys 0.024s
W20260709 13:12:36.585266 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 115149us
I20260709 13:12:36.615311   398 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:36.588641   761 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:12:36.589975 30181 rpcz_store.cc:276] 0709 13:12:35.385732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.385894 (+   162us) service_pool.cc:224] Handling call
0709 13:12:35.414742 (+ 28848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.471926 (+ 57184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.471972 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.472554 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.636528 (+163974us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:35.636567 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.636631 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.347945 (+711314us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:36.540337 (+192392us) raft_consensus.cc:1685] finished
0709 13:12:36.540371 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.540629 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83703,"raft.queue_time_us":58594,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":12545408,"thread_start_us":130210,"threads_started":1,"wal-append.queue_time_us":481360}
I20260709 13:12:36.573434   618 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:36.577164 30036 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:36.352213   843 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.605365 30180 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:36.607205 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.587599   731 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
W20260709 13:12:36.601600   682 consensus_meta.cc:287] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.005s
I20260709 13:12:36.587455   681 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:36.615082 30178 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:36.597263   765 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:36.583323 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 103769us
I20260709 13:12:36.616879 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:36.570930   829 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:36.682034 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 65287.6us
I20260709 13:12:36.619930 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:36.608562   861 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.623607   618 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.626096   853 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:36.626554   758 raft_consensus.cc:993] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:36.659147   850 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:36.663049   644 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:36.660699   810 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
I20260709 13:12:36.705871   810 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.708171   810 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:36.708925 30187 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:36.709733   758 raft_consensus.cc:1081] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:36.711586   853 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.619506   835 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:36.713042   835 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.715307   835 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.670760   787 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:36.698669   682 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.671208   679 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:36.716199   679 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.671816   777 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.717685 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2266) took 1070 ms. Trace:
I20260709 13:12:36.717906   682 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.718293 30184 rpcz_store.cc:276] 0709 13:12:35.646811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.647970 (+  1159us) service_pool.cc:224] Handling call
0709 13:12:36.717391 (+1069421us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002166d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:36.717566 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012424448}
I20260709 13:12:36.672267   713 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.672911   870 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.673568   727 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.627311   398 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:36.660710   749 consensus_meta.cc:287] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
W20260709 13:12:36.662806   822 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.312s	user 0.013s	sys 0.000s
I20260709 13:12:36.587767   841 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.682880 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:36.562873   864 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:36.687088   803 consensus_meta.cc:287] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.590s	user 0.014s	sys 0.000s
I20260709 13:12:36.607362   748 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.654448   761 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.690517 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 569) took 1865 ms. Trace:
I20260709 13:12:36.690584 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:36.693866   833 consensus_meta.cc:287] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:12:36.694142   829 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.694831 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.746326 30186 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:36.747179 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.748010 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:36.749214 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2253) took 1160 ms. Trace:
I20260709 13:12:36.696870   732 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.703943 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:36.699553 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:36.730424 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.733526   870 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:36.738320 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 55557.4us
I20260709 13:12:36.741693 30182 rpcz_store.cc:276] 0709 13:12:34.824939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.825050 (+   111us) service_pool.cc:224] Handling call
0709 13:12:34.825333 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:34.825756 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:35.206768 (+381012us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.546017 (+339249us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.547034 (+  1017us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.547174 (+   140us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:35.583971 (+ 36797us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.584216 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.584294 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.450072 (+865778us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b18003fbe60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:36.690293 (+240221us) raft_consensus.cc:1685] finished
0709 13:12:36.690319 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.690455 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11009,"prepare.queue_time_us":591199,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":5043,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":28163,"spinlock_wait_cycles":47892480,"thread_start_us":645970,"threads_started":2,"wal-append.queue_time_us":371329}
I20260709 13:12:36.762533 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:36.763973   883 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.765034   871 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.766134   871 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.766528   871 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.767737   864 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.738299   713 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:36.769050   765 consensus_queue.cc:1059] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:36.745257 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54766.2us
I20260709 13:12:36.703158   861 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:36.770262 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:36.770530 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:36.771255 30735 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.771433   864 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.772382 30030 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:36.773948 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:36.775357 30002 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:36.775906 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2256) took 1184 ms. Trace:
I20260709 13:12:36.776331 30178 rpcz_store.cc:276] 0709 13:12:35.591770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.761932 (+1170162us) service_pool.cc:224] Handling call
0709 13:12:36.762278 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.775525 (+ 13247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.775554 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:36.775593 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:36.775630 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.775682 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.775857 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14592}
I20260709 13:12:36.777554 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.785354   765 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:36.786018   765 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.786428   765 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.765648   858 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.768937   713 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.606950   721 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.790684 30184 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:36.792291 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2261) took 1199 ms. Trace:
I20260709 13:12:36.792603 30184 rpcz_store.cc:276] 0709 13:12:35.593180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.789945 (+1196765us) service_pool.cc:224] Handling call
0709 13:12:36.790504 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.792054 (+  1550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.792226 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.793576 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:36.795328 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2260) took 1202 ms. Trace:
I20260709 13:12:36.795740 30178 rpcz_store.cc:276] 0709 13:12:35.592889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.794566 (+1201677us) service_pool.cc:224] Handling call
0709 13:12:36.794849 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.795027 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.795050 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:36.795089 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:36.795124 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.795176 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.795264 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.787842 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:36.749537 30186 rpcz_store.cc:276] 0709 13:12:35.588646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.748567 (+1159921us) service_pool.cc:224] Handling call
0709 13:12:36.748873 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.749016 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.749031 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:36.749059 (+    28us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:36.749077 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.749109 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.749175 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.740597 30109 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:12:36.742511   630 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:36.799116 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:36.743726   803 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.802816 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.734889   749 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:36.805096   883 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:36.805369   878 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.809629   829 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.809898 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:36.811138 30112 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:36.828490 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:36.811343 30104 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:36.829834 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:36.811745 30110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88e3e05564894b51b12ceb093978f695"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:12:36.831393 30110 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:36.809192 30113 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:36.808446 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:36.808372 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:36.832422 30105 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:36.832509 30106 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:36.813784 30178 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:36.785458   682 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:36.749811   828 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.831894 30110 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.834844 30739 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:36.847448 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.849792 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:36.850930 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.848946 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.839243 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:36.843945 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.844658 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.840149 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:36.844955 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.842469 30108 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:36.846167 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:36.872653 30034 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:36.815223   721 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.881315 30178 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:36.882248 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2262) took 1288 ms. Trace:
I20260709 13:12:36.827574   829 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.882879 30178 rpcz_store.cc:276] 0709 13:12:35.593491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.868061 (+1274570us) service_pool.cc:224] Handling call
0709 13:12:36.870244 (+  2183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.881937 (+ 11693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.882165 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.884918 30178 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:36.778386   732 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.841961   883 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:36.906970   883 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.886219 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:36.911002 30186 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.911158 30735 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:36.805119   608 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:12:36.886574 30112 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:12:36.888854 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49729.9us
I20260709 13:12:36.922201 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:36.821786   618 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:36.885535   820 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 1.265s	user 0.000s	sys 0.006s
I20260709 13:12:36.843555   749 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.872402   644 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.853528   398 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:36.889936   679 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:36.882651   682 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:36.914300 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2267) took 1149 ms. Trace:
I20260709 13:12:36.872479   786 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:36.750371   833 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.883548   829 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.846596   835 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:36.931708 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:36.995975 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64394.4us
I20260709 13:12:36.997107 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:36.916792 30110 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.911852   454 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:36.918170   748 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:36.835969   796 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.003684   720 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.873368   858 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:12:36.948009   679 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.008286   758 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:37.008785   758 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:37.008549   679 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.009742   758 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.939575   787 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:36.835045   878 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.011184   758 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:37.012210 30182 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:36.974539   888 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:12:36.880769   828 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.013439 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2255) took 1424 ms. Trace:
I20260709 13:12:37.013821   833 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.014035 30104 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:37.013841 30182 rpcz_store.cc:276] 0709 13:12:35.591397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.761880 (+1170483us) service_pool.cc:224] Handling call
0709 13:12:36.762191 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.012590 (+250399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.013150 (+   560us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002986d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.013349 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574148992}
I20260709 13:12:37.003764   705 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:37.016122 30182 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:36.975826   607 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:37.016680 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2268) took 1235 ms. Trace:
I20260709 13:12:36.976990   682 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.977843 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 580) took 2038 ms. Trace:
W20260709 13:12:37.021893 30002 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.707s (SENT) [suppressed 19 similar messages]
W20260709 13:12:36.983325 30180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2254) took 1394 ms (client timeout 1702 ms). Trace:
I20260709 13:12:37.024401 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:37.024636 30180 rpcz_store.cc:269] 0709 13:12:35.588959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.613819 (+ 24860us) service_pool.cc:224] Handling call
0709 13:12:36.982994 (+1369175us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400298bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:36.983230 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259435392}
W20260709 13:12:37.017323 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.026988 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1928) took 1207 ms. Trace:
I20260709 13:12:37.027760 30180 rpcz_store.cc:276] 0709 13:12:35.819614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.025921 (+1206307us) service_pool.cc:224] Handling call
0709 13:12:37.026311 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.026549 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.026588 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:37.026648 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:37.026699 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.026771 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.026919 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.981161   703 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:36.992224 30178 rpcz_store.cc:276] 0709 13:12:35.764510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.884049 (+1119539us) service_pool.cc:224] Handling call
0709 13:12:36.884666 (+   617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.914028 (+ 29362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.914239 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:36.944474   644 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:36.827400   871 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.011054   679 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.017010 30182 rpcz_store.cc:276] 0709 13:12:35.781728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.015461 (+1233733us) service_pool.cc:224] Handling call
0709 13:12:37.015791 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.016450 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.016631 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:37.010798   804 raft_consensus.cc:3055] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:36.994827   835 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.038223 30180 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:37.175237 30180 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:37.038396 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:37.126592 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:37.180131 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53662.4us
I20260709 13:12:37.122340   758 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.180940   864 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.016897   725 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.195027   758 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.195626   727 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:37.196089   727 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:37.135946   828 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:37.048426   796 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
W20260709 13:12:37.182687 30740 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43022 (request call id 807) took 1379 ms (client timeout 1644 ms). Trace:
I20260709 13:12:37.178821   732 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.185806 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:37.088009 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2249) took 1500 ms. Trace:
W20260709 13:12:37.197942 30740 rpcz_store.cc:269] 0709 13:12:35.803111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.803234 (+   123us) service_pool.cc:224] Handling call
0709 13:12:37.038231 (+1234997us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:37.182599 (+144368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12107648}
I20260709 13:12:37.202257 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:37.022258 30741 rpcz_store.cc:276] 0709 13:12:34.939896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.940624 (+   728us) service_pool.cc:224] Handling call
0709 13:12:34.941043 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:34.941514 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.941556 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:34.942030 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.293592 (+351562us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:35.293631 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.293705 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.764298 (+1470593us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:36.977482 (+213184us) raft_consensus.cc:1685] finished
0709 13:12:36.977507 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.977765 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":970,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":8930560,"thread_start_us":351161,"threads_started":1,"wal-append.queue_time_us":531864}
W20260709 13:12:37.132889 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.085129 30186 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:37.201221 30183 rpcz_store.cc:276] 0709 13:12:35.587611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.620162 (+ 32551us) service_pool.cc:224] Handling call
0709 13:12:35.620459 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.620653 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:35.799307 (+178654us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.826989 (+1027682us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b1800381ca0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1
0709 13:12:37.031480 (+204491us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b1800381ca0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe5c7b4bc 00007fcbe2fc948b 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287
0709 13:12:37.087626 (+ 56146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:37.087696 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:37.087751 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.087825 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.087954 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15215,"prepare.queue_time_us":417824,"prepare.run_wall_time_us":33,"raft.queue_time_us":97550,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6456,"spinlock_wait_cycles":45124992,"thread_start_us":442591,"threads_started":3,"wal-append.queue_time_us":584626}
W20260709 13:12:37.367511 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 153233us
I20260709 13:12:37.021831   713 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.197070   727 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.208590   864 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:37.197326   725 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.397689   727 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.132149   787 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.048190   652 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:37.420084 30186 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:37.368971 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:37.089830   681 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:37.205353   804 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:37.086090   748 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.136647   861 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.380542   732 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.234977   391 raft_consensus.cc:2764] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:12:37.439200   828 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:37.427357   652 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:37.424024   713 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.431511   877 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.104375   833 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.468966 30110 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.424867   867 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.484838 30105 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:37.469156 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 257891us
I20260709 13:12:37.486413 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:37.413139   875 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:37.424857   850 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.397750   864 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.433753   725 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.468667   720 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:37.429272 30107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.015s
I20260709 13:12:37.467789   796 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:37.438448   787 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.493482   833 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.539919   644 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.506132   850 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.543128   850 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.544137   835 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:37.544633   607 consensus_meta.cc:287] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.001s
I20260709 13:12:37.527051   804 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.545116   703 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.545668   804 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.546147   703 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.503038   875 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:37.549597 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 468181us
I20260709 13:12:37.488117 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:37.490780   731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.024s	sys 0.062s
I20260709 13:12:37.500810   867 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:37.554455 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66085.1us
I20260709 13:12:37.500639   732 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.482589   713 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.502696   681 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.502456   862 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.502671   864 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.468654   828 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.548725   754 raft_consensus.cc:993] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:37.465386   758 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:37.483959 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 462066us
W20260709 13:12:37.426555 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57718.9us
I20260709 13:12:37.510219   725 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:37.554329   883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.042s	sys 0.096s
W20260709 13:12:37.513367 30107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.016s
I20260709 13:12:37.572142 30185 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
W20260709 13:12:37.552449   731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.025s	sys 0.063s
I20260709 13:12:37.512240   720 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.579073 30110 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.594306 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.595420 30110 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:37.581364 30112 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:12:37.558101   835 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.520645   796 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.522264   652 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.558036   703 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.583190 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.592808   732 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.596998 30112 pending_rounds.cc:85] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
W20260709 13:12:37.589993   829 consensus_meta.cc:287] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.004s
I20260709 13:12:37.607059 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 582) took 1811 ms. Trace:
I20260709 13:12:37.610430 30113 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:37.610872 30736 rpcz_store.cc:276] 0709 13:12:35.795685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.796092 (+   407us) service_pool.cc:224] Handling call
0709 13:12:37.606360 (+1810268us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:37.606544 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.606729 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.606759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:37.606800 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:37.606838 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.606895 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.607000 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11624832}
I20260709 13:12:37.613193   787 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.613531   725 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.613734   828 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.614066   725 raft_consensus.cc:1081] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:37.615023   725 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.615505   725 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.618512   758 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:37.619550   875 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:37.620685   758 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:37.593020   883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.043s	sys 0.096s
I20260709 13:12:37.608448 30112 pending_rounds.cc:107] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:12:37.593818   795 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.624755 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33114 (request call id 80) took 1032 ms. Trace:
I20260709 13:12:37.628975 30112 raft_consensus.cc:2889] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:37.629124 30180 rpcz_store.cc:276] 0709 13:12:36.592702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.199077 (+606375us) service_pool.cc:224] Handling call
0709 13:12:37.624402 (+425325us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400267fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d9735 00007fcbe60d19fa 00007fcbeb0994c9 00007fcbe4615c54 00007fcbe4615be2 00007fcbe4615b11 00007fcbe4615a8c 00007fcbe4614d42 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.624662 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799927040}
I20260709 13:12:37.585444   681 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.637341 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:37.639369 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.630908 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:37.600023   877 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:37.633101 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.633970 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.635221 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:37.642165 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.645453 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:37.646020 30179 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.646239 30113 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:37.645983 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.647217 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.647298 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.647655 30112 raft_consensus.cc:2376] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7. Re-sending same reply.
I20260709 13:12:37.585274   862 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.626379   652 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:37.618568   867 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:37.638293   871 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.607184   703 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.692327 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.694834 30179 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:12:37.695464 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.699518 30183 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:12:37.699461 30180 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:37.700462 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.624312   732 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.648510   877 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.677139   861 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.638537   795 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:37.714493   721 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 13:12:37.627729   829 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.714690   681 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.715310   713 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.716638   732 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.712679 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.710755 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.706595   833 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.726121 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.707161   725 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.728705 30178 raft_consensus.cc:2410] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:37.728888 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:37.750612 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.707185   703 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.758385 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.761536   877 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.756356   864 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.760689 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.786871 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:37.787590 30107 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 2.
I20260709 13:12:37.786912 30106 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:37.789047   681 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.789371   833 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.791980   871 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.791394 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.792055   833 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.792879 30186 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:37.792672   871 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.793748   853 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:37.794369   833 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.791179   681 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:37.740190 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 143620us
I20260709 13:12:37.723217   850 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:37.814697 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.817366 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.734114   836 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.797441 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:37.809635   871 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.811803 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.812819 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.788796 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.823467 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:37.824842 30035 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.744659 30732 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:37.828527 30107 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:37.836071 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:37.843294 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.843638 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.844563 30107 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:37.843482 30183 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:37.845072 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1906) took 1014 ms. Trace:
I20260709 13:12:37.826700 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:37.843824 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.822163   754 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.845579 30038 rpcz_store.cc:276] 0709 13:12:36.830670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.833879 (+  3209us) service_pool.cc:224] Handling call
0709 13:12:36.834116 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.836662 (+  2546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.836693 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.837184 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:12:37.619210 (+782026us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b1800428b60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:37.725543 (+106333us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:37.725581 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.725650 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.844748 (+119098us) raft_consensus.cc:1685] finished
0709 13:12:37.844770 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.845007 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2097,"raft.queue_time_us":3925,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":26339,"spinlock_wait_cycles":8247040,"thread_start_us":105822,"threads_started":1,"wal-append.queue_time_us":904792}
I20260709 13:12:37.848230   871 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:37.847729   754 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.848537 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:37.848738   871 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.849193   871 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:37.849862 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:37.850478   754 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.851095 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.851423 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2149) took 1042 ms. Trace:
I20260709 13:12:37.851831 30104 rpcz_store.cc:276] 0709 13:12:36.809102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.830726 (+ 21624us) service_pool.cc:224] Handling call
0709 13:12:36.831008 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.014408 (+183400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.851201 (+836793us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400304dd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.851364 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420469504}
I20260709 13:12:37.852367 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:37.853013 30038 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:37.853307 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.854147 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2252) took 2265 ms. Trace:
I20260709 13:12:37.854842 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.855444 30030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1955) took 1854 ms. Trace:
I20260709 13:12:37.856176 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.857353 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.857918 30033 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:37.858697 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.859213 30033 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:37.860029 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.862022   910 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:37.863157 30001 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:37.864279 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:37.865309 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:37.866425   829 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.867087   829 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:37.867384   732 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:37.867487   829 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.867848   732 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.867913   829 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.868275   754 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:37.868291   732 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:37.869067   754 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:37.870028   754 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.871459 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.872002   862 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:37.872179 30111 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:37.854508 30187 rpcz_store.cc:276] 0709 13:12:35.588382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.792997 (+204615us) service_pool.cc:224] Handling call
0709 13:12:35.793416 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.709380 (+915964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.853948 (+1144568us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54002170d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.854091 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105030016}
I20260709 13:12:37.876021 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.873206 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:37.822427   765 consensus_meta.cc:287] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.036s	user 0.014s	sys 0.003s
I20260709 13:12:37.853071 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:37.844242 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:37.825659   905 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.286254   910 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:37.829677   878 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:37.926169   777 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.287966   910 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:38.289225 30185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2257) took 2697 ms (client timeout 1707 ms). Trace:
W20260709 13:12:38.289680 30185 rpcz_store.cc:269] 0709 13:12:35.592041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.603114 (+ 11073us) service_pool.cc:224] Handling call
0709 13:12:38.289009 (+2685895us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54003b0954. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.289127 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4472776960}
I20260709 13:12:38.290647   841 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.290969 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.291221   910 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.291736 30739 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 581) took 3338 ms. Trace:
I20260709 13:12:37.831250   877 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.292503   630 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:38.292831   870 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.293053 30038 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:38.037849 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.898839 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.298895 30182 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:38.294396   910 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.299621 30111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:12:38.300055   910 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:37.879482 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:38.302174 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 422747us
I20260709 13:12:38.302919 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:37.848444 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2150) took 1039 ms. Trace:
I20260709 13:12:38.305629 30105 rpcz_store.cc:276] 0709 13:12:36.809365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.833174 (+ 23809us) service_pool.cc:224] Handling call
0709 13:12:36.833500 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.485505 (+652005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.848117 (+362612us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400397454. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.848383 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497326464}
I20260709 13:12:38.308507 30105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:12:38.295763 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 701) took 2252 ms. Trace:
I20260709 13:12:37.861135 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:37.932771 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.087071   865 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:37.818445   850 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:37.997556 30004 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:38.067276 30035 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:38.283425 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:38.323835 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:38.114180 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.324625 30035 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.298204   795 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.297921   905 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.292383 30739 rpcz_store.cc:276] 0709 13:12:34.953559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.953746 (+   187us) service_pool.cc:224] Handling call
0709 13:12:34.954144 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.838062 (+1883918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.291466 (+1453404us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400650c54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:38.291631 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4324736896}
I20260709 13:12:37.895766 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:38.288781   777 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.300504 30111 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.086129 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.334504 30111 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.334841 30179 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:38.306883 30182 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:38.336015 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:38.336596 30182 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.295712 30104 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.293975 30038 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.314533 30108 rpcz_store.cc:276] 0709 13:12:36.043710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.043884 (+   174us) service_pool.cc:224] Handling call
0709 13:12:36.044272 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.873123 (+828851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.295455 (+1422332us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54003543d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:38.295672 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835220864}
I20260709 13:12:38.314765 30033 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:38.337827 30038 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.338407 30033 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:38.315487 30105 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.338999 30105 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:37.864285   681 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.293166   630 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:37.846084 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.318112 30106 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:37.871451   703 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.321358 30183 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:38.324116 30180 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.284742 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:38.285154 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 1957) took 1932 ms. Trace:
I20260709 13:12:38.363209 30029 rpcz_store.cc:276] 0709 13:12:36.352980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.353114 (+   134us) service_pool.cc:224] Handling call
0709 13:12:36.381056 (+ 27942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.774679 (+393623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.774710 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:36.774749 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:36.774786 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.284859 (+1510073us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54003421d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:38.284922 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.285071 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904807808}
I20260709 13:12:38.326112 30185 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:38.323808 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:38.329137 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:38.330482 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 333052us
I20260709 13:12:38.170073   861 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.365621 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.332772 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.366223 30185 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:38.340255 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:37.831900   796 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:37.855871 30030 rpcz_store.cc:276] 0709 13:12:36.001213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.001378 (+   165us) service_pool.cc:224] Handling call
0709 13:12:36.001773 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.772905 (+771132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.855231 (+1082326us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540020add4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:37.855388 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771715328}
I20260709 13:12:38.367316 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:38.367736 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:38.367913 30030 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:38.087379   713 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:38.359143 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:38.319636   808 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.332182   758 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:38.322764   809 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.299669   877 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.361413 30104 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
W20260709 13:12:38.284431 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.920274   864 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.070705   899 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:38.366292 30187 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 3.
W20260709 13:12:38.331660 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.358177 30038 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:38.372185 30179 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:38.372370 30108 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:38.286562   774 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.366883 30181 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:38.359858 30111 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.339399   878 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.375988   808 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:38.376104 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:38.376241   862 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:38.376307   758 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.402310   862 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.402455   758 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.402827   862 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:38.407809 30732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 586) took 1805 ms (client timeout 1843 ms). Trace:
W20260709 13:12:38.408305 30732 rpcz_store.cc:269] 0709 13:12:36.602385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.602933 (+   548us) service_pool.cc:224] Handling call
0709 13:12:38.407618 (+1804685us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004303d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.407741 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361881472}
I20260709 13:12:38.376632   809 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.410305 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:38.411581 30109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1558) took 2603 ms (client timeout 2890 ms). Trace:
W20260709 13:12:38.411993 30109 rpcz_store.cc:269] 0709 13:12:35.808237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.808402 (+   165us) service_pool.cc:224] Handling call
0709 13:12:38.411406 (+2603004us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400354654. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.411496 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973726080}
I20260709 13:12:38.412876   758 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.380256 30105 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.415040   862 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.415455 30105 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:38.416460   871 consensus_meta.cc:287] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.004s
I20260709 13:12:38.386703   878 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.334084   811 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:38.375545 30035 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:38.417734   811 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.418424   878 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.387835 30111 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.396185 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.419835   811 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.380342 30104 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 8. Ops: []
I20260709 13:12:38.421785 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:38.421943 30183 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:38.422411 30036 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:38.397830 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.423823 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.398201 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:38.425501 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.377969 30186 raft_consensus.cc:2393] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:38.378458 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.329777   836 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.413255 30112 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:12:38.380113 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.398609 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.428485 30734 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:38.331667   874 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:38.433676 30734 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:38.341475   682 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:38.292384   765 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.445735 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:38.345950   909 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.447652 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.436018 30180 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:38.463336 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.432289 30105 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:38.651252 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:38.654778 30037 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:38.457146 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.447268 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.446715 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:38.427179 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51136.1us
W20260709 13:12:38.678340 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.679486 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1915) took 1833 ms. Trace:
I20260709 13:12:38.477843 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.680217 30032 rpcz_store.cc:276] 0709 13:12:36.846166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.848665 (+  2499us) service_pool.cc:224] Handling call
0709 13:12:38.678901 (+1830236us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400332554. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.679231 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828680064}
I20260709 13:12:38.681288 30732 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:38.683630 30035 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:38.683554 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.685796 30031 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:38.479902 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.486387 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.459512 30740 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.454912 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:38.460449 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.464037 30737 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:38.694429 30037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 1908) took 1850 ms. Trace:
I20260709 13:12:38.707037 30037 rpcz_store.cc:276] 0709 13:12:36.843563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.843668 (+   105us) service_pool.cc:224] Handling call
0709 13:12:38.694082 (+1850414us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000efe54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.694335 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117751040}
I20260709 13:12:38.336922   865 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.706354 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:38.708310 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:38.432200   644 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:38.750627 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 421429us
I20260709 13:12:38.751340   644 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.695765 30079 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:38.459941   682 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:38.534904   732 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
W20260709 13:12:38.757778 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.758390   732 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.759290   776 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:38.759644 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.760195   776 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:38.761893 30077 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.511s (SENT)
I20260709 13:12:38.458832   749 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:38.764429   749 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.767508 30113 raft_consensus.cc:2393] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:38.771847   644 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.455829   753 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.335760   754 consensus_queue.cc:1059] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:12:38.785020   754 raft_consensus.cc:3055] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:38.493444   765 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.446818   807 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:38.789032   754 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:38.797737 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 117911us
I20260709 13:12:38.797866   807 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.798977   754 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.800813   731 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:38.801589 30740 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:12:38.802332   652 consensus_meta.cc:287] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.100s	user 0.011s	sys 0.007s
I20260709 13:12:38.802771   758 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.801321   754 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:38.809764 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 114357us
I20260709 13:12:38.809980 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:38.788641   753 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:38.818059 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.818819   753 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.494657   808 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.820741   808 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.821864   926 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:38.822631   926 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.411581   809 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:38.829380 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.451647   832 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:38.831079   832 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.446416   836 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.436529   843 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.495431   850 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.452426   859 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.878270 30113 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:38.878624   859 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.882764 30736 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.874210 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:38.441686   861 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.462020   863 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:38.910983   863 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.487299   870 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:38.913592 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.914069   870 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.416873   871 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.449812   874 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:38.696955 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1568) took 1116 ms. Trace:
I20260709 13:12:38.918300   874 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.918159 30112 rpcz_store.cc:276] 0709 13:12:37.580640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.649080 (+ 68440us) service_pool.cc:224] Handling call
0709 13:12:38.412941 (+763861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.427050 (+ 14109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.696547 (+269497us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400354650. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:38.696768 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755935488}
I20260709 13:12:38.379127   877 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.920509   871 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.920755 29930 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.923411 29930 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.927479   863 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.530131   910 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.445730   914 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:12:38.930320   874 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.932199   914 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:38.932739   914 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:38.736867 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 583) took 2940 ms. Trace:
I20260709 13:12:38.750188 30029 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.933292   874 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.934852   862 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.435614   713 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.938580   630 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.940022   713 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.773491   776 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:38.940466   732 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:38.773818 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.942732   894 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 1.238s	user 0.009s	sys 0.009s
I20260709 13:12:38.933543 30733 rpcz_store.cc:276] 0709 13:12:35.796078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.796212 (+   134us) service_pool.cc:224] Handling call
0709 13:12:37.039638 (+1243426us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b5800010b98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:37.039971 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:37.040506 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.040551 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:37.041148 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.337185 (+1296037us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180036cd60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:38.685942 (+348757us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:38.686026 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.686155 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:38.736367 (+ 50212us) raft_consensus.cc:1685] finished
0709 13:12:38.736390 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.736623 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20949,"raft.queue_time_us":143,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":41809,"spinlock_wait_cycles":28010624,"thread_start_us":348233,"threads_started":1,"wal-append.queue_time_us":1644510}
I20260709 13:12:38.944914 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.945923 30741 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:38.947135 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.786461 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:38.401799   756 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:38.806270   876 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
I20260709 13:12:38.948276 30737 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:38.590565   829 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.001s
I20260709 13:12:38.948700   756 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:38.947804   914 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.949623   829 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:38.827060 30738 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:38.825160   926 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.801162   807 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.952836   836 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:38.794567 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 401094us
I20260709 13:12:38.953476 30079 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:38.845309   682 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.953510 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:38.955242 30737 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.956331   776 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:38.956522   795 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:38.958674   829 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.907928   861 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.909742 30106 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:38.927687   777 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.379482   899 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:39.005978   807 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:39.008378   899 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.928388   749 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.929416   905 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.917106   870 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.930390   761 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.774181   720 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:38.947543   865 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:38.797494 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 425680us
I20260709 13:12:39.011722 30106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2172) took 1184 ms. Trace:
I20260709 13:12:39.012482 30106 rpcz_store.cc:276] 0709 13:12:37.820693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.371634 (+550941us) service_pool.cc:224] Handling call
0709 13:12:38.457718 (+ 86084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.002015 (+544297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.004957 (+  2942us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540029fed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:39.005307 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007506816}
I20260709 13:12:39.013485 30004 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:39.009227   807 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.014712   807 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:39.014777 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:38.950389   864 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.959040   630 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.016052   864 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:39.018118   865 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.018862   865 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:38.950024   756 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:39.022900   865 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:38.868908 30002 leader_election.cc:336] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.702s (SENT)
I20260709 13:12:38.966737 30737 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:38.969905 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:39.025983 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 157280us
W20260709 13:12:39.027227 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.970516   859 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:38.973076 29931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 260) took 20179 ms (client timeout 15000 ms). Trace:
I20260709 13:12:38.933534   832 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:38.977896 30079 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:39.031605 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 53921.4us
W20260709 13:12:39.030961 29931 rpcz_store.cc:269] 0709 13:12:18.793416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.793593 (+   177us) service_pool.cc:224] Handling call
0709 13:12:38.972409 (+20178816us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":37}
I20260709 13:12:38.949898   914 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:39.033075   749 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:39.033814   749 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.034399   749 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:39.033103 30079 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:39.040407 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:39.040979   899 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:39.041831   899 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:39.041234 29930 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.043355   899 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:38.859448 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 95522.5us
I20260709 13:12:38.985066 30029 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:38.956985 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:38.993569 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 76409.3us
I20260709 13:12:38.965673   877 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:39.024819   864 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:39.053958   877 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:39.057359 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:39.058336 30112 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:39.054565   761 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:39.063333 30736 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:12:39.064749 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 195206us
I20260709 13:12:39.044452 29930 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 6, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:39.074584 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 117696us
I20260709 13:12:39.054145   905 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:39.094483 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:39.098616 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:39.058713   877 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:39.106863 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.109093 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 94464.3us
I20260709 13:12:39.117445 30112 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:39.118533   848 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:39.121594 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 278118us
I20260709 13:12:39.123441   696 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.124018   696 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:39.125346 30740 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
W20260709 13:12:39.126324 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.130012 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:39.130973 30111 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:39.132632   756 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:39.111395 29930 catalog_manager.cc:5697] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.111011 30001 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:39.097334   905 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:39.745682 30002 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.026s
W20260709 13:12:39.404198 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.433187 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.972620 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 852284us
I20260709 13:12:39.745486 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2171) took 1794 ms. Trace:
W20260709 13:12:39.189224 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.233181 30108 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:39.973845 30002 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.000s	sys 0.036s
W20260709 13:12:39.993935 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 896205us
I20260709 13:12:39.112179 30106 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:39.232976 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:39.977272 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.976186 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:39.558992   914 consensus_meta.cc:287] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.526s	user 0.013s	sys 0.000s
I20260709 13:12:39.232873 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:39.234129 30182 consensus_meta.cc:287] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.772s	user 0.019s	sys 0.002s
W20260709 13:12:39.208161 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 100117us
I20260709 13:12:39.121171   877 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.023681 30112 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:39.973260   807 consensus_meta.cc:287] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.958s	user 0.009s	sys 0.006s
I20260709 13:12:39.113049   865 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:39.581709   933 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:12:39.726044   796 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.370447   925 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.671213   864 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.977494 30107 rpcz_store.cc:276] 0709 13:12:37.820412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.354512 (+534100us) service_pool.cc:224] Handling call
0709 13:12:38.354905 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:38.776139 (+421234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.779241 (+  3102us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:38.807903 (+ 28662us) log.cc:844] Serialized 52 byte log entry
0709 13:12:38.856611 (+ 48708us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:39.396876 (+540265us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.511204 (+114328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.547375 (+ 36171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.547444 (+    69us) raft_consensus.cc:1685] finished
0709 13:12:39.547462 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.614667 (+ 67205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96688,"raft.queue_time_us":169176,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":62651,"thread_start_us":917274,"threads_started":3,"wal-append.queue_time_us":115396}
I20260709 13:12:39.977466   905 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:40.037853 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 915349us
I20260709 13:12:39.369210   843 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.611279   652 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.774152   720 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.031188   796 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.039047 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 919816us
W20260709 13:12:40.040364 30110 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.016s	sys 0.000s
I20260709 13:12:40.035751 29930 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 3 to 6, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:40.052913 30110 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.017s	sys 0.000s
W20260709 13:12:40.040366 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.053548 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.631299   861 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.031827   807 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:39.133642   756 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.043327   864 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.044158   829 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.045881 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.046063 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:40.048450 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.209048   808 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:40.034020 30182 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:40.042786   914 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:40.047752   925 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.067775 29930 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 4 to 6, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.074999 30178 raft_consensus.cc:2376] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5. Re-sending same reply.
W20260709 13:12:40.079218 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1959) took 1800 ms (client timeout 1751 ms). Trace:
I20260709 13:12:40.052496   843 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.083002 30182 rpcz_store.cc:269] 0709 13:12:38.275955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.335763 (+ 59808us) service_pool.cc:224] Handling call
0709 13:12:40.070882 (+1735119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.085271 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.086490 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:40.059657   861 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.066145   829 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:40.098876 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.066320   652 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.099774 30034 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:40.105377 30034 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:40.106940 30034 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.108213 30034 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.087894 29930 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.114282 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:40.115473 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.116753 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:40.117805 30038 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.126549 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:40.130654 30107 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:40.129467 29930 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.141832 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.089836   808 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.093855   720 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.135015 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.152873 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.154636   945 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:40.168875   937 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:40.163504   935 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:40.165705   807 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.177284   946 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.177623   870 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:40.175551   939 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:12:40.186846   940 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:12:40.174628   756 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.174957   652 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.180662   870 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:40.191668 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:40.192307   870 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.190500 30038 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:40.173578   947 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.173832   864 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.257881 30034 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:40.185113   796 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.266379 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:40.271229 30740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43022 (request call id 824) took 1318 ms. Trace:
W20260709 13:12:40.272496 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 1.19656e+06us
W20260709 13:12:40.275202 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 1.04229e+06us
I20260709 13:12:40.268747 30111 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:40.271660 30740 rpcz_store.cc:276] 0709 13:12:38.944666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.946845 (+  2179us) service_pool.cc:224] Handling call
0709 13:12:40.262967 (+1316122us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400681354. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:40.263086 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407825664}
I20260709 13:12:40.272877   949 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:40.274264 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2181) took 1197 ms. Trace:
I20260709 13:12:40.320778 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2184) took 1131 ms. Trace:
I20260709 13:12:40.229449   843 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.321297 30111 rpcz_store.cc:276] 0709 13:12:39.151801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.225322 (+ 73521us) service_pool.cc:224] Handling call
0709 13:12:40.266233 (+1040911us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:40.282746 (+ 16513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9072896}
I20260709 13:12:40.263407   756 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:40.341892   749 consensus_meta.cc:287] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.306s	user 0.014s	sys 0.004s
I20260709 13:12:40.332403   950 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.336726   796 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:40.193670   945 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.319967 30110 rpcz_store.cc:276] 0709 13:12:39.076694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.076895 (+   201us) service_pool.cc:224] Handling call
0709 13:12:39.108848 (+ 31953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.125586 (+ 16738us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:40.055211 (+929625us) log.cc:844] Serialized 14 byte log entry
0709 13:12:40.273775 (+218564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.273846 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:40.273919 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.274016 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.274190 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9202,"prepare.queue_time_us":961931,"prepare.run_cpu_time_us":264,"prepare.run_wall_time_us":3560,"raft.queue_time_us":955,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":1145369,"threads_started":2,"wal-append.queue_time_us":218453}
I20260709 13:12:40.341463   861 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:40.361937 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 197788us
I20260709 13:12:40.357105 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.334808   925 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:40.358006   942 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:12:40.361842   829 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.367592   843 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:40.369427   865 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:40.375587   870 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.358144   756 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.361515   749 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.401775 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.413620 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 344676us
I20260709 13:12:40.379431   914 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:40.376886   808 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.414541 30079 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.338850   947 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.394863   925 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.397032   843 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:40.432677 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 301143us
I20260709 13:12:40.438999 30109 raft_consensus.cc:2368] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:40.440485   963 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.441326   756 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.442045 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.445431 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:40.445708 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.446182 30105 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.446337 30740 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.422612   696 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.437896   899 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:40.450448   899 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:40.450977   899 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.451781   720 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.454978 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2179) took 1397 ms. Trace:
I20260709 13:12:40.455152 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2186) took 1223 ms. Trace:
I20260709 13:12:40.439188 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.455646 30109 rpcz_store.cc:276] 0709 13:12:39.231716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.232302 (+   586us) service_pool.cc:224] Handling call
0709 13:12:40.454961 (+1222659us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54000a00d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:40.455090 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953942656}
I20260709 13:12:40.360510   949 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.367414   950 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.441108   963 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.383533   796 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.483239 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.482402 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.467100 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.462738 30181 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:40.460172 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.462111 30186 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:40.463479 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.461848 30185 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:12:40.489737 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.491533 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.464664 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.463227 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.430039   951 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:40.493079 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 77045.3us
I20260709 13:12:40.432618   954 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.456895 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.494467 30112 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:12:40.494719 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.494792   962 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:40.504150   962 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.505374   949 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.505288   962 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.508244   963 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.502147   950 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.512315 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.512943 30733 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
W20260709 13:12:40.514021   953 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:12:40.514616   749 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.515645 30179 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.499001 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.456535   925 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.518396   925 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.520494 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.521133 30733 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.526975 30180 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:40.526759   905 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.528091   954 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.529032   947 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.529822   905 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.530504   954 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.466624   914 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.456001   861 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.530851   796 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.531242   861 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.531601   963 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.532281   963 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.464496   945 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.533362   870 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:40.470736 30004 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:40.533987   870 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:40.534229 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 63592.7us
I20260709 13:12:40.534471   870 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.535250   958 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:40.535383 30004 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:40.535902   958 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:40.537038   958 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.499789 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2185) took 1274 ms. Trace:
I20260709 13:12:40.539516 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.539832   843 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.541095   952 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.541242   843 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.541652   952 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.541747 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.542157   952 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.545535 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.546761   946 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:40.500270 30740 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:40.455438 30113 rpcz_store.cc:276] 0709 13:12:39.057275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.057442 (+   167us) service_pool.cc:224] Handling call
0709 13:12:39.057842 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.058453 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.058492 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.059139 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.441376 (+382237us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:39.441461 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.441570 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.454771 (+1013201us) raft_consensus.cc:1685] finished
0709 13:12:40.454791 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.454923 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1454,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":34284,"thread_start_us":381687,"threads_started":1,"wal-append.queue_time_us":1019610}
I20260709 13:12:40.545838 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.501384   956 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:40.501663 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63192.4us
I20260709 13:12:40.547700 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.546231 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.548106   956 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.539260 30112 rpcz_store.cc:276] 0709 13:12:39.225351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.233041 (+  7690us) service_pool.cc:224] Handling call
0709 13:12:40.499731 (+1266690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.550586 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.550714   956 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:40.552245 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 95431.9us
I20260709 13:12:40.553103 30705 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.554087   696 raft_consensus.cc:2764] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:40.499621 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:40.502034   865 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.555095 30705 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.556610   696 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:40.515527 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.557309   696 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:40.558403 30079 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:40.528676 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.559721   950 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:40.560130   950 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.560504   950 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:40.560799   938 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:40.560943   749 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:40.561273   938 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:40.561666   749 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.562502   938 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.562842   749 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.563963   938 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.533572   949 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.569104 30733 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:40.496598 30183 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:40.558706 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:40.458737 30002 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.707s (SENT)
I20260709 13:12:40.569104 30105 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
W20260709 13:12:40.575874 30105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2188) took 1343 ms (client timeout 1568 ms). Trace:
W20260709 13:12:40.577111 30105 rpcz_store.cc:269] 0709 13:12:39.232495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.233362 (+   867us) service_pool.cc:224] Handling call
0709 13:12:40.361049 (+1127687us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0990a0 00007fcbeb098984 00007fcbe46136d4 00007fcbe4613662
0709 13:12:40.575801 (+214752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21451648}
I20260709 13:12:40.573294 30179 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:12:40.534713   963 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.582487 30079 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.583516 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:40.585698 30738 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:40.585049 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.586254 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.545287   870 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.586467 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.586623 30179 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:40.586253 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.564915   861 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.585639   949 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.593511   829 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.593598 30740 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:12:40.595710 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.595639 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:40.597198 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.598058 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.605818 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.606221 30739 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.598137 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:40.599933 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.590596 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.606947 30186 raft_consensus.cc:2376] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8. Re-sending same reply.
I20260709 13:12:40.611171 30735 raft_consensus.cc:2368] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:40.592161   946 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:40.612582   807 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:40.613098 30079 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.617599 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.620230 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:40.623368 30737 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:40.627161 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.627897 30737 raft_consensus.cc:1813] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Handling vote request from an unknown peer ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:40.628470 30737 raft_consensus.cc:2368] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:40.633678   962 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:40.635066 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.635169   962 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.635257 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.635732   962 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.636230 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.636828 30740 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:40.616429   870 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.637473   963 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.616906 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.637696 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.638055   963 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.638991 30732 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:40.640069   967 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:40.640277   963 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.648948 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:40.649474 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.610605   899 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.650450 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.648123   807 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.651925   899 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.651607   807 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.652323   949 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.652496   899 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:40.653558 30111 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:40.653015   899 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.620662   829 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.662333   829 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:40.665562 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 206889us
I20260709 13:12:40.656029 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:40.645327 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.643749   946 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.659368   899 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.655515   950 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.659596 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 47634us
I20260709 13:12:40.674422 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.660631 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.668856   948 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:40.687022 30739 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:12:40.670449 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.673523   861 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.684024 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.702049 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.703886 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.704041 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.698618 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.711115 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.711865 30733 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:40.712858 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.713651   861 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.714686 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.715952 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.716926   861 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.717146 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.717855 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.719069 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.719937   949 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.719969 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.720610 30079 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.722008 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.725994 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.726563 30741 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:40.732586   967 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.733144   967 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.733587   967 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.733894   950 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.730819   963 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:12:40.696913 30732 raft_consensus.cc:2376] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5. Re-sending same reply.
I20260709 13:12:40.737562 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.738279 30182 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:40.738670 30739 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:40.739205 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.738272   960 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:40.739881 30184 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:40.740087   960 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.740854 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.741613 30181 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:40.741925 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.741591 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.742698   960 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:40.743132 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.743140 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:40.743925 30185 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:40.674724   946 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.744801 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:40.746969 30153 leader_election.cc:400] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:40.747390 30153 leader_election.cc:403] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.745224 30737 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:40.742520 30180 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:40.751540 30740 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:40.754354 30183 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:40.754539 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.730950   644 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:40.764117   865 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.764430   644 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:40.753450   870 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.764968   967 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.767427   870 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.767577   967 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.767943   870 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.769724   967 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.722954   948 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.770979 30038 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:40.790256   948 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.792125   865 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:40.771251   952 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.771324 30034 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:40.772229 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.770181   967 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.773470 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.797500 30732 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:40.799084   967 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:40.799427 30736 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:40.774170 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:40.805827 30185 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:40.806156 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:40.764961   644 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.807538 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:40.808208 30038 raft_consensus.cc:1240] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:40.774924 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:40.775503 30186 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:40.816260   945 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:40.816802   945 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.817621   796 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:40.819718   796 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:40.820183   796 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:40.775436 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:40.821936 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49144.7us
I20260709 13:12:40.822121   967 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:40.822700   967 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.817253   945 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.823240   967 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:40.779119 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.795959   952 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:40.777540 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.850585 30079 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:40.852721   946 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:40.853775   946 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:40.853921   899 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:40.854844   946 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:40.857791 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 78778.1us
I20260709 13:12:40.785264   962 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.874326 30740 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:40.844820   843 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.879338 30001 leader_election.cc:400] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:40.879720 30001 leader_election.cc:403] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.883114 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:40.885038 30038 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:40.918751 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.924328 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:40.925158 30038 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:40.881961   843 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:40.821357   796 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.928495 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:40.932194   926 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:40.932760   926 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:40.933226   926 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.933614 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:40.924413   958 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.927686   843 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.949309 30705 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:40.956595   644 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:40.965132   796 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.958228 30732 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:40.929967   925 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:40.962862 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:40.931645   948 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:40.945068   696 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.978690 30038 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:40.986897   644 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:40.979959 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:40.993994 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:40.962862   960 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:41.001758 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:41.000674 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:40.999907 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.000674 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:40.999358 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:40.991146   914 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.008733 30036 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:41.004926 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.006927   899 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:40.998888 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.000864   938 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:41.007385   967 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:40.980069   962 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:41.010282 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:41.015607 30153 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Timed out: RequestConsensusVote RPC to 127.28.62.132:36585 timed out after 2.052s (SENT)
I20260709 13:12:40.988713   870 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.021064 30034 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:12:41.024793 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.000303 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.028298 30737 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:40.989288   949 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:41.027776 30033 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:41.030289 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:41.047327 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.047787 30029 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:41.048172 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68344.7us
I20260709 13:12:41.049028 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:41.052772 30737 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:41.054937 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:41.055158 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 44972.2us
I20260709 13:12:41.055686 30038 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:41.059301 30079 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:41.032871   899 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:41.058415 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.034765   938 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:41.065042 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.060424 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.063761 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.065117 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.021203   948 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:41.067561 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.069181 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.026899   696 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.065817 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.066331 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.070914 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.066200 30036 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:41.072077 30038 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:12:41.074569 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.073287 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.035718   914 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.085250 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.071457 30037 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:41.085775 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.065629   749 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:41.086562 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.065709   938 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:41.065948   946 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:41.088987 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.099879 30036 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:41.062839   945 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.101437   870 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.113756   696 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.124687 30033 raft_consensus.cc:2410] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:12:41.124797   870 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:41.101097   899 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.125705 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.125979   899 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:41.126443 30033 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:41.127406 30033 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:41.128420 30033 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:41.101956   985 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.129096   985 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:41.107100 30038 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:41.120955 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.121623   749 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:41.138089   749 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.130162 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.125263   870 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.142969   870 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.143054   948 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.143923 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.144587 30036 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:41.147173   945 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:41.154031 30031 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:41.132462 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.129518   985 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.134351 30037 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:41.135205   975 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:12:41.135993 30034 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:41.147275   967 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.158555 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.159294 30037 raft_consensus.cc:2368] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:41.160121 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.160740 30032 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:41.161041 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.161141 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.161582 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.161804 30033 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:41.161897 30038 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:41.162377 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.162621 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.162701 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.162902 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.163506 30031 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:41.162397 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.164217 30035 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:41.165148 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.135927   960 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.165946 30037 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:41.149441   938 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.166383 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.166972 30036 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:41.167503 30032 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:41.167646 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.169587 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.170208 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.133298 30030 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:41.063891   926 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.170790 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.204105 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.232407 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.232867 30037 raft_consensus.cc:2393] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:41.198091 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 139715us
I20260709 13:12:41.167689 30740 raft_consensus.cc:1240] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:41.178982 30029 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:41.235594   958 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:41.236841 30033 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:41.236920 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 308483us
I20260709 13:12:41.206219 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.238903 30032 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 3: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:41.239985 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.246019 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.233824 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.249788 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:41.226648 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.250908 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.230444 30732 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:41.253981   843 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.255313 30734 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:41.255232   870 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.256697   843 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.254541 30034 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:41.261755 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:41.153718   946 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:41.276919 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.277817 30033 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:41.278221   946 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.278774 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.279810   949 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:41.289780 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.290792 30029 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:41.305609 30036 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:41.312736 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.171175   938 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.312599 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:41.319782 30077 connection.cc:256] RPC call timeout handler was delayed by -1.6300138540000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:12:41.320248 30077 connection.cc:256] RPC call timeout handler was delayed by -1.6228138540000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:12:41.320083 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:41.320641 30077 connection.cc:256] RPC call timeout handler was delayed by -1.6203775000001315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:12:41.320940 30077 connection.cc:256] RPC call timeout handler was delayed by -1.5427138540001124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 13:12:41.322263   914 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:41.309731   899 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:12:41.323331 30739 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:41.315886   967 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:12:41.325289 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.170584   985 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.326290 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:41.321203 30077 connection.cc:256] RPC call timeout handler was delayed by -1.418513854000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 13:12:41.326812 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:41.326949 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2700286639999376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28650000000000003s for a response
I20260709 13:12:41.326287 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.327903 30183 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.328265 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.328639 30740 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:12:41.329879 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.327455 30033 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:41.316200 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:41.332942 30734 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:41.340579 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.341332 30179 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:41.341982 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2325669159999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:12:41.342224 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:41.342413 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2277138540000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:12:41.342794 30077 connection.cc:256] RPC call timeout handler was delayed by -1.1701286640000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29760000000000003s for a response
W20260709 13:12:41.343261 30077 connection.cc:256] RPC call timeout handler was delayed by -1.0531138540000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2251s for a response
I20260709 13:12:41.341992 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.347792 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.351557 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.352741 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.353609 30032 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:41.353803 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.352758 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.355336 30180 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:41.358269 30184 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.360687 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.361311 30182 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:41.361474 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.362296 30032 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:41.362193 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:41.317030   843 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.365906 30110 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:41.366150 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:41.366923 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.367712 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.395061 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.395648 30109 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:41.396447 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.396502 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.397720 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.398373 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.398737 30180 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:41.396446   870 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.400082 30180 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:41.401110 30112 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:41.363269 30037 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:41.314057   990 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:41.403095 30105 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:41.403347 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.403728 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.403483 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.403434 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:41.304654   958 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:12:41.404604 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.408479 30112 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:41.409386 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.410420 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.411226   926 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.411247 30180 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.415373 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.386024 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.408399 30178 raft_consensus.cc:2393] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:41.416543 30737 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:41.416312 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:41.418800 30737 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:41.421801 30183 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:41.422824 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.423316 30183 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.326164   807 consensus_queue.cc:1059] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:12:41.426154 30179 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:41.427134 30705 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.332410   949 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:12:41.428972   926 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.401574   843 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:41.406668   990 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.430212 30705 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.428671 30112 raft_consensus.cc:2410] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:41.429222 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.351188   948 consensus_queue.cc:1059] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:12:41.432682 30108 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:41.432945 30004 leader_election.cc:400] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:41.434324 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.404547   796 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:12:41.440953 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.435741 30183 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:41.436542 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:41.434551 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.442957 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:41.443691   796 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:41.444073   796 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:41.444250 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.431257   926 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.441608 30178 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:41.449599 30004 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:41.443650 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.447970 30182 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:41.442595   696 raft_consensus.cc:2804] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:41.451694   696 raft_consensus.cc:697] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:41.441274 30732 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:41.435475   843 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.409576   749 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:41.452705   696 consensus_queue.cc:237] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.457577 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.458393 30187 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:41.459684   997 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:41.460767   926 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:41.444701   963 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:12:41.462628 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.463302   963 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:41.464430   914 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:41.465068   914 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:41.465001   796 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.466420   796 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:41.466360   914 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:41.467114 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.450793 30179 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.470247 30184 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:41.472322 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:41.472776 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.473168 30185 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:41.474612 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.440369   987 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:41.489444 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.495379 30183 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:41.439637   990 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:41.497421 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.440665   959 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:12:41.437180   967 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:12:41.516409 30178 raft_consensus.cc:2410] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:12:41.518023 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.522053 30106 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:41.524900 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.526418 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.535723 30180 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
W20260709 13:12:41.537495 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 49701.2us
I20260709 13:12:41.539942 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.540923 30032 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:41.541069 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70350us
I20260709 13:12:41.496726   958 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:41.508802   986 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:41.546892   870 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:41.546852 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.550822 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.493590   865 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:12:41.517318 30179 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:41.516533   987 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:41.545413 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:41.551429 30178 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.558004 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.560788 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.561547 30180 raft_consensus.cc:2368] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:41.562682 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:41.567435 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.551232   985 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:41.583207 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.561434   864 raft_consensus.cc:3055] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:41.538182   952 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:41.559070   870 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:41.561667   986 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:41.561133   861 raft_consensus.cc:3055] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:41.571669   959 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:41.568776   988 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:41.561906   963 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:41.563428   945 consensus_queue.cc:1059] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:12:41.640429   958 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:41.592811   864 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:41.594847   997 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:41.612314   861 raft_consensus.cc:740] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:41.617024   959 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:41.658442 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 113373us
I20260709 13:12:41.632951   967 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:41.667778 30106 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:41.670580 30740 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:41.671239   959 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:41.672459   959 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.634608   949 consensus_queue.cc:1059] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:12:41.642230   988 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:41.675076 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.677443 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.677714 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.686190 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.687183 30182 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:41.695381 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:41.699014 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.705853 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.706230 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.706920 30184 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:41.708055 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.709746 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.711227 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.712481 30182 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:41.712668 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.713310 30186 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:41.713527 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.714202 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.714766 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.715276 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.703904 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.715984 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.716324 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.717028 30179 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:41.706840 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.717373 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.721325 30185 raft_consensus.cc:2368] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:41.722182 30187 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:41.719234 30186 raft_consensus.cc:2376] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9. Re-sending same reply.
I20260709 13:12:41.695557   865 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:41.723009 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 100459us
I20260709 13:12:41.728142 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.730736 30180 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:12:41.717880   995 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:12:41.738840 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:41.731957 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.732034 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.734208 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.682126   899 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:12:41.742400 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:41.745785 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:41.763792 30185 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:41.765193 30178 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:41.767938 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.769013 30182 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:41.729990   865 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:41.770344 30187 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:41.735984   967 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:41.774158 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.681066   870 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.777127 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.696040   987 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.779511 30106 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:41.784708 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.751428  1015 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:41.787323 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 109694us
I20260709 13:12:41.783680   696 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:41.802105  1001 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:12:41.804289 30181 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:41.718281   997 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.810842 30733 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:41.724706   861 consensus_queue.cc:260] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.785311   967 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:41.786808   914 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:41.817268 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.820845 30106 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:41.739967   986 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:41.825862  1000 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:12:41.828109  1002 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:12:41.830099   861 raft_consensus.cc:3060] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:41.783927   988 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.834537   865 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:41.837625 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 91896us
I20260709 13:12:41.751230   958 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.842116 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.752687   864 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:41.864439 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 66719.2us
I20260709 13:12:41.865612 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.874737 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:41.876093 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.879153 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:41.883598 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.881278  1012 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:41.892700   945 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:41.893625   967 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:41.796281  1015 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.881021   865 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.823766   914 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.815761   990 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.839792   952 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:12:41.884339   963 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:41.898358   949 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.931782 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:41.932569 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.916313  1018 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.170s	user 0.004s	sys 0.000s
I20260709 13:12:41.906574  1004 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:41.941740 30735 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:12:41.937382   696 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:41.938510 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:41.943733 30112 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:41.922356   864 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.946869 30736 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 5: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:41.927093  1016 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:41.948213 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 72171.6us
I20260709 13:12:41.939658   949 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:41.954893 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 171072us
I20260709 13:12:41.964730  1007 raft_consensus.cc:3055] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:41.965210  1007 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:41.966704  1014 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.299s	user 0.003s	sys 0.000s
I20260709 13:12:41.974336 30186 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:41.956907 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:41.941365  1004 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:41.994349 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.999822   796 consensus_meta.cc:287] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.002s
I20260709 13:12:42.001111 30183 raft_consensus.cc:2410] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:12:42.005502   926 consensus_meta.cc:287] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.004s
I20260709 13:12:42.006040   926 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.007429 30739 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:42.012568  1006 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:41.963142   949 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.013473  1006 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.014114  1006 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.023306 30112 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:41.943914   843 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:41.984865 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.034526   926 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.020041  1004 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.064659 30738 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:42.067767 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.076947 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 92192.5us
I20260709 13:12:42.073458 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.077948 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:42.076035 30001 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.686s (SENT) [suppressed 53 similar messages]
I20260709 13:12:42.092993 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.106621 30151 leader_election.cc:400] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:42.106956 30151 leader_election.cc:403] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:42.109982 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.110455 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:42.131870 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.066748  1030 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:42.082515   952 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:42.133188 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:42.133946 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54770.6us
I20260709 13:12:42.134311 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.138103 30107 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:42.143958 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.149585 30737 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:42.149819 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.150627 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.151996 30109 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:42.154974 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.076947  1020 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:12:42.081264   796 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:42.158567 30110 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:42.135898  1030 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:42.169003 30002 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:42.171756 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66199.9us
I20260709 13:12:42.173381 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.175917 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.178632 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.159298  1003 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:42.174153 30113 raft_consensus.cc:2376] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11. Re-sending same reply.
I20260709 13:12:42.077246  1007 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.131919  1040 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:42.172544 30151 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.187216  1017 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:12:42.190119   843 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.196512   949 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.199050 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet 76d91f22e2654dd1ae5451605e7a3b23 with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33114
I20260709 13:12:42.158349  1035 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:42.186903 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:42.169864   990 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.206010 30151 leader_election.cc:400] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:42.181696   952 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:42.207492 30151 leader_election.cc:403] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:42.105465  1045 consensus_queue.cc:1059] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:12:42.177274  1030 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.209237 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:42.213941 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.202950   914 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:42.183205   865 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7.
I20260709 13:12:42.182241  1003 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.164734  1006 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.210050   963 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:42.228521  1051 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:42.228616   963 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.228958  1051 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.227981 29930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 147) took 8634 ms. Trace:
W20260709 13:12:42.237250 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.203614  1040 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:42.247054 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:42.247845 30733 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:42.209061   952 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.233171 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.217650  1007 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:42.230304  1046 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:12:42.255375 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 179354us
W20260709 13:12:42.253968 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48101.2us
I20260709 13:12:42.253811 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.257153 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.253465   952 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.259663  1015 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:42.233819 29930 rpcz_store.cc:276] 0709 13:12:33.591120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.592065 (+   945us) service_pool.cc:224] Handling call
0709 13:12:42.225717 (+8633652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:40.719779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:40.720647 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:40.720717 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:12:40.720756 (+    39us) tablet.cc:662] Decoding operations
0709 13:12:40.924539 (+203783us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:40.930924 (+  6385us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:40.934529 (+  3605us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:40.983839 (+ 49310us) tablet.cc:701] Row locks acquired
0709 13:12:40.983905 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:12:40.984092 (+   187us) write_op.cc:270] Start()
0709 13:12:40.984243 (+   151us) write_op.cc:276] Timestamp: P: 1783602760984009 usec, L: 0
0709 13:12:40.984262 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:40.984928 (+   666us) log.cc:844] Serialized 3597 byte log entry
0709 13:12:41.463674 (+478746us) op_driver.cc:464] REPLICATION: finished
0709 13:12:41.533839 (+ 70165us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe2fc90ac 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe9b09ef0
0709 13:12:41.717175 (+183336us) write_op.cc:301] APPLY: starting
0709 13:12:41.717270 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:41.717544 (+   274us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:41.717577 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:41.824243 (+106666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:41.894602 (+ 70359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:41.894671 (+    69us) write_op.cc:312] APPLY: finished
0709 13:12:41.895063 (+   392us) log.cc:844] Serialized 71 byte log entry
0709 13:12:41.922330 (+ 27267us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:41.934458 (+ 12128us) write_op.cc:454] Released schema lock
0709 13:12:41.941599 (+  7141us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:42.020317 (+ 78718us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:42.024471 (+  4154us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2341826,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":253169,"apply.run_cpu_time_us":5209,"apply.run_wall_time_us":239020,"num_ops":9,"prepare.queue_time_us":88806,"prepare.run_cpu_time_us":49344,"prepare.run_wall_time_us":363760,"raft.queue_time_us":183118,"raft.run_cpu_time_us":17360,"raft.run_wall_time_us":141057,"replication_time_us":479238,"spinlock_wait_cycles":20367744,"thread_start_us":384020,"threads_started":4,"wal-append.queue_time_us":231566}]]}
I20260709 13:12:42.257352 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.225472  1049 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.266382 30111 raft_consensus.cc:2468] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:42.270632 30735 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:42.248848  1032 consensus_queue.cc:1059] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.179s
I20260709 13:12:42.272918   914 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:42.268934  1049 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.273929  1049 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.274067  1032 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:42.274567  1032 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.275507   945 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:42.275365  1032 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.275931   945 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:42.276377   945 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:42.282718 30110 raft_consensus.cc:1217] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Deduplicated request from leader. Original: 6.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:12:42.294982 30110 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:12:42.297906 30001 leader_election.cc:336] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.568s (SENT)
I20260709 13:12:42.267134  1023 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.300173   967 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:42.299760  1051 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:42.302351 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 61802.7us
W20260709 13:12:42.305276 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.304627 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.309044 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.309727  1055 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.310000  1015 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:42.310201  1055 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:42.276661  1032 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:42.310290 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.310671  1015 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.272946   963 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.318513  1015 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:42.317636 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.330449  1013 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:42.331307  1009 raft_consensus.cc:3055] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:42.331710  1009 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.332523  1009 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.333817  1009 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:42.333998  1057 tablet_replica.cc:333] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:12:42.328882 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.339501 30183 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:42.340754  1013 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.343298  1011 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:42.343030  1040 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.338404 30110 raft_consensus.cc:2376] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11. Re-sending same reply.
W20260709 13:12:42.346474 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.343808  1011 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.351037 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.307621   967 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.360387 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.365491 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:42.368697   959 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.000s
I20260709 13:12:42.324487  1045 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.369694  1045 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.313450  1055 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.256371  1035 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:12:42.384459 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.387235 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:42.390291 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 214445us
I20260709 13:12:42.389921  1003 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.391173 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.392220 30002 leader_election.cc:400] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:42.311691  1023 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.370122  1045 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.392989 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.371528  1013 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.395694 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.396595 30108 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:42.370374  1051 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.397642 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.398871 30105 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:42.403281  1011 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:42.405040 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.395287  1019 raft_consensus.cc:2764] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:42.394246  1020 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:42.409126 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 487) took 1100 ms. Trace:
I20260709 13:12:42.409245  1017 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:42.382205   959 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:42.400446   997 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:42.413645 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.417294 30183 raft_consensus.cc:1275] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:42.418807  1023 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.420213 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:42.420297  1017 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:42.422672 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.422326  1017 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.423525  1017 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.425037   945 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.426160 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:42.426962 30179 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:42.427254 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.410836 30736 rpcz_store.cc:276] 0709 13:12:41.308548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.308694 (+   146us) service_pool.cc:224] Handling call
0709 13:12:42.408896 (+1100202us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54001c1bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:42.409061 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388586240}
I20260709 13:12:42.428580 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:42.429239 30183 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.397982  1058 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:42.379407   952 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.398665  1035 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.404750  1011 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:42.442085 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46423.7us
I20260709 13:12:42.407191  1013 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.441164 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.443994 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.447748   997 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:42.448220   997 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.448284  1019 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:42.449654  1025 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.293s	user 0.003s	sys 0.001s
I20260709 13:12:42.449218   997 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.450588   997 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:42.452384  1027 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:12:42.454774   952 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.436465  1035 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.455484  1035 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.455725  1013 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.456200  1013 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.458501 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.478931 30734 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:42.487157 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.398144   967 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:42.507808 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64725.2us
W20260709 13:12:42.509634 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 62068.2us
I20260709 13:12:42.509727   967 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.510015  1058 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:42.511042 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.511626 30111 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:42.512375 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.514237 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.518874 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.520318   952 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:42.521477   952 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:42.521908   952 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.522797   952 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.523976   952 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.525949  1019 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.526445  1019 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:42.526870  1019 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.528102  1031 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:42.528626  1031 raft_consensus.cc:697] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.534374 30105 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:42.519615 30112 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:42.510782  1058 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.542923 30187 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:42.549162 30737 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:42.557544 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:42.549577 30183 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
W20260709 13:12:42.560809 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.562240 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:42.562999 30733 raft_consensus.cc:2410] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:42.566346 30180 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:42.567631 30179 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:42.537568   963 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:42.580351   949 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.562282   985 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.582067   985 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.584438   985 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.590826 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.569324  1007 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.612444 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:42.616011  1047 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.404s	user 0.000s	sys 0.002s
I20260709 13:12:42.570649   644 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:12:42.585959   865 raft_consensus.cc:3055] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:42.586604   945 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.592476   987 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.628132 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 117182us
I20260709 13:12:42.617340  1049 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.547087  1059 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 13:12:42.633169 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.627061   644 consensus_queue.cc:1243] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:42.635720 30187 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:12:42.638551 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 125285us
I20260709 13:12:42.574707  1040 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:12:42.624017   865 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.621757  1007 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.634469  1013 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.624151  1051 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:42.642316   796 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.642525   949 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.625106  1015 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.684029 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.586366  1031 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:42.660108  1004 consensus_meta.cc:287] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.005s
I20260709 13:12:42.631163   987 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.660367   861 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:42.662125  1058 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:42.668062  1003 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.670233   865 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.677860 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:42.678257 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.679770 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.682034 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.684926 30030 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:42.696309 30036 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:42.712644 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.693328   861 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:42.686268   949 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.715581   865 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.732674 30030 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:42.733960 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.685870   796 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.719619  1032 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:42.748795  1057 raft_consensus.cc:2243] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.750170  1057 raft_consensus.cc:2272] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.753701 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:42.754364  1057 ts_tablet_manager.cc:1916] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:42.754407 30110 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:42.755726   987 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:42.737989 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 49850.4us
W20260709 13:12:42.757678 30077 connection.cc:256] RPC call timeout handler was delayed by -1.7703439629999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3103s for a response
I20260709 13:12:42.763358 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:42.764109 30179 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:42.766243  1019 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.717485   926 consensus_queue.cc:1048] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:12:42.769384  1019 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.745110   796 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:42.770969   861 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.772414   861 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:42.771636 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.774966   949 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:42.777513 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.778074 30001 leader_election.cc:336] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.709s (SENT)
W20260709 13:12:42.778569  1030 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:12:42.778961  1030 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.783653 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:42.698050  1004 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.778447 30001 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.788363 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.788580 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.790891 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.801060 30032 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:42.802378 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.803754 30705 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:42.714866  1045 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.810132 30030 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:42.813457 30030 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:42.810230 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.815233 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.816881 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.817497 30032 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:42.818147 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.819744 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.822230   899 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:42.822659   899 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:42.822907 30110 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:42.823058   899 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.816186   987 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:42.814239 30030 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.824702 30030 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.824957 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.825700 30036 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:42.826498  1045 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.829509  1008 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:42.832755   899 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:42.833277 30037 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:42.833595  1023 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:42.833750  1012 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:42.834127  1023 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:42.835148  1023 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:42.835830   899 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.842278  1049 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.842604 30034 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.845326 30704 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:42.718596  1055 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:42.819399 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 82682.1us
I20260709 13:12:42.847380 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.824007   987 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:42.848496 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 70446.6us
W20260709 13:12:42.862345 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 47228.9us
W20260709 13:12:42.852145 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.841197 30030 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:42.865809 30030 pending_rounds.cc:85] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 6
I20260709 13:12:42.853364 30038 raft_consensus.cc:2410] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:42.862929 30151 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.863329 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:42.874529 30185 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:42.875893 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.875991 30032 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:42.866094 30030 pending_rounds.cc:107] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:42.880476 30030 raft_consensus.cc:2889] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:42.865868   987 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.886070 30035 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:42.887888 30035 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:42.861029   952 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:42.891683 30035 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:42.894682 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.873119   644 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.870568   986 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:42.907460 30038 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:42.907936 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:42.873514  1051 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:42.895529 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c1b7d91eea54fb4990789f41041df86 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50288
I20260709 13:12:42.906754 30734 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:12:42.906816 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.898149  1032 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.873435   843 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:42.893791  1030 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.925730 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:42.875566   960 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:12:42.905218   644 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:42.907511   986 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.885486  1040 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:12:42.940476  1010 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:42.942003  1006 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.913244  1049 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:42.948395 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.972368 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.977845 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.989866 30031 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:42.948498 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:42.947521 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.990742 30038 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:42.950536 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:42.990890 30036 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:42.971103 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:42.992261 30034 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:42.992832 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 129921us
W20260709 13:12:42.994957 30001 leader_election.cc:336] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.827s (SENT)
I20260709 13:12:42.999468 30033 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:42.918504  1007 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:43.010387 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 143246us
I20260709 13:12:43.011035 30151 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
W20260709 13:12:43.007058 30001 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.902s (SENT)
I20260709 13:12:43.011389 30151 leader_election.cc:403] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:12:42.945271  1017 consensus_meta.cc:287] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 13:12:42.970536  1020 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:43.011307 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.012526 30179 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:42.935503  1009 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:43.011792 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:42.953861  1015 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:42.954955  1004 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:42.953634   864 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.991994   986 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.991657   644 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.950026  1055 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:43.048465 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.043255 30179 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:43.039754 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.049316 30185 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:42.991315  1010 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:42.991925  1012 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.040302 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.051144 30187 raft_consensus.cc:2410] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:12:43.043745 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 180493us
I20260709 13:12:43.044524 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:42.933988  1064 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:12:43.057343 30034 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:42.951300  1035 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.061861 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.021849  1013 raft_consensus.cc:2764] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:12:43.068367 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 163979us
W20260709 13:12:43.030436 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.093621 30186 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:43.041702  1045 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.090186 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.047894  1008 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.100314 30734 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.057466  1007 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.046550   864 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:43.101251 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:43.111100 30038 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.111522 30038 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:43.112720 30034 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:43.113276 30032 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:43.112347 30151 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.059803   899 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:43.126245 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:43.125989 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.123232 30183 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:43.131242 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.098707  1020 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:43.099777  1008 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.110826   864 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.065647  1012 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.114488  1030 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.141284 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.143373 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.134418   914 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:43.133577   952 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.162922   899 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:43.166512 29932 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.167694  1012 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.147859  1008 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.168164 30035 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:43.168541 30038 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.133589  1010 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.170840 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:43.174003  1020 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.188452  1003 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:43.144717  1084 tablet_replica.cc:333] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:12:43.193166 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:43.194344 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.202337 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.157302  1064 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:43.208516 30113 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:43.235224 30113 pending_rounds.cc:85] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:12:43.235505 30113 pending_rounds.cc:107] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:43.235737 30113 raft_consensus.cc:2889] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.209365 30035 pending_rounds.cc:85] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 6
W20260709 13:12:43.208829 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 77651.9us
I20260709 13:12:43.211252 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.217489 30181 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:12:43.236728 30181 pending_rounds.cc:85] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 5
I20260709 13:12:43.237288 30181 pending_rounds.cc:107] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:12:43.237625 30181 raft_consensus.cc:2889] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.217563 30038 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.217856  1089 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.221290  1019 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:12:43.221611 29932 catalog_manager.cc:5697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.224403   644 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.136889  1085 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:12:43.226389 30178 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:12:43.227443  1007 consensus_queue.cc:1175] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d2f11cccca04a7683da4080ab797bd7" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:12:43.228770  1076 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:12:43.236449 30035 pending_rounds.cc:107] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:43.264129 30035 raft_consensus.cc:2889] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.190896   938 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:43.220178  1057 ts_tablet_manager.cc:1929] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:12:43.238847 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.239935 30186 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:43.156301  1081 consensus_queue.cc:1059] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:12:43.126315  1082 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:12:43.243765 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:43.249722 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.250555  1089 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.252091 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.338351 30178 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:43.339341 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.340080 30178 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:43.338382 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74807us
I20260709 13:12:43.351334 30111 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:43.238261   952 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:43.358676  1088 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:43.362540  1081 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:43.362982  1081 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:43.363822  1081 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.365031  1081 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:43.365953 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 122282us
I20260709 13:12:43.366900  1007 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:43.367270  1007 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:43.367479  1035 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.367642  1007 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.371366 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.372195  1004 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:43.373977 29932 catalog_manager.cc:5697] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.375636 29932 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.263706  1012 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.381965 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 144297us
I20260709 13:12:43.391907 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.377377 29932 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:43.394157 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.391772 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:43.403002 30739 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:43.393160 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:43.403435 30733 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:43.404004 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 230979us
I20260709 13:12:43.424564 30038 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:43.245955  1064 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:43.284349   865 consensus_meta.cc:287] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
I20260709 13:12:43.415376  1049 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:43.429280 30035 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:43.432466 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.240924   985 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:12:43.239835  1003 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.186s
I20260709 13:12:43.436853 30153 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:43.263880   914 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.383636  1084 raft_consensus.cc:2243] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:43.438779 30179 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:43.382174  1023 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:43.440591 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.452266 30186 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:43.445693 29932 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.435434  1057 log.cc:1199] T 76d91f22e2654dd1ae5451605e7a3b23 P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/76d91f22e2654dd1ae5451605e7a3b23
W20260709 13:12:43.447022 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 354823us
W20260709 13:12:43.455389 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 220561us
I20260709 13:12:43.436286 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.383569  1089 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.457993 30178 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:43.382346  1035 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:12:43.434752  1049 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:43.464510 30181 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.405041   987 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.382647  1012 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.438437   952 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:43.474400 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:43.441325  1015 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:43.451666   865 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:43.476363 30002 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.452801  1068 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:43.490438 30735 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:43.461165  1023 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:43.491070 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:43.493310 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.494930 30734 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:43.499691 30186 raft_consensus.cc:2410] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:43.451474   914 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.505867 30032 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:43.520651 30032 pending_rounds.cc:85] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 8
I20260709 13:12:43.521059 30032 pending_rounds.cc:107] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:43.521369 30032 raft_consensus.cc:2889] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.463982 30038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:43.506809  1017 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.507912  1010 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.507598  1008 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.470000  1090 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:12:43.468343  1089 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:12:43.499482   959 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.510172  1012 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.510377 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:43.543303 30034 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:43.510628   861 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:43.488536   952 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.511696  1080 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:12:43.511857  1023 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.513469  1092 consensus_queue.cc:1059] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:43.522464 30038 raft_consensus.cc:606] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:43.534754 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:43.528733   938 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:43.503489  1004 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:43.545122 30738 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.548261 30035 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:43.553709 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.539415   959 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.565347 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:43.562127 30038 raft_consensus.cc:614] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:43.505494  1064 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.554205   952 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:43.530489  1017 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.502497   865 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.561285   644 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.574024   959 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.586862 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:43.553635  1049 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.550762   986 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.576856  1004 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:43.593859  1008 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.578576  1015 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:43.601298  1045 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:43.624449   914 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.606010  1057 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33114 (request call id 82) took 1407 ms. Trace:
W20260709 13:12:43.625204  1091 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:12:43.614813  1017 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:43.626166  1049 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.589704  1007 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.635391  1007 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.636905 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:43.637764 30734 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:43.639420 30184 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:43.625195  1057 rpcz_store.cc:276] 0709 13:12:42.198320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.198610 (+   290us) service_pool.cc:224] Handling call
0709 13:12:42.333492 (+134882us) ts_tablet_manager.cc:1151] Deleting tablet 76d91f22e2654dd1ae5451605e7a3b23
0709 13:12:42.333597 (+   105us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:12:42.958500 (+624903us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:43.219982 (+261482us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:43.605926 (+385944us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413391,"tablet-delete.queue_time_us":123351,"thread_start_us":107955,"threads_started":1}
W20260709 13:12:43.604892  1095 log.cc:927] Time spent T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:12:43.630371  1093 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:43.640406 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:43.641111 30038 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.609846 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:43.622764   864 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.645381 30736 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.646503   864 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.646773  1004 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.653825   938 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:43.654448   938 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.660185   952 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.663132 30181 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:43.664141 30186 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.665139 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.632931   987 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:43.591596 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:43.674095 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82593.5us
I20260709 13:12:43.677809 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.682017 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:43.682088 30181 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:43.669206  1007 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:43.702363 30038 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
W20260709 13:12:43.721163 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 43745us
I20260709 13:12:43.722052 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.680090  1082 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:43.730595 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:43.732295 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:43.732919 30038 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:43.739228 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.720763   914 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.740567 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:43.741225 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:43.684643  1081 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:12:43.744172  1081 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.744315 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.744583  1081 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:43.724256  1087 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.746098 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:43.729174  1082 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:43.728286  1007 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:43.744988  1081 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.741732   861 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.760984 30186 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:43.747342   644 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:43.766418  1007 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.747076  1085 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.752966  1010 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:43.754586  1082 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.774113 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.753099  1072 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.783758  1072 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.786139  1072 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.787699   952 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.776654 30032 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:43.754683  1099 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:43.789024  1099 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:43.789423  1099 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.791308  1049 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:43.793480   861 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:43.794831 30182 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:43.775830   644 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:43.796046   644 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.797781 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:43.798482 30734 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:43.799278 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:43.777839 30185 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:43.757074  1003 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.783041  1010 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.754870  1015 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.801072 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.783419   938 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.792115   959 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.762012  1045 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.812840 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.749128   914 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.821990 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:43.856819  1098 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.811579   861 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:43.831902 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.862959 30077 leader_election.cc:400] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:43.862236   864 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.816434  1010 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.866442 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:43.816709  1087 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:43.854105   952 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.866439  1107 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:12:43.817006  1015 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.870268  1089 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:43.873944  1105 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:12:43.854027  1045 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.813700  1003 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.869699  1085 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:12:43.874786   864 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:12:43.889632  1089 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.910053  1089 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.910650  1099 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.912262  1045 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.876339   865 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:43.901216 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:43.914744 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:43.914299  1082 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.915521   985 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:43.915916   985 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:43.879290 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet 76d91f22e2654dd1ae5451605e7a3b23 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:12:43.917932  1082 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.918994  1098 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:43.926047  1083 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.926671  1083 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.926206  1099 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:43.921644 30001 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.566s (SENT)
I20260709 13:12:43.866801   861 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.899408   914 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:43.894774   959 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:43.908324   967 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:43.875048   952 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.907992  1015 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:43.965243  1081 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.929350  1083 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:43.923050  1087 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:43.467609 29932 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:43.992242  1088 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.916832   985 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:43.907437 30002 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:44.161008 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 239390us
I20260709 13:12:44.162561   861 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:44.429141 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.429378  1032 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.478015  1032 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.478482  1058 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.479090  1058 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:44.480355  1032 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:44.227329 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 358548us
I20260709 13:12:44.481201 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.483024 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.484565   861 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:43.931221   865 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:44.485716   865 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.486683   861 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:44.487995   865 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.488574   865 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.263660  1003 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.264321   914 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.272660 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.280859  1099 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.491248  1090 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:44.491662  1099 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.492054  1090 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:44.493922  1099 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.493862 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.285063 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.495857 30077 leader_election.cc:400] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:44.496019 30110 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:44.496181 30077 leader_election.cc:403] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:44.290678  1084 raft_consensus.cc:2272] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.497663   864 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:44.498406   864 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:44.500048  1090 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:44.500963  1084 ts_tablet_manager.cc:1916] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:44.468459 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.502307 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.297523 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 1995) took 1094 ms. Trace:
I20260709 13:12:44.503334 30184 rpcz_store.cc:276] 0709 13:12:43.202602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.202838 (+   236us) service_pool.cc:224] Handling call
0709 13:12:43.639222 (+436384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.639878 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.297204 (+657326us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54001eb9d0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:44.297346 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968578816}
I20260709 13:12:44.503963 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.305377 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:44.504616 30178 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:44.318639  1113 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.326409 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 867) took 1448 ms. Trace:
I20260709 13:12:44.505350 30735 rpcz_store.cc:276] 0709 13:12:42.877741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.877972 (+   231us) service_pool.cc:224] Handling call
0709 13:12:42.897089 (+ 19117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.494877 (+597788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.326131 (+831254us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54005d7ad4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:44.326325 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364139776}
I20260709 13:12:44.331516   986 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:44.471019  1081 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.494587  1099 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:12:44.471216  1088 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:44.507131 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.507709 30178 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.507597  1088 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.508596  1088 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.471587   985 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:44.509732  1032 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:44.510152  1032 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.510476  1032 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.489019   865 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.334933 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.514112 30032 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:44.472115 29932 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:44.335915 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.515107 30111 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:44.515708   865 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:44.515452 29932 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.337316 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 1993) took 1135 ms. Trace:
I20260709 13:12:44.337745 30109 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:44.517616 30186 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.473147  1015 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.341734 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.517783 29932 catalog_manager.cc:5697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 3 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.518522  1015 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.518863 30105 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:44.341077 30004 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:44.519901 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 178895us
I20260709 13:12:44.519537 29932 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.520594  1015 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:44.472965  1009 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.352331 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43012 (request call id 624) took 1258 ms. Trace:
I20260709 13:12:44.521441  1009 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.521555 30736 rpcz_store.cc:276] 0709 13:12:43.093781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.094433 (+   652us) service_pool.cc:224] Handling call
0709 13:12:43.102526 (+  8093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.645827 (+543301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.352076 (+706249us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400650c54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:44.352263 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248030976}
I20260709 13:12:44.522190   967 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.522615   967 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.522966   967 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.523507  1009 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:44.384109 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.418429  1080 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:44.309419 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:44.479974  1058 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:44.527863 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 218510us
I20260709 13:12:44.472620 30113 raft_consensus.cc:1240] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:44.505374  1113 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.168066  1010 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.489902   914 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.532070  1010 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:44.472923 30001 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.703s (SENT)
I20260709 13:12:44.533118 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.533560   914 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:44.527944 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:44.534036 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61147.2us
I20260709 13:12:44.534214   914 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:44.504108 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet 42209a176ad44af88b5b1710846183cb: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:44.320075  1012 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:44.536657   959 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.506160 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.472812   952 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:44.471922 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 564520us
I20260709 13:12:44.471935 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.536660  1012 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:44.542935  1012 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.544107  1012 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:44.545266 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.545598   986 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:44.517544 30183 rpcz_store.cc:276] 0709 13:12:43.201969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.202105 (+   136us) service_pool.cc:224] Handling call
0709 13:12:44.337116 (+1135011us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54003b0954. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:44.337253 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231456000}
I20260709 13:12:44.546630 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.546977 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.527896 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:44.547556 30035 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:44.547766 30734 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
W20260709 13:12:44.472715 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.548558 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.549350 30034 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:44.527211 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.550096 30030 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:44.550486 30184 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:44.525691  1080 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.537200   959 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.551517 30032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "396297d3a2474246b40507f61f59858c"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:44.552042 30032 raft_consensus.cc:606] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:44.552357 30032 raft_consensus.cc:614] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:44.552553  1080 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:44.552755   959 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.334031  1007 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:44.553529  1007 consensus_queue.cc:1243] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:44.549260  1064 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.554032  1003 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:44.554068  1064 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.554596  1003 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:44.554764  1064 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.555557  1003 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.556792  1003 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.545975 30038 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:44.560287 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.561094 30036 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:12:44.541981 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70128.9us
I20260709 13:12:44.531827  1113 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:44.563109  1113 consensus_queue.cc:1059] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:44.563908  1090 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:44.564275  1090 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:44.566329 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:44.550885 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:44.567626 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.568399 30181 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:44.568288 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.568661 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.568949 30185 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:44.569744 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.569921 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.570363 30179 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:44.570663 30185 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.569324 30036 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
W20260709 13:12:44.566162 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70421.9us
I20260709 13:12:44.572544 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:44.573050 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:44.573729 30038 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:44.575508 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:44.576171 30038 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:44.579336 30178 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:44.597750 30183 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:44.590076 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:44.580722 30185 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:44.582525 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:44.587721 30179 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:44.588765 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.588658  1083 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:44.589359   644 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:44.592633 30186 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:44.606549 30182 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:44.587903 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:44.429124 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2348) took 1200 ms. Trace:
I20260709 13:12:44.596037 30111 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:12:44.597096 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.610342 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.615572 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.626951 30178 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:12:44.628477 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.629333 30186 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:44.633282 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.608475 30187 rpcz_store.cc:276] 0709 13:12:43.228377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.641487 (+413110us) service_pool.cc:224] Handling call
0709 13:12:44.341737 (+700250us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b5800003f98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:44.341899 (+   162us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:44.342331 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.342376 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:44.343200 (+   824us) log.cc:844] Serialized 52 byte log entry
0709 13:12:44.426985 (+ 83785us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:44.427027 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.427102 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:44.428779 (+  1677us) raft_consensus.cc:1685] finished
0709 13:12:44.428796 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:44.429045 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2472,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":18400896,"thread_start_us":83355,"threads_started":1,"wal-append.queue_time_us":83709}
I20260709 13:12:44.634665 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.644086 30038 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:44.623960 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:44.475976  1089 consensus_meta.cc:287] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.565s	user 0.004s	sys 0.006s
I20260709 13:12:44.609615  1081 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:44.609757   644 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:44.660475 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 72649.1us
I20260709 13:12:44.667982 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.668356 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.669195 30107 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.670855 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:44.672410 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 121587us
I20260709 13:12:44.675437 30182 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:44.624023  1045 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:44.629966   861 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:44.595835   986 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:12:44.704209 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.681715 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.706192 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.682652 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.666167 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.701016 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.709250 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.658576   865 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:44.668932 30104 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:44.717067 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.718837 30109 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:44.695801 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.719779 30184 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:44.695951 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.699009 30038 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:44.701912 30030 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:44.658226  1055 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.737972 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.738867 30110 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:44.651845  1049 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:44.706073 30105 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:44.686674 30187 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:44.624131   959 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:12:44.657761  1007 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.707194 30113 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:44.609908  1090 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.766351 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.766722 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:44.767529 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.768565 30104 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:44.769260 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.693320  1045 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.774534 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.775331 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.770087 30109 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 3.
W20260709 13:12:44.764652 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173659us
I20260709 13:12:44.767784 30034 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:44.777169 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.731173  1127 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:44.762296 30108 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:44.698681  1010 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:44.698453  1009 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.774063 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:44.743898   865 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.679677  1081 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:44.680155   644 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.778532 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.779541 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.843212 30104 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:44.784672 30105 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:44.793167 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.793884 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.794492 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.844705 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:44.845551 30186 raft_consensus.cc:2368] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:44.844741 30183 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:44.794703 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.847784 30179 raft_consensus.cc:2368] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:44.848879 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.793171 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.850224 30182 raft_consensus.cc:2368] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:44.794692 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.775679 30113 raft_consensus.cc:2410] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:44.865978 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.866814 30186 raft_consensus.cc:2368] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:44.808969 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.869746 30109 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:44.809899  1009 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:44.810930 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.877941 30187 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:44.811609 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.812429  1130 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:44.882051 30184 raft_consensus.cc:2368] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 8.
I20260709 13:12:44.780436  1127 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.816928  1015 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:44.913595 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 71573us
I20260709 13:12:44.914120 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.785009  1045 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.763160  1049 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.843451 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.770924  1007 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.685530  1089 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.703493   967 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.915573 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.916555 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.738440  1055 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.970541 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.972189 30178 raft_consensus.cc:2376] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8. Re-sending same reply.
I20260709 13:12:44.918617 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.973790 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:44.921114 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet 0d31c2ecc47149adb9b7dd839def365c: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:44.974218 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.926501 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.929117 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.937570 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.975308 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:44.976007 30184 raft_consensus.cc:2368] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:44.924952 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:44.843706   865 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.890753  1090 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.974850 30187 raft_consensus.cc:2376] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8. Re-sending same reply.
I20260709 13:12:44.988354 30110 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:44.988286 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.990617 30108 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:44.890050  1081 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:44.975083  1055 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.979998 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.992027 30109 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:44.913769  1127 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.976470 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.996378 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:44.822448  1010 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:44.927524  1049 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:45.003903 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:45.013441 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 388070us
I20260709 13:12:44.927322  1007 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.015338 30184 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:45.016079 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:44.912878  1096 consensus_queue.cc:1059] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:12:45.022119 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:44.996285 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 219074us
I20260709 13:12:45.024354 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.021147 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:45.017812 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 277037us
I20260709 13:12:45.028228 30704 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:45.027236 30108 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:45.027333 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.037333 30105 raft_consensus.cc:2368] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9.
I20260709 13:12:45.021133 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:45.012967 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 448202us
W20260709 13:12:45.040472 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08002276a0 after lost signal to thread 28925
I20260709 13:12:45.044148 30734 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:45.045670 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:45.084349 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800227940 after lost signal to thread 29970
W20260709 13:12:45.085995 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800228100 after lost signal to thread 30062
W20260709 13:12:45.087378 29967 debug-util.cc:398] Leaking SignalData structure 0x7b080030bf00 after lost signal to thread 30137
W20260709 13:12:45.087725 29967 debug-util.cc:398] Leaking SignalData structure 0x7b080035c500 after lost signal to thread 30138
W20260709 13:12:45.089002 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800290520 after lost signal to thread 30211
W20260709 13:12:45.049886 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.053275 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.053476  1096 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:45.054297 30179 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.101141 30179 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:45.001221  1092 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.053172 30077 leader_election.cc:400] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.109668 30077 leader_election.cc:403] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.056646 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.058385 30032 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:45.059479 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:45.059748 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:45.110795 30038 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:45.111042 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:45.111645 30032 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:45.112555 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:45.059158 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.061246 30033 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:12:45.114604 30150 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.522s (SENT)
I20260709 13:12:45.114851 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:45.115433 30150 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.548s (SENT)
I20260709 13:12:45.115912 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:45.116202 30150 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.562s (SENT)
W20260709 13:12:45.116954 30150 leader_election.cc:336] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.562s (SENT)
I20260709 13:12:45.062709 30107 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:44.921072  1130 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.118016 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.118690 30107 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:45.119401 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.119568  1130 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.119866 30107 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:45.064126 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:45.065909  1135 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:45.117183 30033 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:45.121472 30186 raft_consensus.cc:2410] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:45.068786 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:45.070007 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.122786 30038 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
W20260709 13:12:45.123258 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.117327 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.071085  1004 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:45.125382  1004 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:45.126778 30150 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.676s (SENT)
I20260709 13:12:45.126453  1004 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.127496 30107 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
W20260709 13:12:45.127739 30150 leader_election.cc:336] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.679s (SENT)
I20260709 13:12:45.127990  1004 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:45.128123 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.128392 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.129881 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:44.925846  1015 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.064754 30104 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:45.136245 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.080092 30002 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:45.094513 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.097268 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:45.089339 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800300440 after lost signal to thread 30212
W20260709 13:12:45.117246 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.132057 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:45.133262 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 80243.5us
I20260709 13:12:45.104424 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.138322 30105 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:12:45.146725 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7900 after lost signal to thread 30765
W20260709 13:12:45.147614 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800298700 after lost signal to thread 30766
W20260709 13:12:45.101218  1111 log.cc:927] Time spent T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:45.194365   967 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:45.245581  1032 consensus_meta.cc:287] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.002s
I20260709 13:12:45.192407 30105 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:45.177666  1135 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:45.187881  1148 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.176774 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.310667 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.283663   959 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.176934 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:45.194088 30181 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:45.188463  1142 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:45.148699 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8f80 after lost signal to thread 1078
I20260709 13:12:45.321914  1135 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.189265  1136 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.139559 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.324484 30109 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:45.108785  1019 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:45.329804  1019 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:45.100135   952 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:45.330914   952 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.178889 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:45.280535  1058 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:45.150991  1088 consensus_meta.cc:287] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 13:12:45.134708 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:45.344956 30736 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
W20260709 13:12:45.318984   938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.006s	sys 0.021s
I20260709 13:12:45.102721  1040 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.180289 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.109563  1013 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:45.100883  1099 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:12:45.137311  1092 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.102188  1087 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:12:45.249581  1089 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.333942   914 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:45.253247  1151 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:45.254334 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:45.254619  1133 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:45.255420  1023 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:45.256125  1147 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:45.354199  1003 consensus_meta.cc:287] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.005s
I20260709 13:12:45.260257 30705 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.268185  1141 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:45.186443 30107 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:45.294095  1009 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:45.295215  1045 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:45.297259  1132 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:45.301728  1015 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:45.301870 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.304955  1064 consensus_meta.cc:287] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.002s
I20260709 13:12:45.387094 30108 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:12:45.363206  1121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.010s	sys 0.009s
I20260709 13:12:45.317948 30104 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:45.320601 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 145129us
I20260709 13:12:45.396366 30104 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:12:45.359916   952 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.333858 30030 raft_consensus.cc:1813] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Handling vote request from an unknown peer 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.399863 30030 raft_consensus.cc:2410] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 8 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:45.100342  1096 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:45.347146 30112 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 9.
W20260709 13:12:45.402396 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 274660us
I20260709 13:12:45.251752  1055 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:45.360193 30178 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:45.373576  1010 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.290495  1032 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.348718  1058 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:45.383134 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 122969us
I20260709 13:12:45.316860 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.423755 30105 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:45.174304 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:45.397919 30001 leader_election.cc:336] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.657s (SENT)
W20260709 13:12:45.426090 30001 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.775s (SENT)
I20260709 13:12:45.343956   959 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.404592 30104 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:45.405565 30150 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.688s (SENT)
I20260709 13:12:45.367698 30109 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:45.429847 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:45.395149  1121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.009s
I20260709 13:12:45.353303  1040 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.435246 30183 raft_consensus.cc:2368] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9.
I20260709 13:12:45.435827 30105 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:45.399053  1015 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:45.397020   926 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:45.398344  1009 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.396366 30107 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:45.427376 30001 leader_election.cc:336] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.800s (SENT)
W20260709 13:12:45.449855 30001 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.804s (SENT)
W20260709 13:12:45.431187 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.431619 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 176087us
I20260709 13:12:45.432902 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.318969  1148 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:45.436450 30150 leader_election.cc:336] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.697s (SENT)
I20260709 13:12:45.445065 30185 raft_consensus.cc:2368] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.407786   864 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:45.342222  1142 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.476694 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 396650us
I20260709 13:12:45.556591 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:45.455628 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.454849 30077 leader_election.cc:400] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
W20260709 13:12:45.522374 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 70022.7us
I20260709 13:12:45.398074  1064 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.527720 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 94928.2us
I20260709 13:12:45.384336  1019 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.546825 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 87185.3us
W20260709 13:12:45.599531 30001 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.934s (SENT)
I20260709 13:12:45.600039 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:45.446146  1010 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:45.530941  1122 log.cc:927] Time spent T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.714s	user 0.002s	sys 0.001s
I20260709 13:12:45.410033   952 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:45.556586 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:45.610677 30112 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:45.558363 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:45.583545 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 128802us
I20260709 13:12:45.612396 30736 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.612951 30077 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:45.613523 30077 leader_election.cc:403] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.542924  1083 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:45.590790 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.535837   926 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:45.604424 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 167997us
W20260709 13:12:45.617991 30150 leader_election.cc:336] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.711s (SENT)
I20260709 13:12:45.618610 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.453022  1015 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:45.673749 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 83156us
I20260709 13:12:45.450539  1137 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 13:12:45.674580 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:45.676718 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.522975  1009 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.680640 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 65829.2us
I20260709 13:12:45.694746 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:45.604365  1049 consensus_meta.cc:287] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.000s
I20260709 13:12:45.705991 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:45.726329 30036 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
W20260709 13:12:45.710618 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.723662 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet cfbfe72ddc624143b4f12cb68c249a4e: Illegal state: Replica 34f51764a89048468a6faa21020812b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:45.705122 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:45.729029 30030 raft_consensus.cc:2393] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:45.724218 30184 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:12:45.732345 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 119601us
I20260709 13:12:45.732764 30037 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:45.733263 30077 leader_election.cc:400] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:45.735728 30077 leader_election.cc:400] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:45.736023 30077 leader_election.cc:403] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:45.683461  1140 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
I20260709 13:12:45.783150 30182 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:45.785513 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 207307us
W20260709 13:12:45.738272 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 168199us
I20260709 13:12:45.790023 30183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
W20260709 13:12:45.790947 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.732612  1007 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
W20260709 13:12:45.793810 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 175867us
I20260709 13:12:45.672262  1141 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.620568  1083 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:45.544094  1096 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.786396 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:45.806393 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 206894us
I20260709 13:12:45.810564 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:45.811033 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 75431.3us
I20260709 13:12:45.815528 30037 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:45.815807 30077 leader_election.cc:400] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.816115 30077 leader_election.cc:403] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.816661 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.818645 30736 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:45.699595  1155 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.780880  1010 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:45.601279  1058 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:45.801091  1099 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:45.859604 30182 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:45.797250  1013 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:45.859033 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 70506.1us
I20260709 13:12:45.905207 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:45.840276  1138 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:45.670773   952 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:45.739794  1134 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:45.883163 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 67483.1us
I20260709 13:12:45.813448  1083 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:45.915234  1013 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.898658 30183 raft_consensus.cc:606] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:45.917960 30183 raft_consensus.cc:614] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:45.811311   986 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:45.740015  1165 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
W20260709 13:12:45.805435  1012 consensus_meta.cc:287] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.261s	user 0.015s	sys 0.000s
W20260709 13:12:45.910861 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 94295.1us
I20260709 13:12:45.923448 30077 leader_election.cc:400] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 8.
I20260709 13:12:45.923811 30077 leader_election.cc:403] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:45.923606 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:45.915169  1134 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:45.919188 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:45.735350  1049 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:45.862705  1162 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.805500  1007 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.947055 30001 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.204s (SENT)
I20260709 13:12:45.947660 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:45.874727  1045 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:45.884177  1099 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:45.906104  1092 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:45.923151  1055 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:45.936448  1134 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:45.980014 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 67261.7us
W20260709 13:12:45.988309 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 193710us
I20260709 13:12:45.989923 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:45.922554   914 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:45.959079   967 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:45.993292 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 177977us
I20260709 13:12:45.983846  1148 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:45.985924  1163 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:12:45.985469  1099 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:45.986544  1167 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:12:45.987005  1015 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.967386   986 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:45.884589  1159 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:12:45.959892   959 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:45.943921  1113 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:45.995831 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:46.021623 30038 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:45.934453  1160 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.027107 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.027832 30038 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
W20260709 13:12:45.997195 30735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.011s
I20260709 13:12:46.001067 30077 leader_election.cc:400] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:45.963702  1138 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.002514 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:46.007910 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.008070 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2360) took 1440 ms. Trace:
I20260709 13:12:45.884440  1003 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 13:12:45.992074  1149 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:12:46.012972 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:46.017175 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 342643us
W20260709 13:12:46.042392 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.862038  1155 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.003279  1141 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:46.024327 30035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.003s	sys 0.015s
W20260709 13:12:46.054255 30735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.013s
I20260709 13:12:46.009449  1162 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:45.934307   926 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:45.980921  1040 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:46.060328 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59399us
W20260709 13:12:46.020525   865 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 1.015s	user 0.012s	sys 0.000s
I20260709 13:12:46.057344 30029 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:46.060885 30180 rpcz_store.cc:276] 0709 13:12:44.567563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.571060 (+  3497us) service_pool.cc:224] Handling call
0709 13:12:44.571329 (+   269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:44.581547 (+ 10218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.581576 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:44.589509 (+  7933us) log.cc:844] Serialized 52 byte log entry
0709 13:12:45.014697 (+425188us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:45.036281 (+ 21584us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.075048 (+ 38767us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800439960. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287 00007fcbe60ee208
0709 13:12:45.395567 (+320519us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:45.400360 (+  4793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.400443 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.007869 (+607426us) raft_consensus.cc:1685] finished
0709 13:12:46.007888 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.008013 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21043,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":16971,"raft.queue_time_us":229173,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":4942,"spinlock_wait_cycles":7945984,"thread_start_us":733045,"threads_started":2,"wal-append.queue_time_us":653142}
I20260709 13:12:46.018289  1099 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:46.020553  1015 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:46.014485  1148 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:46.085726 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1605) took 1422 ms. Trace:
I20260709 13:12:46.025781  1113 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:46.064898 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46456.3us
I20260709 13:12:46.086148 30111 rpcz_store.cc:276] 0709 13:12:44.663253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.690492 (+ 27239us) service_pool.cc:224] Handling call
0709 13:12:44.691679 (+  1187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.179958 (+488279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.179992 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.209276 (+ 29284us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.440612 (+231336us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:45.440651 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.440714 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.085493 (+644779us) raft_consensus.cc:1685] finished
0709 13:12:46.085513 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.085659 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125054,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":659011,"threads_started":2,"wal-append.queue_time_us":548274}
W20260709 13:12:46.073184 30035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.003s	sys 0.016s
I20260709 13:12:46.072989 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.088726 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:46.007087  1087 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.078049 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.090723 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:46.091418 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 172328us
I20260709 13:12:46.078562 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.092159 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.078779 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:46.081990 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.057494  1032 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.025645  1160 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:46.069243 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 282788us
W20260709 13:12:46.067045  1090 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.068s	user 0.012s	sys 0.000s
I20260709 13:12:46.076248 30153 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:46.089362 30029 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:46.093488 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.093348 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.095643 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:46.096414 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.105661 30181 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:46.119570 30181 pending_rounds.cc:85] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 6
I20260709 13:12:46.119838 30181 pending_rounds.cc:107] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:46.094175 30031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1974) took 1034 ms. Trace:
I20260709 13:12:46.120095 30181 raft_consensus.cc:2889] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:46.120450 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:46.121069 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 44927.4us
I20260709 13:12:46.100383 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.121819 30153 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:46.121984 30111 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:46.122763 30150 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:46.082823  1151 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:46.075649  1138 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.067555  1092 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:12:46.083520  1157 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:46.143018 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2016) took 1173 ms. Trace:
I20260709 13:12:46.132290 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.101121 30180 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:46.100613 30004 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:12:46.174543 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 74016.7us
I20260709 13:12:46.172732 30187 rpcz_store.cc:276] 0709 13:12:44.969588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.990578 (+ 20990us) service_pool.cc:224] Handling call
0709 13:12:45.106192 (+115614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.135202 (+ 29010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.135243 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.283031 (+147788us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b2c00111558. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:45.319550 (+ 36519us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.556434 (+236884us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:45.556474 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.556536 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.141670 (+585134us) raft_consensus.cc:1685] finished
0709 13:12:46.141701 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.142795 (+  1094us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000ca8d0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:46.142948 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146528,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":421007488,"thread_start_us":194029,"threads_started":1,"wal-append.queue_time_us":732614}
I20260709 13:12:46.184720 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:46.185624 30038 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:46.123467 30704 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:46.179973 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57287.5us
I20260709 13:12:46.182489 30037 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:46.200412 30038 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:46.093835   914 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:46.086045  1148 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.120278 30031 rpcz_store.cc:276] 0709 13:12:45.060102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.060227 (+   125us) service_pool.cc:224] Handling call
0709 13:12:45.060620 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.061027 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.061068 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.061628 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.477449 (+415821us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:45.537057 (+ 59608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.537755 (+   698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.093958 (+556203us) raft_consensus.cc:1685] finished
0709 13:12:46.093984 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.094113 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":653,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":35939,"thread_start_us":346774,"threads_started":1,"wal-append.queue_time_us":445975}
I20260709 13:12:46.202054 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.126935  1152 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:46.162362  1003 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:46.201594   967 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:46.134568  1004 consensus_meta.cc:287] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.006s	user 0.013s	sys 0.000s
I20260709 13:12:46.237138  1156 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:46.128015   644 consensus_meta.cc:287] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.202s	user 0.002s	sys 0.009s
W20260709 13:12:46.205193 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 133756us
I20260709 13:12:46.237792  1156 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:46.238323  1194 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:46.159624  1009 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:46.205809  1058 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:46.238994  1003 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.238853  1156 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.191102  1157 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.207710  1200 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:46.240722  1200 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:46.151162   861 consensus_meta.cc:287] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.440s	user 0.007s	sys 0.005s
I20260709 13:12:46.241190  1096 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:46.127458  1153 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:12:46.126766  1183 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:46.241752 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1970) took 1201 ms. Trace:
I20260709 13:12:46.233357   914 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:46.238826 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:46.134024  1168 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:12:46.242798   914 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.244067 30077 leader_election.cc:400] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:46.093622  1146 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.244359 30077 leader_election.cc:403] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.098311  1064 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:46.148039  1081 consensus_meta.cc:287] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.000s
W20260709 13:12:46.208635 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 86889.7us
I20260709 13:12:46.119065  1019 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.241693  1200 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.245865  1019 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.242200 30034 rpcz_store.cc:276] 0709 13:12:45.058808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.058935 (+   127us) service_pool.cc:224] Handling call
0709 13:12:45.065384 (+  6449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.076407 (+ 11023us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:45.134346 (+ 57939us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.398438 (+264092us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.405973 (+  7535us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.406157 (+   184us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:45.408726 (+  2569us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.736586 (+327860us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180028a9e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287 00007fcbe60ee208
0709 13:12:45.736812 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.736911 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.241518 (+504607us) raft_consensus.cc:1685] finished
0709 13:12:46.241545 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.241690 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123408,"prepare.queue_time_us":103738,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":6855,"raft.queue_time_us":340488,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":45163,"spinlock_wait_cycles":5718656,"thread_start_us":151233,"threads_started":1,"wal-append.queue_time_us":1022042}
I20260709 13:12:46.214998 30037 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:46.248027  1157 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:46.203493 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68245.2us
I20260709 13:12:46.241691   861 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:46.127211  1055 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.249348 30106 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
W20260709 13:12:46.251116 30106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1614) took 1569 ms (client timeout 1548 ms). Trace:
W20260709 13:12:46.251772  1127 consensus_meta.cc:287] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.229s	user 0.011s	sys 0.000s
I20260709 13:12:46.252251  1127 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.216140 30032 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.238822  1194 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.253996  1194 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.157363  1084 ts_tablet_manager.cc:1929] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:12:46.084288   865 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.092957  1015 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.221804 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1973) took 1149 ms. Trace:
I20260709 13:12:46.225755 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 497) took 1130 ms. Trace:
I20260709 13:12:46.126489   952 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:46.227986 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.228816 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 105429us
I20260709 13:12:46.105891  1083 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.138175  1007 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:46.133842  1049 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:46.129302  1155 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.104441  1160 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.278654 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.279085 30104 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:46.279881 30033 raft_consensus.cc:2410] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:46.214429  1045 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:46.238175   644 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.239470  1003 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:46.251495 30106 rpcz_store.cc:269] 0709 13:12:44.681950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.682331 (+   381us) service_pool.cc:224] Handling call
0709 13:12:46.250923 (+1568592us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54003061d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:46.251022 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544921984}
I20260709 13:12:46.098115  1130 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:46.261436 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:46.262301 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.262741 30032 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:46.258262 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.161429  1141 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:46.272501 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.299592 30031 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:46.101910  1087 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.267779  1090 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7.
I20260709 13:12:46.228063  1148 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.119686   986 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.265668 30035 rpcz_store.cc:276] 0709 13:12:45.059710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.059821 (+   111us) service_pool.cc:224] Handling call
0709 13:12:45.075631 (+ 15810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.101800 (+ 26169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.101831 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.132566 (+ 30735us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.089100 (+956534us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:46.103027 (+ 13927us) log.cc:844] Serialized 14 byte log entry
0709 13:12:46.103300 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.103403 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.209161 (+105758us) raft_consensus.cc:1685] finished
0709 13:12:46.209185 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.209318 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25707,"prepare.queue_time_us":28891,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":55529,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":37199,"spinlock_wait_cycles":35518336,"thread_start_us":827906,"threads_started":1,"wal-append.queue_time_us":1015516}
I20260709 13:12:46.236251 30029 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:46.370283 30113 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:46.191654  1151 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:46.290654 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46703.8us
I20260709 13:12:46.291985 30186 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:46.228379  1152 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:46.267423  1084 log.cc:1199] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/2c1b7d91eea54fb4990789f41041df86
I20260709 13:12:46.380577 30029 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:12:46.381031 30029 pending_rounds.cc:85] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 8
I20260709 13:12:46.381276 30029 pending_rounds.cc:107] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:46.381649 30029 raft_consensus.cc:2889] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:46.306033  1141 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.268157  1146 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:46.306859 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.307266 30736 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:46.286060 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.267360  1032 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:46.272184   864 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.282632 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.245497  1081 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.287824  1045 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.265241 30735 rpcz_store.cc:276] 0709 13:12:45.095219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.095349 (+   130us) service_pool.cc:224] Handling call
0709 13:12:45.095750 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.368190 (+272440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.368242 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.368873 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.070058 (+701185us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:46.070098 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.163496 (+ 93398us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54001c1bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:46.163573 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.225376 (+ 61803us) raft_consensus.cc:1685] finished
0709 13:12:46.225427 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.225687 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5284,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11506,"spinlock_wait_cycles":625255808,"thread_start_us":662399,"threads_started":1,"wal-append.queue_time_us":829071}
I20260709 13:12:46.231679  1113 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.295440 30732 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:46.308679   967 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.433926 30029 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:46.435009  1200 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:46.417475 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.421132  1058 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.421905 30738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:46.422111   644 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.423291 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:46.425279 30113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2243) took 1496 ms (client timeout 1943 ms). Trace:
W20260709 13:12:46.425994 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 143432us
I20260709 13:12:46.383230  1152 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:46.306953  1130 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:46.440218 30113 rpcz_store.cc:269] 0709 13:12:44.928484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.105276 (+176792us) service_pool.cc:224] Handling call
0709 13:12:46.404915 (+1299639us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400247554. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:46.425098 (+ 20183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359382784}
I20260709 13:12:46.439790 30738 raft_consensus.cc:606] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:46.468367 30110 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:46.479827 30738 raft_consensus.cc:614] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:46.480891 30740 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:46.483402 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:46.468778 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51434us
W20260709 13:12:46.468842 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.469128 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.473588 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:46.440630 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:46.493180 30179 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.433079  1045 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:46.494331 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53815.5us
I20260709 13:12:46.496217 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.432842  1155 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:46.498849 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.500574 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.501838 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:46.436491  1099 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6.
I20260709 13:12:46.518065 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.504568 30184 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:46.481145  1146 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:46.500059  1155 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.510885  1049 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:46.511183  1195 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:12:46.512665 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.539778 30179 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:46.541257 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.467787  1113 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.543670 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.544425 30179 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:46.433421  1032 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.501883  1010 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.435729   864 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.439651   967 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.513628   644 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.559300 30179 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:46.562458 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.571952 30077 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.573135 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.535166  1155 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.543072  1159 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:46.458906  1200 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.569516 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.542157  1064 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:46.581501 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:46.576659 30077 raft_consensus.cc:2686] T 2c1b7d91eea54fb4990789f41041df86 P 98b3b699b87245df85d3aa84c13f5691: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:46.548926  1162 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:46.595688 30113 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:46.586473  1128 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.285s
I20260709 13:12:46.592057 30077 leader_election.cc:400] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9.
I20260709 13:12:46.468222  1058 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:46.573628  1199 log.cc:927] Time spent T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:12:46.571694  1010 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:46.603999 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 71898.5us
I20260709 13:12:46.542639  1088 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:46.567142  1127 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:46.588652  1064 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.608858 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:46.607097 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet e3976f5c231948d6bd8a5345ec54d5d5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:46.578965  1146 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.602627 30077 leader_election.cc:403] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.583338  1084 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50288 (request call id 79) took 3781 ms. Trace:
W20260709 13:12:46.611711  1187 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
I20260709 13:12:46.610778  1010 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:46.667903 30150 leader_election.cc:336] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.603s (SENT)
I20260709 13:12:46.668629 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:46.611471  1087 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.669906 30032 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:46.670420 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 894) took 1087 ms. Trace:
I20260709 13:12:46.672020 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:46.618348  1064 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.613140  1147 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:46.687486   864 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.620819  1084 rpcz_store.cc:276] 0709 13:12:42.780240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.860392 (+ 80152us) service_pool.cc:224] Handling call
0709 13:12:43.101853 (+241461us) ts_tablet_manager.cc:1151] Deleting tablet 2c1b7d91eea54fb4990789f41041df86
0709 13:12:43.102920 (+  1067us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:12:44.290140 (+1187220us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003052d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60db362 00007fcbe9ac634c 00007fcbeb0e960a 00007fcbeb11a2d0 00007fcbeb10083d 00007fcbeb1007e9 00007fcbeb100779 00007fcbeb100741 00007fcbeb0ff96d 000000000038f354
0709 13:12:45.073719 (+783579us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:46.157154 (+1083435us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:46.558487 (+401333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348321152,"tablet-delete.queue_time_us":170846,"thread_start_us":109683,"threads_started":1}
W20260709 13:12:46.694801 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 103396us
I20260709 13:12:46.697002 30077 leader_election.cc:400] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10.
I20260709 13:12:46.697434 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:46.698414 30036 raft_consensus.cc:606] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:46.698966 30036 raft_consensus.cc:614] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:46.624578  1162 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:46.626333  1009 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:46.682502 30734 rpcz_store.cc:276] 0709 13:12:45.583580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.585907 (+  2327us) service_pool.cc:224] Handling call
0709 13:12:45.676963 (+ 91056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.677482 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.677524 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.678110 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.223063 (+544953us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:46.223121 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.223215 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.670107 (+446892us) raft_consensus.cc:1685] finished
0709 13:12:46.670135 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.670339 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122609,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":36666,"thread_start_us":432302,"threads_started":1,"wal-append.queue_time_us":662033}
I20260709 13:12:46.623394  1015 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.669893  1088 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:12:46.703661  1172 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
W20260709 13:12:46.755875 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.680052  1049 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:46.716535  1206 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:12:46.701576  1159 raft_consensus.cc:697] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:46.763456 30113 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:46.764678 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.765753 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.772341 30105 raft_consensus.cc:2376] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10. Re-sending same reply.
I20260709 13:12:46.704629  1162 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:46.767570 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.765352 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.804287 30111 raft_consensus.cc:2410] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:46.773932 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.763996  1049 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.764353 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.774298  1215 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.775086 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.764982  1136 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:12:46.764892  1198 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:46.777827  1208 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:46.770718  1087 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:12:46.770375   864 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:12:46.781919  1096 consensus_meta.cc:287] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.540s	user 0.003s	sys 0.007s
I20260709 13:12:46.782675 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.793872  1083 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:46.795333  1151 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.796734   967 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:46.799487  1152 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:46.799957 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.806514 30104 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:46.896499 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.897222 30104 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:46.807053 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.763768 30106 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:46.898474 30111 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:46.768594  1081 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:46.875087 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.805289 30108 raft_consensus.cc:2376] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8. Re-sending same reply.
I20260709 13:12:46.849256 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.879329 30109 raft_consensus.cc:2368] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9.
I20260709 13:12:46.709852  1147 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.759882  1015 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.884845 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.892129  1176 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.886920 30105 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:46.858060  1058 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:46.891628 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 195224us
I20260709 13:12:46.879213  1146 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:46.887782  1003 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:12:46.901259 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 633) took 1174 ms. Trace:
I20260709 13:12:46.899132 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:46.901813 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.902217 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.904367 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.908221 30179 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:46.899693  1134 consensus_meta.cc:287] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.891s	user 0.004s	sys 0.008s
I20260709 13:12:46.769853  1009 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:46.915357 30104 raft_consensus.cc:2410] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:46.880766  1215 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.884986  1198 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.919198 30184 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:46.913054 30185 rpcz_store.cc:276] 0709 13:12:45.726995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.753117 (+ 26122us) service_pool.cc:224] Handling call
0709 13:12:45.753732 (+   615us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:45.790691 (+ 36959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.790721 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:46.364217 (+573496us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b2c00111558. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:46.374571 (+ 10354us) log.cc:844] Serialized 52 byte log entry
0709 13:12:46.435164 (+ 60593us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:46.435506 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:12:46.436106 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.436235 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.899771 (+463536us) raft_consensus.cc:1685] finished
0709 13:12:46.901019 (+  1248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.901181 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51191,"prepare.queue_time_us":250,"raft.queue_time_us":91041,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":21172,"spinlock_wait_cycles":77062784,"thread_start_us":13396,"threads_started":1,"wal-append.queue_time_us":82051}
I20260709 13:12:46.927506  1152 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:46.928188  1152 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:46.935324  1160 consensus_meta.cc:287] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.001s
I20260709 13:12:46.935828  1160 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.937139 30038 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:12:46.919018 30182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2021) took 1897 ms (client timeout 1867 ms). Trace:
W20260709 13:12:46.938648 30182 rpcz_store.cc:269] 0709 13:12:45.021328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.130739 (+109411us) service_pool.cc:224] Handling call
0709 13:12:46.918837 (+1788098us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54002661d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:46.918944 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823987968}
I20260709 13:12:46.939785 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:46.919472 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.942651 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.944334 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:46.949343  1113 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 8.
I20260709 13:12:46.902025  1032 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:46.949061  1009 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.954716 30113 raft_consensus.cc:2410] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:46.955904  1113 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:46.956152  1136 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:46.922907  1134 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.956789  1136 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.959194  1134 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:46.959486  1136 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:46.960022  1058 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.960549  1058 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.962666  1058 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:46.964365 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:46.965448  1136 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:46.968070 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 55688.3us
I20260709 13:12:46.945164   864 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:46.965093  1045 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.975955  1045 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:46.977823  1148 consensus_meta.cc:287] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.006s
W20260709 13:12:46.978668 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66126.5us
I20260709 13:12:46.981333 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:46.982154 30185 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:46.983392 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:46.985653 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:46.968878   861 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:46.916380  1003 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:46.995517 30104 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:46.995852 30032 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:46.996620 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.002732 30106 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:46.997474 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.004438 30108 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.998526 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:46.998713 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.000104 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:46.941031  1015 consensus_queue.cc:1059] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:12:47.006166 30111 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:47.011132 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.897699  1159 consensus_queue.cc:237] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.012372 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.012483 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.019086 30109 raft_consensus.cc:2368] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:46.913156  1176 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.024578 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.015403 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.025875 30029 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.015899 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:47.026643 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:46.919447  1146 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.028143 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.036515 30104 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:47.039136 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.040886 30106 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.039386 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:46.978538  1148 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:46.900096  1162 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:47.022285  1194 consensus_meta.cc:287] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.768s	user 0.002s	sys 0.009s
I20260709 13:12:47.048168 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.056152 30112 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:47.019403   861 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.048576  1015 raft_consensus.cc:3055] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:47.049011  1003 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.051882  1087 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:47.094307  1147 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.053901  1151 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.054385 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.055104 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.041851 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.057489 30106 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:46.993569  1064 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.019788  1113 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:47.097265 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2023) took 2050 ms. Trace:
I20260709 13:12:47.098053 30150 leader_election.cc:400] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8.
I20260709 13:12:47.061969  1015 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:47.063402  1194 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:47.068361  1223 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:47.017656  1010 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.043010  1045 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.122174  1224 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.121802  1113 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.076049  1160 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.122872  1010 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.122728  1224 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:47.077258 30077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.867s (SENT) [suppressed 51 similar messages]
I20260709 13:12:47.078680  1198 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:47.080884  1141 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.002s
I20260709 13:12:47.126451  1141 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.126929 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.127271  1064 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.127759 30734 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:47.127980 30181 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.128587  1141 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.082939  1155 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.129175  1142 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.130735  1155 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.084159 30033 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:47.086558  1176 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.066808   861 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.131253 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.132050 30187 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:47.132800 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.136294  1015 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.116603  1055 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.141948  1055 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.096787 30109 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:47.144143 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 897) took 1209 ms. Trace:
I20260709 13:12:47.144537  1055 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.144603 30736 rpcz_store.cc:276] 0709 13:12:45.934370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.934767 (+   397us) service_pool.cc:224] Handling call
0709 13:12:45.968392 (+ 33625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.418517 (+450125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.143861 (+725344us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400780354. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.144070 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778925952}
W20260709 13:12:47.146874 30110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2235) took 2253 ms (client timeout 1934 ms). Trace:
W20260709 13:12:47.147435 30110 rpcz_store.cc:269] 0709 13:12:44.893292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.104116 (+210824us) service_pool.cc:224] Handling call
0709 13:12:47.146608 (+2042492us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000465d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:47.146782 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050641792}
I20260709 13:12:47.148821 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.149462 30033 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.149956 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.135396 30187 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:12:47.150527 30037 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.096779 30104 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.099208 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.101583 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.158295 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:47.158596 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59505us
I20260709 13:12:47.159541 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:47.101869 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:47.102620 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:47.097721 30186 rpcz_store.cc:276] 0709 13:12:45.046576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.122263 (+ 75687us) service_pool.cc:224] Handling call
0709 13:12:45.122671 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.376126 (+1253455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.097005 (+720879us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540004abd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.097199 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688428416}
I20260709 13:12:47.100772 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:47.113626 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.162225 30104 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:47.093111  1088 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9.
I20260709 13:12:47.125537 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.121853  1045 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:47.132973 30185 raft_consensus.cc:2368] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:12:47.133455   861 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.066136  1009 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:47.161187 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:47.168885 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 68213.2us
I20260709 13:12:47.176604 30108 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:47.177489 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.095880  1215 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.116956  1225 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.195914 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:47.116307  1213 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.205720 30107 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:47.200624 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.153503  1224 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.207183 30153 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:47.165541  1055 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.166529  1155 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:47.174129  1176 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:47.183604  1045 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.174319  1003 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.217942 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.241813 30032 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.174474  1160 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:47.193553   967 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.224397 30037 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:47.224836 30033 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:47.175423  1142 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:12:47.195591  1148 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.253371 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.254751 30033 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:47.256440 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:47.259367 30033 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:47.264428 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:47.260213   967 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.270882   967 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.273298 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 639) took 1025 ms. Trace:
I20260709 13:12:47.253276  1003 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.274238 30180 rpcz_store.cc:276] 0709 13:12:46.248134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.249738 (+  1604us) service_pool.cc:224] Handling call
0709 13:12:46.250055 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.428649 (+178594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.428681 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:46.428733 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:46.428779 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.272930 (+844151us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540004a6d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.272999 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.273205 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410231552}
I20260709 13:12:47.277132 30034 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:47.199395  1009 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.285099 30032 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:47.285513 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.280138 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.296888 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.300917 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.315407 30182 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.316514 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.229525  1055 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.245012  1213 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:47.343282 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 45214.5us
I20260709 13:12:47.350868 30182 raft_consensus.cc:2410] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:47.352380 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.354590 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 642) took 1103 ms. Trace:
I20260709 13:12:47.354965 30178 rpcz_store.cc:276] 0709 13:12:46.250973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.253483 (+  2510us) service_pool.cc:224] Handling call
0709 13:12:46.253771 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.296491 (+ 42720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.296535 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:46.296573 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:46.296611 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.354338 (+1057727us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54000aee54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.354389 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.354519 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97787648}
I20260709 13:12:47.261817  1160 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:47.367823 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 290585us
I20260709 13:12:47.310595  1161 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:12:47.209270  1225 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.370100 30184 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:47.371042 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 644) took 1103 ms. Trace:
I20260709 13:12:47.383859 30181 rpcz_store.cc:276] 0709 13:12:46.269106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.301043 (+ 31937us) service_pool.cc:224] Handling call
0709 13:12:46.301472 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.128436 (+826964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.370815 (+242379us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54002977d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.370982 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900396416}
W20260709 13:12:47.377334 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.375356 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.386521 30732 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:47.387190 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.386430 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.388734 30106 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:47.388113 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:47.389851 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 181227us
I20260709 13:12:47.389902 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:47.390391 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.340773  1213 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:47.353377  1215 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.393671 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.392217 30110 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:47.395067 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.393070 30109 raft_consensus.cc:2410] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:47.446360 30106 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:47.447005 30106 pending_rounds.cc:85] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 3
I20260709 13:12:47.447371 30106 pending_rounds.cc:107] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:47.447679 30106 raft_consensus.cc:2889] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.447789 30037 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
W20260709 13:12:47.450544 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 78991.7us
I20260709 13:12:47.451319 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:47.454058 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64214us
I20260709 13:12:47.451212 30180 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:47.389734  1012 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:47.450155  1155 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:47.456280 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.386435  1148 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:12:47.358718   952 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:12:47.379886  1058 consensus_queue.cc:1059] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:12:47.389534  1083 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:47.471766 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.399923  1213 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.386523   967 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 13:12:47.486994  1209 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.798s	user 0.000s	sys 0.003s
W20260709 13:12:47.487457  1235 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:12:47.466446  1081 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:12:47.489235 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 628) took 1224 ms. Trace:
W20260709 13:12:47.478343 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.470046  1012 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.455606  1215 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.481480  1003 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.482182  1230 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:47.482640   864 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:47.484513  1205 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.935s	user 0.005s	sys 0.000s
I20260709 13:12:47.462649  1228 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.489646 30035 rpcz_store.cc:276] 0709 13:12:46.265133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.369579 (+104446us) service_pool.cc:224] Handling call
0709 13:12:46.385503 (+ 15924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.385844 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.385873 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.431312 (+ 45439us) log.cc:844] Serialized 26 byte log entry
0709 13:12:46.555658 (+124346us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:46.555718 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.555815 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.486385 (+930570us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:47.488936 (+  2551us) raft_consensus.cc:1685] finished
0709 13:12:47.488956 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.489174 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":646,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":14227,"spinlock_wait_cycles":22680320,"thread_start_us":79658,"threads_started":1,"wal-append.queue_time_us":151252}
I20260709 13:12:47.491876 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:47.475036  1229 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.270s	user 0.000s	sys 0.002s
I20260709 13:12:47.465690  1194 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.519639  1230 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:47.505345 30109 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:47.505129   864 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.510387  1003 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:47.510499 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.505034  1198 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.513032  1160 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:47.513815  1233 log.cc:927] Time spent T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:12:47.514791  1234 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:47.517441 30038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 623) took 1256 ms. Trace:
I20260709 13:12:47.518738 30108 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:12:47.531638 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.532073 30108 pending_rounds.cc:85] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 3
I20260709 13:12:47.532480 30108 pending_rounds.cc:107] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:12:47.532863 30108 raft_consensus.cc:2889] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.472653  1155 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.523834 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.538378 30109 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:47.519840  1194 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:47.525774 30182 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:47.530584 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 79336us
I20260709 13:12:47.532013 30038 rpcz_store.cc:276] 0709 13:12:46.261196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.261714 (+   518us) service_pool.cc:224] Handling call
0709 13:12:46.262014 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.937684 (+675670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.517141 (+579457us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540011d354. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.517356 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551776640}
W20260709 13:12:47.539322 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 165272us
I20260709 13:12:47.498665  1083 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.552119 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.553013 30182 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:47.554812 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.537966  1087 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.561982 30001 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:47.557566 30034 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:47.573041 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.543210  1003 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.576363 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.578126 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:47.590621 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:47.593474   952 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:47.593652  1245 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.601089  1055 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:47.602231  1238 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:12:47.582490  1230 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:47.605813  1239 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:12:47.570986  1087 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.538967  1198 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.607880 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.547072  1194 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.551193  1147 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:12:47.572707  1009 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.555119  1191 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:47.623164 30001 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:47.610337  1151 consensus_meta.cc:287] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.002s
W20260709 13:12:47.633370 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 80901us
I20260709 13:12:47.639343 30001 leader_election.cc:400] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:47.640100 30001 leader_election.cc:403] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:47.592725  1003 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.613564  1087 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.645483  1012 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.647464  1003 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.647917  1083 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.648504   864 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.649681  1225 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.670508 30001 leader_election.cc:400] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9.
I20260709 13:12:47.656086  1045 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.613709   952 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:47.625111   861 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.624475  1088 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.626914  1155 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.672039 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.644948  1151 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.634526  1248 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:47.700626 30186 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.682891   861 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.667548  1058 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:47.703147 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 95611.1us
I20260709 13:12:47.672983   952 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.707197  1253 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:47.708339 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.708045  1253 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.709802 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.711575  1253 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.713100 30704 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:47.715086  1253 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.718974 30704 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.724308  1198 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.725307  1248 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:47.726131  1248 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:47.726469  1248 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:47.691425  1244 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:47.683512  1088 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.694308  1147 consensus_queue.cc:1059] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:12:47.843873 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 124970us
W20260709 13:12:47.747444 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.845288 30182 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:47.734154 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:47.844820 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173108us
W20260709 13:12:47.763800 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 129594us
W20260709 13:12:47.850875 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 116819us
I20260709 13:12:47.851768 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.854813   864 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.855474   864 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.857946   864 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.858464 30187 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:47.859416 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2387) took 1431 ms. Trace:
I20260709 13:12:47.860539 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:47.864733 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.852344 30150 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.867136 30030 raft_consensus.cc:606] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.867242 30105 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:47.867585 30030 raft_consensus.cc:614] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:47.860119 30183 rpcz_store.cc:276] 0709 13:12:46.428433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.886287 (+457854us) service_pool.cc:224] Handling call
0709 13:12:46.900546 (+ 14259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:46.979649 (+ 79103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:46.979683 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:46.986846 (+  7163us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.263730 (+276884us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:47.263781 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.762456 (+498675us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54002684d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:47.762514 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.762571 (+    57us) raft_consensus.cc:1685] finished
0709 13:12:47.762589 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.859342 (+ 96753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17040,"raft.queue_time_us":9976,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8447,"spinlock_wait_cycles":159079296,"thread_start_us":276469,"threads_started":1,"wal-append.queue_time_us":369582}
I20260709 13:12:47.860565 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.867846 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.719996   952 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:47.819000  1160 raft_consensus.cc:3055] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:47.731185  1146 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.728399  1019 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.852489  1246 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:47.732161   865 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:47.873643 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:47.747583  1194 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.889592   865 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.891968  1088 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:47.877614 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.876734 30182 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:47.878218 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.883155 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.859297  1152 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:47.732159  1045 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:47.858861   644 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:47.894007 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.898976 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.903622 30113 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:47.826828  1087 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.871250  1250 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:47.723560  1058 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.875792  1160 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:47.910732 30187 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:47.915071 30183 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:47.898026  1246 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.727232  1248 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:47.911870 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61382.7us
I20260709 13:12:47.870175   864 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:12:47.883235  1151 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.914196 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:47.874857  1191 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:12:47.916231   644 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:47.923112 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:47.906042  1146 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.876909  1161 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:12:47.927122 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:47.963224 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 111494us
I20260709 13:12:47.964315 30732 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:47.908999  1253 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:47.905800  1152 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.966223 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:47.966741 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:47.970288 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.917331  1250 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:47.914790  1213 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:47.974977  1250 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:47.974360 30182 raft_consensus.cc:2376] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9. Re-sending same reply.
I20260709 13:12:47.929076  1246 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.991492 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:47.992184 30740 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.992125 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.994011 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.919377  1019 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:47.918923  1058 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.001310 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:47.994674 30739 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:48.002696 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:48.004515 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:48.010824 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.014088 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:48.014361 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:48.015465 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:48.016878 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:47.974159  1152 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.025238 30740 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
W20260709 13:12:48.031939 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.033897 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.034965 30079 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:47.973183  1146 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.037729  1146 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.020031   864 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.041921   864 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:48.044701  1227 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.992s	user 0.000s	sys 0.003s
I20260709 13:12:48.046325 30179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2380) took 1619 ms. Trace:
I20260709 13:12:48.046969   644 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.046931 30179 rpcz_store.cc:276] 0709 13:12:46.427136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.591732 (+164596us) service_pool.cc:224] Handling call
0709 13:12:46.592331 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:46.915428 (+323097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.045941 (+1130513us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540016ec54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:48.046239 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725953920}
I20260709 13:12:48.048839 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.055590 30179 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:48.002395  1213 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.062392 30179 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:48.065445 30150 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.727s (SENT)
I20260709 13:12:48.066027 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:48.074543 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.044917   864 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.011809  1019 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.060107  1146 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:48.072527  1226 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:48.020421  1160 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.032419  1250 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.098044  1146 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.147183  1019 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.149750  1087 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.151758  1250 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.154008  1160 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.155465  1152 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.112793  1191 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:48.157704  1191 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.159842  1191 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.161593  1146 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.144340   952 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.179359 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:48.179440 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 98708.2us
I20260709 13:12:48.206429 30110 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.180297 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:48.217528 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:48.228964 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:48.206218  1019 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:48.233472 30153 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:48.238286 30153 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:48.239552  1213 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:48.240336  1213 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:48.241614  1213 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:48.223908  1260 log.cc:927] Time spent T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:12:48.231554   864 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:48.250576  1226 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:48.253793  1137 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:48.266716 30106 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:48.235260  1246 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.254462  1019 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.270243  1230 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:48.293129 30732 raft_consensus.cc:2368] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:12:48.270514   864 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.300750   864 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.303071 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:48.310794 30106 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.234606  1263 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:48.295337  1137 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:48.323297 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74104.6us
I20260709 13:12:48.328079 30106 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:48.333093 30110 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:48.291330  1230 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:48.358076  1272 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:12:48.358836 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.359946  1270 log.cc:927] Time spent T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:48.342150   952 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.302932  1276 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:48.358413  1137 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.370260 30737 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:48.406700 30734 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:48.409113  1058 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.420302  1275 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:48.425966  1246 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.473330  1200 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.477877  1230 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.478958 30183 raft_consensus.cc:1240] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:48.484197 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:48.607508  1161 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.613488 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:48.613955 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.614214 30181 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:48.689292 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.605719  1200 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:48.695477 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:48.696283 30181 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:48.696527 30030 raft_consensus.cc:2410] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:48.697096 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:48.612922  1161 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.707943  1194 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.708549  1194 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.691974  1216 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:48.709843  1216 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.712402 30181 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:48.716112  1216 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:48.716322   864 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:48.712427  1200 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.718559   864 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:48.720032  1200 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:48.721328 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 266048us
I20260709 13:12:48.469817  1275 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.724323 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:48.725155 30104 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
W20260709 13:12:48.706673  1096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.367s	user 0.008s	sys 0.007s
I20260709 13:12:48.735502 30038 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:48.738451 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:48.742221 30002 connection.cc:256] RPC call timeout handler was delayed by -1.119657006000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:12:48.742863 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.750754 30030 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:48.754488 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:48.746476 30002 connection.cc:256] RPC call timeout handler was delayed by -1.058457006000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:12:48.723547  1019 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.746181 30035 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:48.734169  1146 consensus_meta.cc:287] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:12:48.759162 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:48.761390  1200 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:48.761556 30104 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:48.762156  1200 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:48.746186  1160 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.592s	user 0.022s	sys 0.000s
I20260709 13:12:48.757352  1250 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.766434  1250 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.767047  1243 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:48.767547  1243 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:48.768404  1243 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.773288 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.775903 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:48.776825  1275 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:48.777079 30180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2395) took 1612 ms (client timeout 1845 ms). Trace:
W20260709 13:12:48.784637 30180 rpcz_store.cc:269] 0709 13:12:47.164778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.279764 (+114986us) service_pool.cc:224] Handling call
0709 13:12:48.776906 (+1497142us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001eafd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:48.777012 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376932736}
I20260709 13:12:46.917658 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 2c1b7d91eea54fb4990789f41041df86 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:12:48.759824 30112 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:12:48.768880  1250 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.765534  1200 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.788079 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:48.796252 30112 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.796449 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.789768 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:48.797688 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.798405 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.798811 30178 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:48.799428 30180 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:48.789665 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:48.785720 29920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 1.88236e+06us
I20260709 13:12:48.791312 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:48.799959 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:48.800033 30104 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:48.795118 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:48.739409  1096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.008s	sys 0.008s
I20260709 13:12:48.751153  1161 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.749863  1133 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:12:48.758140  1138 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.795959  1243 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.835467  1194 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:48.837592 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:48.821710  1216 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:12:48.784221  1146 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.839159  1230 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.004850   967 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:48.946458  1015 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.013216   861 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.088480   967 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:49.027495  1228 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.089975  1228 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.090095   967 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.952795 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.091634   967 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.092207 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.011212   959 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.927549 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2270) took 1542 ms. Trace:
I20260709 13:12:48.992672 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:49.094537 30108 rpcz_store.cc:276] 0709 13:12:47.385492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.388627 (+  3135us) service_pool.cc:224] Handling call
0709 13:12:47.518382 (+129755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.533347 (+ 14965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.927207 (+1393860us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400397450. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:48.927442 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297769728}
I20260709 13:12:48.972154 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 646) took 1853 ms. Trace:
I20260709 13:12:49.007206 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2036) took 1114 ms. Trace:
I20260709 13:12:48.958818 30105 raft_consensus.cc:1240] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:49.097177 30182 rpcz_store.cc:276] 0709 13:12:47.892765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.914368 (+ 21603us) service_pool.cc:224] Handling call
0709 13:12:49.006943 (+1092575us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54002661d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:49.007122 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27543936}
I20260709 13:12:48.893754  1130 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:49.026719  1207 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 2.318s	user 0.007s	sys 0.004s
W20260709 13:12:48.974217  1285 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 13:12:48.980173 30704 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:49.099627  1096 raft_consensus.cc:3055] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:48.995299  1152 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.100082  1096 raft_consensus.cc:740] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:48.969452 30153 leader_election.cc:400] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:12:48.978185 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:48.962191 30029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 1984) took 2696 ms. Trace:
I20260709 13:12:49.026942  1090 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.952383  1284 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:49.051849   864 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.102190   986 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:49.102589   864 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.102797   986 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.095796 30186 rpcz_store.cc:276] 0709 13:12:47.118958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.605943 (+486985us) service_pool.cc:224] Handling call
0709 13:12:47.606297 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.702234 (+ 95937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.971800 (+1269566us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b54001eb9d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:48.972065 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212438912}
I20260709 13:12:49.103961   986 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.104808   864 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.104327   959 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.976887 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:48.966189 30037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44710 (request call id 632) took 1720 ms (client timeout 1849 ms). Trace:
I20260709 13:12:49.105369   986 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.107199   959 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:49.106941 30037 rpcz_store.cc:269] 0709 13:12:47.246204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.264088 (+ 17884us) service_pool.cc:224] Handling call
0709 13:12:48.966005 (+1701917us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540020b7d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:48.966126 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321008512}
W20260709 13:12:48.975893  1290 log.cc:927] Time spent T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:12:49.102025  1284 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.132014  1284 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:48.999318  1198 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.839254  1013 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:48.940524  1099 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:49.133885  1198 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.979499 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.135304  1099 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:49.136363  1198 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.136267  1099 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.101449 30029 rpcz_store.cc:276] 0709 13:12:46.265990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.435058 (+169068us) service_pool.cc:224] Handling call
0709 13:12:46.435403 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.026508 (+591105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.961868 (+1935360us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400288cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:48.962097 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357271936}
I20260709 13:12:49.137917  1099 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.139088 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2289) took 1037 ms. Trace:
I20260709 13:12:49.093008 30110 raft_consensus.cc:2393] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:49.139529 30109 rpcz_store.cc:276] 0709 13:12:48.101448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.101639 (+   191us) service_pool.cc:224] Handling call
0709 13:12:48.131230 (+ 29591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.271242 (+140012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.271290 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.286662 (+ 15372us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.424652 (+137990us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:48.424694 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.424810 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.975041 (+550231us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:49.138751 (+163710us) raft_consensus.cc:1685] finished
0709 13:12:49.138775 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.139027 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1950,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":20660,"spinlock_wait_cycles":35476352,"thread_start_us":253680,"threads_started":2,"wal-append.queue_time_us":411304}
I20260709 13:12:49.141335 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.117341   861 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:49.068202  1081 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.884598  1087 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:48.979808 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.098933 30180 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:49.108132 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:48.855893  1058 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:48.815515   926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.026s	sys 0.019s
W20260709 13:12:49.152806   926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.336s	user 0.029s	sys 0.023s
I20260709 13:12:49.152436  1087 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:49.124155 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 174403us
I20260709 13:12:48.983999  1162 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.877115 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.124749 30112 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:49.156070 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.157083 30112 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:12:48.952312 30185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2030) took 1971 ms (client timeout 1564 ms). Trace:
I20260709 13:12:48.979868 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:48.951660  1215 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.119000 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.088492  1230 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:48.986479 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.002399  1248 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.160272  1087 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.126906  1298 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.101094 30153 leader_election.cc:403] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:12:49.161761 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 192614us
I20260709 13:12:49.164475 30106 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.979012 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:49.165369 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.166013 30741 raft_consensus.cc:2410] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:49.034150 30735 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:49.167294  1298 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.106318 30738 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:49.101737  1090 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.092437  1228 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.169575  1228 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:49.170823  1113 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:49.171020 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.171274  1113 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:49.133219  1284 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:49.100453 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 120400us
W20260709 13:12:49.158574 30185 rpcz_store.cc:269] 0709 13:12:46.981309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.983104 (+  1795us) service_pool.cc:224] Handling call
0709 13:12:48.952055 (+1968951us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002fa654. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:48.952229 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342036736}
I20260709 13:12:49.142328 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.095794  1146 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:49.146706 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 100994us
I20260709 13:12:49.177179 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.176923  1113 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.178444 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.160106   864 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:49.095980 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.179087 30109 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:49.179432 30108 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:49.180377 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.142184 30110 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:49.178450  1113 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.173501 30112 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:49.183290 30110 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:49.171303 30705 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:49.180460  1230 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.183213 30112 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:49.144093   861 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.185616 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.194451 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.196593 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.199034 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.199282 30735 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:49.195286 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:49.198513 30740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 909) took 1164 ms. Trace:
I20260709 13:12:49.196007   865 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.202325   865 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.203600 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:49.204826   865 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:49.205153 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.205801 30737 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:49.205814 30735 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:49.186353  1137 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:49.174573  1133 consensus_queue.cc:1059] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:12:49.209968 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.200783 30740 rpcz_store.cc:276] 0709 13:12:48.034082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.942978 (+908896us) service_pool.cc:224] Handling call
0709 13:12:48.943380 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.943642 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:49.075100 (+131458us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.198159 (+123059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:49.198216 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:49.198261 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.198329 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.198455 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10220,"prepare.queue_time_us":131461,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":12785,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":32512,"thread_start_us":241067,"threads_started":2}
I20260709 13:12:49.207223 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.181663  1215 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:12:49.186507   864 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:49.225626   864 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:49.207434 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.226892  1298 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.226649   864 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.149250  1081 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.228085   864 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.230132  1081 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.207393  1194 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.224272 30735 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:49.239681   986 raft_consensus.cc:3055] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:49.240399   986 raft_consensus.cc:740] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.240893  1137 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.242056  1137 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.241778   986 consensus_queue.cc:260] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.243726   986 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.136269  1096 consensus_queue.cc:260] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:49.254752  1287 consensus_queue.cc:1175] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef9ab4d665234a799376bf42ef5d058c" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
W20260709 13:12:49.295670 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.303897 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:49.108358 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.115658 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.308720 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.311616 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2106) took 1732 ms. Trace:
I20260709 13:12:49.313135 30031 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:49.314481 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.315268 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.315721 30029 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:49.316481 30037 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:49.317891 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.318255 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.318938 30030 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:49.319339 30038 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:49.324440 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.325639 30038 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:49.310900 30036 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
W20260709 13:12:49.330422 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.330996 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:49.331317 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 147917us
I20260709 13:12:49.336366 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.333024 30029 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:49.337875 30029 pending_rounds.cc:85] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 7
I20260709 13:12:49.312299 30034 rpcz_store.cc:276] 0709 13:12:47.579212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.579392 (+   180us) service_pool.cc:224] Handling call
0709 13:12:47.579836 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.594962 (+ 15126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.594994 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.946228 (+1351234us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c000e1358. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:48.946739 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.310392 (+363653us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:49.310543 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.310762 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.310842 (+    80us) raft_consensus.cc:1685] finished
0709 13:12:49.310857 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.311307 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27370,"raft.queue_time_us":10046,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":28221184,"thread_start_us":362777,"threads_started":1,"wal-append.queue_time_us":297011}
I20260709 13:12:49.338218 30029 pending_rounds.cc:107] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:12:49.338693 30029 raft_consensus.cc:2889] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.333678 30004 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.339540 30031 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:49.342379 30105 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:49.344524 30031 raft_consensus.cc:1240] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:12:49.346000 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 136328us
W20260709 13:12:49.347450 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 152993us
I20260709 13:12:49.347357 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:49.349459 30111 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:49.351263 30111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1654) took 2352 ms (client timeout 1727 ms). Trace:
W20260709 13:12:49.352419 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.351985 30111 rpcz_store.cc:269] 0709 13:12:46.999161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.010782 (+ 11621us) service_pool.cc:224] Handling call
0709 13:12:49.350886 (+2340104us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b5400131fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:49.351136 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5369307008}
I20260709 13:12:49.353813 30104 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 4.
I20260709 13:12:49.352000 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:49.199391 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:49.358508 30112 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:49.358554 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:49.360316 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 160807us
I20260709 13:12:49.361887 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.362933 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.363943 30113 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:49.364907 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.365146 30111 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:49.367254 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.367605 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:49.198511   926 consensus_queue.cc:1059] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.176s
I20260709 13:12:49.374891  1013 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:49.383286 30108 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:49.385265  1055 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:49.385972  1003 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:49.376053 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 155035us
I20260709 13:12:49.208742  1090 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.236593   861 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.400024  1287 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:49.400169  1228 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:49.400856  1287 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.407948  1088 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:49.408095  1287 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.401098  1228 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.408969  1088 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.409803  1228 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.412081  1088 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.412842  1088 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:49.404671  1142 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.405541 30179 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:49.405733  1003 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:49.402451  1230 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:49.414059  1090 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:49.414346 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:49.416065 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.395902  1200 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:49.420961 30104 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:49.422118 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.431624  1276 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:49.433210 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.434974 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.435439  1096 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.435858 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.444209  1137 consensus_queue.cc:1059] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:49.444684  1133 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:49.445960 30112 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:49.446434 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:49.447202 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 98212.4us
W20260709 13:12:49.447937 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79901.9us
I20260709 13:12:49.448012  1087 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:49.449819  1055 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:49.452185 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:49.506201 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.507154  1133 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:49.507620  1133 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.508267  1142 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:49.508638 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.509088  1142 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.510018  1146 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.510872 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:49.510712  1146 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.511819  1142 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:49.454005 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 140814us
I20260709 13:12:49.514346 30004 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.514635  1088 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.515950  1198 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:49.516165 30004 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.517383 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.520363  1215 consensus_queue.cc:1059] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:49.463390  1287 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.487541 30734 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:49.487715  1155 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.488255 30036 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:49.488947  1200 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:49.481695  1003 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:49.493848 30035 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:49.501823  1090 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.534449  1200 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.535952  1090 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.533560  1155 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.538255  1194 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:49.520489 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:49.457832  1160 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:49.523541 30037 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:49.528882 30110 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:49.529013  1230 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:49.533510 30001 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:49.538609  1198 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.538902  1215 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:49.502173 30032 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:49.539857  1276 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:49.540407  1055 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:49.543779 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 49576.4us
W20260709 13:12:49.544598 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.545068 30106 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:49.548521  1273 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:49.508858  1133 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.564605 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:49.566170 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173381us
I20260709 13:12:49.559252  1276 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.559933  1273 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:49.559109  1215 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:49.571817 30004 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.576915  1213 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:49.577517 30004 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.580556   967 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:49.571973 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:49.558171  1137 consensus_queue.cc:1243] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer 98b3b699b87245df85d3aa84c13f5691 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:49.567744  1142 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.587831 30036 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:49.590147  1133 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:49.592097 29930 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 8, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 8 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:49.593290 30109 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
W20260709 13:12:49.601902 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 93472.9us
I20260709 13:12:49.609906  1283 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:49.610702  1283 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:49.612493 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.612581  1273 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.614332  1273 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:49.616245 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.617746 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.604748  1130 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.618607 30032 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:12:49.619024  1130 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.619964 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.621038 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.621564 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.621790 30035 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:49.580587  1248 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.610781  1228 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.594661  1013 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:49.633777  1013 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.634312  1013 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.630838 30033 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:49.640091 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.596022   926 raft_consensus.cc:3055] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:49.595661 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:49.641111 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:49.645180 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 124877us
I20260709 13:12:49.594359  1003 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.645068 30034 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:12:49.649709 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.621302  1130 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:49.664865  1298 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:49.665668  1298 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:49.666754  1298 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.671296  1013 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.642627   926 raft_consensus.cc:740] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:49.674819 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:49.681327 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 85804.9us
I20260709 13:12:49.681499 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.683633 30105 raft_consensus.cc:2410] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:49.694872  1230 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.697542 30036 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:49.698840 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:49.700520 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.703843   926 consensus_queue.cc:260] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:49.713768 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.686072  1130 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.717732 30739 raft_consensus.cc:2410] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:12:49.717828 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.708601  1248 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:49.723510 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.721576 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:49.722947  1162 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.717485  1088 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.733129 30029 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:49.685520  1276 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.730252 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:49.694995  1146 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:49.734115 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 89826.1us
I20260709 13:12:49.736052 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.730561   926 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.743611 30734 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:49.748066 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.751683 30038 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:49.751780  1138 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:49.752198 30733 raft_consensus.cc:1240] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:49.752367  1138 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.752815  1138 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.735598  1055 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:49.768641 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:49.770596 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.771798 30038 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:49.772671   959 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:49.766451  1058 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:49.777884  1058 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:49.778342  1058 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:49.768503  1200 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:12:49.758491  1003 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.782282   959 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:49.782727   959 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.783053   959 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.784600  1248 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:49.784940  1155 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:49.785359  1248 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.787628 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.787892 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.738067  1162 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.790992 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.791800 30030 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.792657 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.792769 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.793495 30036 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:49.794567 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.795572 30032 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:49.799918 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.800127 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.804507 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:49.824067 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61801us
I20260709 13:12:49.828068 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.831177 30029 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:49.832511 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.833770 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.836244 30001 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:49.802088  1162 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.837548 30034 raft_consensus.cc:2376] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8. Re-sending same reply.
I20260709 13:12:49.841107 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:49.828181 29930 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 10, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.828442  1155 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.848357  1213 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:49.848779  1213 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:49.849121  1213 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.851300  1142 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:49.854614  1228 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.861841 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.862588 30036 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:12:49.862780 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57166us
I20260709 13:12:49.863380 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:49.863698 30036 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:49.865603 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.866672 30734 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.866775 30038 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:49.861912 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:49.867563 30035 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.867653  1283 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.870107  1155 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.870553  1013 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.871855  1226 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:49.872515  1226 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:49.874730 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.874840  1226 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:49.875216  1276 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:49.882543 30030 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:12:49.885109 29930 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 2 to 5, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 5 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:49.865190 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.889675  1298 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:49.890266  1298 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:49.891394  1298 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.892263 29930 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 8 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:49.898820  1325 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:12:49.893812 29930 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:49.910604 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 106226us
I20260709 13:12:49.911155 30180 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:49.911567 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.912168 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:49.913077 30185 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:49.846294  1215 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.911569  1160 consensus_queue.cc:1059] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:49.914300  1215 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:49.919414 29932 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 260) took 20902 ms (client timeout 15000 ms). Trace:
I20260709 13:12:49.931562 30734 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:12:49.924758  1248 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.931126 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:49.945900 30179 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.934553 30112 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:49.934845  1142 consensus_queue.cc:1059] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:49.933732  1130 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.937323  1015 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:49.937431 29930 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 7, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 7 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:49.970021 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 104360us
I20260709 13:12:49.937280  1155 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:49.939604   959 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:49.942318 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.943915  1213 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.894898  1058 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:49.948690 30035 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
W20260709 13:12:49.947927 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0287806280000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:12:49.977209 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.919909 29932 rpcz_store.cc:269] 0709 13:12:29.017502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.028633 (+ 11131us) service_pool.cc:224] Handling call
0709 13:12:49.919097 (+20890464us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:44.811616 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:44.812221 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:44.812262 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:12:44.812284 (+    22us) tablet.cc:662] Decoding operations
0709 13:12:44.813365 (+  1081us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:44.813446 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:44.813480 (+    34us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:12:44.814470 (+   990us) tablet.cc:701] Row locks acquired
0709 13:12:44.814496 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:12:44.814670 (+   174us) write_op.cc:270] Start()
0709 13:12:44.814775 (+   105us) write_op.cc:276] Timestamp: P: 1783602764814619 usec, L: 0
0709 13:12:44.814794 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:44.815462 (+   668us) log.cc:844] Serialized 4422 byte log entry
0709 13:12:45.250338 (+434876us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe2fc90ac 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b
0709 13:12:46.139063 (+888725us) op_driver.cc:464] REPLICATION: finished
0709 13:12:46.372231 (+233168us) write_op.cc:301] APPLY: starting
0709 13:12:46.378356 (+  6125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:46.422028 (+ 43672us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:46.422055 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:46.423636 (+  1581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:46.423927 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:12:46.423981 (+    54us) write_op.cc:312] APPLY: finished
0709 13:12:46.533593 (+109612us) log.cc:844] Serialized 83 byte log entry
0709 13:12:46.560655 (+ 27062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:46.577836 (+ 17181us) write_op.cc:454] Released schema lock
0709 13:12:46.587679 (+  9843us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:46.627376 (+ 39697us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:46.667166 (+ 39790us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6743,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":159971,"apply.run_cpu_time_us":4923,"apply.run_wall_time_us":304206,"num_ops":11,"prepare.queue_time_us":236478,"prepare.run_cpu_time_us":22269,"prepare.run_wall_time_us":665428,"raft.queue_time_us":407232,"raft.run_cpu_time_us":12153,"raft.run_wall_time_us":84740,"replication_time_us":1324077,"spinlock_wait_cycles":66261760,"thread_start_us":1033202,"threads_started":4,"wal-append.queue_time_us":742028,"wal-append.run_cpu_time_us":97350,"wal-append.run_wall_time_us":2036510}]]}
I20260709 13:12:49.984866 30705 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:49.971202   967 raft_consensus.cc:3055] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:49.990389 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.972028  1283 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:12:49.995253 30031 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:49.937232  1013 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:12:49.982689  1198 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.946177  1138 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:50.000272 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 58059.5us
I20260709 13:12:50.008486 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:50.010001 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:50.010982 29930 catalog_manager.cc:5697] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 5, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 5 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.989902   967 raft_consensus.cc:740] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:50.026834 30112 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 4.
I20260709 13:12:50.010694  1198 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.030958 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:50.030746 29930 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 8, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:12:50.031980  1198 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:50.032532 29930 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 10, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.032037  1334 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:50.031607 30105 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:50.006516  1015 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.036437 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:50.027557 30106 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.042814 30032 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:50.048231   959 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:50.049340 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 67807.2us
I20260709 13:12:50.049911  1138 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:50.050457  1058 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:50.050624 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:50.051223 30035 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:50.052217 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:50.052500 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:50.055117  1326 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:50.055761  1015 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.058931  1015 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:50.060045 29930 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.061108 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:50.061645 29930 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 4, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.017198   926 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:50.078585 30035 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:50.081072 30108 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:50.081503 30106 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:50.082724 30179 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:50.085080 30030 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:50.089435 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 89451.4us
I20260709 13:12:50.041179  1130 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.092358 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:50.093077 30038 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:50.092706   967 consensus_queue.cc:260] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.080924  1133 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.093436  1334 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:50.063136  1213 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:50.097733 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.101531  1316 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:12:50.096648 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:50.080796   926 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:50.112916 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52008.5us
I20260709 13:12:50.123423 30038 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:50.106494  1130 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.130822 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:50.106866  1133 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:50.105834  1334 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:50.130403  1263 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:50.125504  1142 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:50.131798 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79696.2us
I20260709 13:12:50.118643   926 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:50.121644  1316 consensus_queue.cc:1243] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:12:50.155596 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 59068.7us
I20260709 13:12:50.160547 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:50.161978  1332 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:50.163295 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:50.165180  1213 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.166046  1055 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:50.166898  1055 consensus_queue.cc:1243] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:50.155835  1133 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.158084  1334 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.173141  1273 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:50.137814   967 raft_consensus.cc:3060] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:50.177217 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.178375 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:50.183318 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:50.183586 30151 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:50.202533 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.158000  1263 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:50.176414  1273 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:50.217483 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64848.6us
I20260709 13:12:50.178035  1155 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:50.210414  1263 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:50.209331  1248 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:50.238211 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 59942.4us
I20260709 13:12:50.217442  1230 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.242772 30150 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:50.220907  1096 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.252902  1343 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.221493  1155 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:50.222702  1316 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.230630  1321 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.245235  1142 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:50.290050 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 106837us
W20260709 13:12:50.297889 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 55263.3us
I20260709 13:12:50.278044  1058 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:12:50.282807  1321 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:50.288014  1013 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.303238 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:50.284386  1316 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.299113  1142 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:50.305523  1321 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:50.330545 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 110873us
I20260709 13:12:50.290894  1273 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.331881 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:50.341789 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:50.342025 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:50.300438  1096 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.324450  1213 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.313759   926 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.364523 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:50.344934  1336 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:50.345191  1248 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.344534  1130 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:50.356962  1213 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.371585  1213 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.371641  1273 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.378720  1316 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:50.382763  1200 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:50.386020  1096 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:50.389367   926 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:50.390134 30734 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:50.405984 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64038.6us
I20260709 13:12:50.369783  1336 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:50.411005 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 92484.5us
I20260709 13:12:50.344386  1155 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.442005 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:50.438782 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173046us
W20260709 13:12:50.444921 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 94497.8us
W20260709 13:12:50.446099 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.413218  1336 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.409248  1162 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:50.446983 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.393206  1248 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.403838  1130 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:12:50.462108 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 120401us
I20260709 13:12:50.418119  1352 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:50.465996 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 115756us
I20260709 13:12:50.475282 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:50.456785  1058 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:50.420603  1343 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:50.480233 30150 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:50.477375  1215 consensus_meta.cc:287] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.002s
I20260709 13:12:50.449311  1334 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:50.475282  1352 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:50.494009 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:50.478947  1355 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:50.503324 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:50.526439  1360 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:50.533713 30705 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:52.556118  1354 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:52.556345 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 2.04755e+06us
I20260709 13:12:52.556661  1354 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:52.081293  1366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.000s	sys 0.000s
I20260709 13:12:52.157591  1369 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:52.557807  1366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.338s	user 0.000s	sys 0.000s
I20260709 13:12:52.558034  1369 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:52.560732  1369 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:52.158788  1370 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:12:51.561142  1013 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 1.252s	user 0.009s	sys 0.005s
I20260709 13:12:52.699762  1013 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:52.174041  1373 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:52.594807  1397 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.066473  1397 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.068905  1397 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:52.597599  1398 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:53.069753  1398 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.072153  1398 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:52.602512  1399 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:52.610558  1400 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.072968  1399 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.073096  1400 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:52.527194 30704 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.607s (SENT) [suppressed 20 similar messages]
I20260709 13:12:52.557368 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:52.390897 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 935) took 2325 ms. Trace:
I20260709 13:12:52.607547  1055 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:52.692167  1401 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.698101  1403 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:53.485551  1403 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.488096  1403 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:52.329592 30001 connection.cc:256] RPC call timeout handler was delayed by -1.0338784170000963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:12:52.334602 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 1.85412e+06us
W20260709 13:12:52.662333 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.306090 30079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.820s	user 0.021s	sys 0.016s
W20260709 13:12:53.557523 30079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.073s	user 0.021s	sys 0.020s
W20260709 13:12:52.401386 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.431741 30109 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:53.563094 30109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36342 (request call id 815) took 3079 ms (client timeout 3156 ms). Trace:
I20260709 13:12:52.443904 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:53.563540 30109 rpcz_store.cc:269] 0709 13:12:50.483442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.483600 (+   158us) service_pool.cc:224] Handling call
0709 13:12:53.563023 (+3079423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:53.565354 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36342 (request call id 817) took 1165 ms. Trace:
I20260709 13:12:53.565796 30112 rpcz_store.cc:276] 0709 13:12:52.399502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.443479 (+ 43977us) service_pool.cc:224] Handling call
0709 13:12:53.565264 (+1121785us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:52.484275 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.994s	user 0.007s	sys 0.020s
W20260709 13:12:52.350205 30150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.836s	user 0.011s	sys 0.036s
I20260709 13:12:53.568971  1406 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.610282 30153 connection.cc:256] RPC call timeout handler was delayed by -1.1839758959999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:12:53.570708  1314 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.571285  1314 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.087607 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:53.573630  1314 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:53.125602 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 598417us
W20260709 13:12:53.165359 30762 debug-util.cc:398] Leaking SignalData structure 0x7b0800356840 after lost signal to thread 28925
I20260709 13:12:53.126358 30734 rpcz_store.cc:276] 0709 13:12:50.065898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.066037 (+   139us) service_pool.cc:224] Handling call
0709 13:12:50.076019 (+  9982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.390524 (+314505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.390467 (+1999943us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400527454. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:52.390761 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721996672}
I20260709 13:12:52.368697  1096 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.500655  1133 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.584268 30738 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:53.585299  1133 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:50.446122  1142 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.588745  1403 consensus_queue.cc:1059] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:50.489871  1155 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.595487  1410 raft_consensus.cc:3055] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:53.595911  1410 raft_consensus.cc:740] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:50.875082  1213 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:50.531827  1215 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.561754  1226 raft_consensus.cc:3055] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:53.606438  1226 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:53.607507  1226 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.608587  1226 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.509661  1230 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:53.610735  1230 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:53.611241  1230 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:51.012589  1248 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.615089  1248 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:53.615677  1248 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:51.968502  1263 consensus_meta.cc:287] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.710s	user 0.014s	sys 0.000s
I20260709 13:12:53.619009  1263 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.125696  1276 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:53.622778  1276 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:53.623907  1276 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.625756 30735 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:53.627141 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 937) took 3275 ms. Trace:
I20260709 13:12:53.627547 30735 rpcz_store.cc:276] 0709 13:12:50.352132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.352310 (+   178us) service_pool.cc:224] Handling call
0709 13:12:50.367515 (+ 15205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:53.626226 (+3258711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.626861 (+   635us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b540027bfd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:53.627071 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7492568960}
W20260709 13:12:51.560791  1321 consensus_meta.cc:287] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.223s	user 0.005s	sys 0.007s
I20260709 13:12:53.629982  1321 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:51.017772  1334 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:50.530273  1336 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.635879  1321 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.637080  1336 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:50.524834  1349 log.cc:927] Time spent T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:12:52.465332  1337 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 2.466s	user 0.012s	sys 0.008s
I20260709 13:12:50.527906  1352 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.643478 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2133) took 3782 ms. Trace:
I20260709 13:12:52.557240  1354 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.561630  1370 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.652662  1370 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:52.159308  1371 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:53.654189  1371 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.656764  1371 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:52.160305  1372 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:53.658308  1372 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.660805  1372 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:52.168205  1374 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.663683  1374 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:52.169754  1375 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:52.176044  1376 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:53.666651  1375 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.667330  1376 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.669934  1376 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:52.321975  1380 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.370302  1383 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.321054  1378 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:53.673146  1383 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.674031  1378 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:53.675189  1378 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.675904  1383 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:52.438242  1388 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:53.677642  1388 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.678485  1213 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:53.680486  1388 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:52.334476  1379 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.682523  1379 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:52.328984  1381 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:53.686655  1381 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:52.365762  1382 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.371902  1384 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.445389  1389 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.463922  1392 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.430363  1391 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.466566  1395 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.471374  1394 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:53.075598  1400 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.065763  1373 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.075546  1399 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.485494  1401 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:52.777117 29930 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 148) took 9681 ms. Trace:
I20260709 13:12:53.484629  1055 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.552907 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:53.561264  1361 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:53.561286 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.563668 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.565905  1405 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.568027  1402 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.568065 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.078s	user 0.008s	sys 0.020s
I20260709 13:12:53.569602  1406 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:53.098650 30077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.611s	user 0.026s	sys 0.027s
I20260709 13:12:53.577751  1385 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:12:53.124883 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 567605us
W20260709 13:12:53.578218 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08003268c0 after lost signal to thread 29970
I20260709 13:12:53.578415  1398 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.736214  1375 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.770877  1398 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.569594 30150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.059s	user 0.011s	sys 0.038s
I20260709 13:12:53.737512  1130 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.582266  1096 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.586742  1314 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.597102  1403 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:53.596781  1410 consensus_queue.cc:260] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.639654  1263 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:53.643963 30034 rpcz_store.cc:276] 0709 13:12:49.861049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.864256 (+  3207us) service_pool.cc:224] Handling call
0709 13:12:49.864563 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.894344 (+ 29781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.894377 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.894914 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.975416 (+ 80502us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:49.975480 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.975592 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.464617 (+2489025us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:53.643080 (+1178463us) raft_consensus.cc:1685] finished
0709 13:12:53.643107 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.643354 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56706,"raft.queue_time_us":30432,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":12572032,"thread_start_us":80100,"threads_started":1,"wal-append.queue_time_us":98237}
I20260709 13:12:52.318359  1377 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:53.670802  1374 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.691228  1382 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.692970  1248 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.692508  1384 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.690678  1379 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:53.697228 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08000f90c0 after lost signal to thread 28925
W20260709 13:12:53.786556 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08001a53c0 after lost signal to thread 29970
W20260709 13:12:53.787045 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4c80 after lost signal to thread 29984
I20260709 13:12:53.744144  1391 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.707437  1215 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.773854 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.641604 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2309) took 3612 ms. Trace:
I20260709 13:12:53.745177  1395 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.788766 30107 rpcz_store.cc:276] 0709 13:12:50.029189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.029312 (+   123us) service_pool.cc:224] Handling call
0709 13:12:50.131640 (+102328us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:12:50.152862 (+ 21222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.159263 (+  6401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.159316 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:50.166309 (+  6993us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.283537 (+117228us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:50.283598 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.283707 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:53.641118 (+3357411us) raft_consensus.cc:1685] finished
0709 13:12:53.641143 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.641380 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6132,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":2462464,"thread_start_us":116779,"threads_started":1,"wal-append.queue_time_us":191401}
I20260709 13:12:53.774667  1130 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.791237 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:53.792223  1395 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.792740 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:53.746134  1394 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.753597 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 207264us
I20260709 13:12:53.794878  1130 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:53.724314  1354 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.795526  1394 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:53.797086  1354 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:53.755236 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 182373us
I20260709 13:12:53.798008 30737 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:53.743184  1392 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.800422 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800168160 after lost signal to thread 30062
I20260709 13:12:53.756294  1055 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:53.757299 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 204507us
I20260709 13:12:53.801834 30740 raft_consensus.cc:2393] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
W20260709 13:12:53.802124 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 3.33101e+06us
W20260709 13:12:53.801674 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0d20 after lost signal to thread 30062
W20260709 13:12:53.803128 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08003d52a0 after lost signal to thread 30137
W20260709 13:12:53.803557 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08003ceb40 after lost signal to thread 30138
W20260709 13:12:53.804401 30762 debug-util.cc:398] Leaking SignalData structure 0x7b080033d2a0 after lost signal to thread 30137
W20260709 13:12:53.804746 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800321e00 after lost signal to thread 30211
W20260709 13:12:53.804822 30762 debug-util.cc:398] Leaking SignalData structure 0x7b080025cdc0 after lost signal to thread 30138
I20260709 13:12:53.806035 30179 raft_consensus.cc:1240] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:53.806418 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1360 after lost signal to thread 30211
I20260709 13:12:53.805946  1379 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:53.807780 30762 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8d20 after lost signal to thread 30765
W20260709 13:12:53.808128 30762 debug-util.cc:398] Leaking SignalData structure 0x7b0800375d20 after lost signal to thread 30766
I20260709 13:12:53.808852 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:53.809566  1391 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.757625  1361 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.810346 30134 debug-util.cc:398] Leaking SignalData structure 0x7b080012cbe0 after lost signal to thread 30765
W20260709 13:12:53.810714 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08003a12e0 after lost signal to thread 30766
I20260709 13:12:53.759594  1385 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.811038 30134 debug-util.cc:398] Leaking SignalData structure 0x7b080031dce0 after lost signal to thread 1133
W20260709 13:12:53.811342 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800342ec0 after lost signal to thread 1142
W20260709 13:12:53.811574 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800367620 after lost signal to thread 1155
W20260709 13:12:53.811805 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc580 after lost signal to thread 1213
I20260709 13:12:53.811990  1361 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.812569  1361 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.761174  1406 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.760613  1230 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.814148  1406 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.814656  1406 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.815745  1230 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.816965  1406 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.773257  1398 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.812789  1385 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.762830  1405 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.758678  1373 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.766076 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.768096 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.837286 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:53.819484  1392 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.769773 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.775218 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.775409 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.761610  1389 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.821487 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:53.823122 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:53.759292 30077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.272s	user 0.026s	sys 0.028s
I20260709 13:12:53.752473  1401 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.778221  1410 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:53.825045  1354 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.877810  1354 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.834662  1391 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:53.881009  1354 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:53.812034 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800342c60 after lost signal to thread 1215
I20260709 13:12:53.825758 30186 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:53.785492  1384 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:53.840063 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:53.783304  1382 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:53.841928 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 246140us
I20260709 13:12:53.892232 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:53.893595 30107 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:53.893953  1389 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.892290 30179 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:53.843887 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:53.844765 30735 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:53.906412  1415 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:53.854905 30705 connection.cc:256] RPC call timeout handler was delayed by -2.3517327480001313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:12:53.845049 30739 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:53.777138  1096 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.757356  1408 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:53.907697  1408 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.908205  1408 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:53.908061  1412 consensus_queue.cc:1059] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:53.908556  1406 consensus_queue.cc:1059] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:53.909442 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 73306us
I20260709 13:12:53.908598 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.909825 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.910487 30740 raft_consensus.cc:2410] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:12:53.907248 30705 connection.cc:256] RPC call timeout handler was delayed by -2.2965875620000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:12:53.754514 29930 rpcz_store.cc:276] 0709 13:12:43.100036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.110247 (+ 10211us) service_pool.cc:224] Handling call
0709 13:12:52.777028 (+9666781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:50.450878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:50.494089 (+ 43211us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:50.494157 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:12:50.494180 (+    23us) tablet.cc:662] Decoding operations
0709 13:12:50.495493 (+  1313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:50.495598 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:50.495630 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:12:50.497004 (+  1374us) tablet.cc:701] Row locks acquired
0709 13:12:50.497066 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:12:50.497251 (+   185us) write_op.cc:270] Start()
0709 13:12:50.508882 (+ 11631us) write_op.cc:276] Timestamp: P: 1783602770497187 usec, L: 0
0709 13:12:50.513792 (+  4910us) op_driver.cc:348] REPLICATION: starting
0709 13:12:50.561281 (+ 47489us) log.cc:844] Serialized 4430 byte log entry
0709 13:12:52.125200 (+1563919us) op_driver.cc:464] REPLICATION: finished
0709 13:12:52.131895 (+  6695us) write_op.cc:301] APPLY: starting
0709 13:12:52.132024 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:52.132688 (+   664us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:52.132872 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:52.137618 (+  4746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:52.138058 (+   440us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:12:52.138127 (+    69us) write_op.cc:312] APPLY: finished
0709 13:12:52.139270 (+  1143us) log.cc:844] Serialized 83 byte log entry
0709 13:12:52.139510 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:52.139652 (+   142us) write_op.cc:454] Released schema lock
0709 13:12:52.139699 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:52.140118 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:52.140149 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":260738,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":5993,"apply.run_cpu_time_us":4257,"apply.run_wall_time_us":8202,"num_ops":11,"prepare.queue_time_us":233942,"prepare.run_cpu_time_us":9638,"prepare.run_wall_time_us":153133,"raft.queue_time_us":984946,"raft.run_cpu_time_us":4560,"raft.run_wall_time_us":21178,"replication_time_us":1596190,"thread_start_us":1465900,"threads_started":4,"wal-append.queue_time_us":13207,"wal-append.run_cpu_time_us":9311,"wal-append.run_wall_time_us":2984528}]]}
I20260709 13:12:53.907697 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.912240  1412 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:53.765448  1378 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.912704  1412 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:53.813059  1361 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.845029 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:53.913816 30002 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:53.914007  1230 raft_consensus.cc:3055] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:53.914485  1230 raft_consensus.cc:740] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:53.915428  1230 consensus_queue.cc:260] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.916613  1230 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.868638  1394 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.918408  1394 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.919404  1412 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.920941  1394 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.871639  1263 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.873754 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52390.5us
I20260709 13:12:53.874322  1392 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:53.874977 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:53.875466 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 3.40691e+06us
I20260709 13:12:53.758558  1402 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:53.923005 30705 connection.cc:256] RPC call timeout handler was delayed by -2.1588875620000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:12:53.924755 30705 connection.cc:256] RPC call timeout handler was delayed by -2.1588875620000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 13:12:53.777491  1314 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:53.926225 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.926723 30110 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:53.876204  1405 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.921146  1412 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:53.781173  1377 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.883507 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:53.758841 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 3.26924e+06us
I20260709 13:12:53.737244  1381 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.888020 30734 raft_consensus.cc:2410] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:53.871045 30741 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:53.890964 30134 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3ba0 after lost signal to thread 1226
W20260709 13:12:53.945955 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800340360 after lost signal to thread 1230
W20260709 13:12:53.946233 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800342f00 after lost signal to thread 1248
W20260709 13:12:53.946439 30134 debug-util.cc:398] Leaking SignalData structure 0x7b080015e020 after lost signal to thread 1263
W20260709 13:12:53.946697 30134 debug-util.cc:398] Leaking SignalData structure 0x7b080015e7c0 after lost signal to thread 1321
I20260709 13:12:53.946573 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:53.946923 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800390220 after lost signal to thread 1334
I20260709 13:12:53.906883  1415 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:53.947116 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.947391 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:53.947726 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.935348  1361 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:53.948483 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.947145 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800326200 after lost signal to thread 1336
W20260709 13:12:53.949110 30134 debug-util.cc:398] Leaking SignalData structure 0x7b0800131300 after lost signal to thread 1349
W20260709 13:12:53.949332 30134 debug-util.cc:398] Leaking SignalData structure 0x7b080038a2a0 after lost signal to thread 1352
I20260709 13:12:53.949564 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:53.950145 30106 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:53.944355 29936 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 5 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:53.947956  1377 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.957255 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:53.959038 29936 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 5 to 6, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 6 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.960142  1096 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.960629  1096 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.961005  1096 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.963155 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.926281  1401 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:53.965840 30739 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:53.965545  1401 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.967401 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "ef9ab4d665234a799376bf42ef5d058c"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:53.968181 30034 raft_consensus.cc:606] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:53.968545 30034 raft_consensus.cc:614] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:53.928159 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:53.930150  1402 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:53.931891  1314 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.923475  1392 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:53.926294  1391 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.834830  1395 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:12:53.934497 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:53.932507  1263 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.936463  1405 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:53.935400 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:53.969173  1401 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:53.981805 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46511.4us
I20260709 13:12:53.982523  1405 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.982904 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:53.944473 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:53.947821  1415 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:53.943287 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.867206 30738 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 5.
I20260709 13:12:53.985747 30735 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:53.911733  1248 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.955261 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.985845  1415 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.967185 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.969070 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.980989  1392 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.983093  1405 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.008086 30704 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:53.964685 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:53.997632 30734 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:53.923897 30185 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:53.955941  1226 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:53.974001 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:54.006503 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.015996 30034 raft_consensus.cc:606] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.016783 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.017482 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.019152 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.004127 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:53.927525 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.020138 30107 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:54.022102 30032 raft_consensus.cc:1217] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:12:54.022707 30032 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:54.023828 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:54.024468 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 90090.3us
I20260709 13:12:54.024830 30030 raft_consensus.cc:2410] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:54.024755 30077 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:54.025218  1410 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:54.025671  1410 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.026044  1410 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.026440 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.026876 30032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88e3e05564894b51b12ceb093978f695"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:54.027750 30032 raft_consensus.cc:606] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.027804 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.028191 30032 raft_consensus.cc:614] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:54.029629  1361 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.030053  1361 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.030467  1361 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.030719 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.031615 30733 raft_consensus.cc:2410] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:54.032469 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.033059 30733 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:54.013459  1142 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:54.015216 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:54.037632 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54807.9us
I20260709 13:12:53.986999 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.038110 30036 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.027251 30031 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:54.025972 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.026111 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.033190 30705 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.033656 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.033852 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:54.034126  1405 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.941728 30109 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:54.035111 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.043493 30038 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:54.035674 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.036887 30029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:54.044661 30029 raft_consensus.cc:606] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.009087 30741 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:12:54.037565 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.045344 30704 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.011621 29936 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:54.019306  1226 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:54.034366  1384 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:54.048859  1336 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.049574  1336 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.050499  1394 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:54.050742  1416 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:54.050987  1394 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.051301  1416 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.051476  1394 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.051677  1336 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:54.042800 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.048895  1226 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:54.052727 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:53.988974  1055 consensus_queue.cc:1059] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:54.053526  1226 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.047570 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:53.989253  1385 consensus_queue.cc:1059] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:12:54.047019  1155 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.054560 30107 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:53.988663  1360 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.055327  1360 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.054937  1155 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.047698 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.055733  1360 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.056382 30740 raft_consensus.cc:2410] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:53.952814  1408 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.048401  1213 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.041440 30738 raft_consensus.cc:2376] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12. Re-sending same reply.
I20260709 13:12:54.057907  1213 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.058676  1226 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:54.060366  1213 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.060685 30029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:12:53.997609  1248 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.051726  1416 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.061681  1248 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.057260  1155 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:54.062610  1155 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.063839 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.064720 30180 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.065788 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.066992 30036 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:54.067158 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.034211  1382 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:12:54.055552  1406 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:53.986135  1263 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:53.989534  1398 consensus_queue.cc:1059] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:12:54.056387  1381 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:54.054808  1385 raft_consensus.cc:3055] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:54.067960 30186 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
W20260709 13:12:54.077732 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44614us
I20260709 13:12:54.061302 30029 raft_consensus.cc:606] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.078773 30029 raft_consensus.cc:614] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:54.076210 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.006773  1401 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:54.072067 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.098436 30036 raft_consensus.cc:2410] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:54.098522 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.099395 30179 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.080251 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.081619  1263 raft_consensus.cc:2804] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:54.070998  1384 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:54.085855 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.104667 30037 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:54.086032 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.086257  1377 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:54.077073  1406 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:54.071223  1400 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.108793 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.069051  1314 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.093669  1055 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:54.071695  1378 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:54.045831  1402 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.033187  1096 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.107059 30185 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:54.118716 30037 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:54.102257 30704 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.102624  1401 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:54.077803  1385 raft_consensus.cc:740] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:54.110321 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.111425 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.125573 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.095525  1215 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:54.106769  1377 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:54.105199 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.116484 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.143193 30187 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.107178  1382 consensus_queue.cc:1059] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:12:54.111249  1055 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:54.111058  1372 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.118692 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.120322  1375 raft_consensus.cc:993] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:54.123392 29936 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 4 to 5, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 5 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.124330  1416 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.106738  1384 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.128357 30704 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.109706  1403 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.118067 30004 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:54.133203 30186 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:54.111209  1263 raft_consensus.cc:697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:54.112672 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.111286  1314 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.134608  1389 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.144259 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.146414  1406 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.146888 30187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d11240e2763045ecaa6122102420302e"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:12:54.164574 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.147050 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.147573  1402 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:54.154342  1384 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.152029 30737 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:54.158859  1403 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.132939  1401 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:54.156445 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.161440  1314 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:54.221088 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.152321  1410 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.153743 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.157969 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.159215 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.223816 30112 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:54.224145 30185 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:54.113142  1392 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.163077 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.135069  1215 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:54.225545 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.126068  1378 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.147889  1408 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.115090  1400 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:54.172466 30002 connection.cc:256] RPC call timeout handler was delayed by -3.6557544029999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:12:54.211938 30186 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:54.213587  1380 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:54.160822  1389 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.153021  1415 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.283223  1389 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.283403  1415 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.285643  1380 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:54.153951  1388 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:54.151429 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.286259  1388 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.286651 30183 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.286785 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.287712 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.287756 30185 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:54.288441 30183 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:12:54.288880 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.214017 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.286688  1388 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.289733 30185 raft_consensus.cc:2410] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:54.290297 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.290555 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.290954 30180 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 4.
I20260709 13:12:54.291828 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.292518 30180 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.292634  1380 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.151350  1372 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.294898  1372 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.161886  1373 raft_consensus.cc:1081] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:54.295269  1263 consensus_queue.cc:237] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.289302 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.220448  1230 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:54.297609 30183 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.297843  1230 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.300973  1230 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.302203 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.303089 30180 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:54.204628  1383 raft_consensus.cc:2804] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:54.303642  1383 raft_consensus.cc:697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:54.304025  1360 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.215469  1402 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.156633 30004 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:54.305791 30185 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:12:54.305747 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 149158us
I20260709 13:12:54.306823  1402 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.304590  1383 consensus_queue.cc:237] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.308218 30185 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:54.290228  1215 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.309034  1215 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.308239  1373 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:54.309887  1373 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:54.310016 30153 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.310318  1373 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:54.212980 30182 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
W20260709 13:12:54.224349 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 69095.8us
I20260709 13:12:54.224272 30112 pending_rounds.cc:85] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:12:54.313280 30112 pending_rounds.cc:107] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:54.233073 30181 raft_consensus.cc:2393] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.234179 30178 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:54.235651  1377 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.205700 29936 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 5 to 6, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:54.242328  1376 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.244315  1405 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:54.245433 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0940 after lost signal to thread 28925
I20260709 13:12:54.311759 30153 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:54.246958  1392 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:54.330348 30183 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:12:54.330611 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 110949us
I20260709 13:12:54.247315 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.247514  1055 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.249145  1400 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:54.249851 30002 connection.cc:256] RPC call timeout handler was delayed by -2.7896759249999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:12:54.345932 30002 connection.cc:256] RPC call timeout handler was delayed by -2.630375924999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:12:54.346248 30002 connection.cc:256] RPC call timeout handler was delayed by -2.4116759249998267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:12:54.346487 30002 connection.cc:256] RPC call timeout handler was delayed by -2.3675759249999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:12:54.346715 30002 connection.cc:256] RPC call timeout handler was delayed by -2.1920759249999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 13:12:54.346941 30002 connection.cc:256] RPC call timeout handler was delayed by -1.3190759249998791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3134s for a response
W20260709 13:12:54.347177 30002 connection.cc:256] RPC call timeout handler was delayed by -1.3028759249998529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31520000000000004s for a response
I20260709 13:12:54.251606  1395 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.236048  1213 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:54.254859  1276 raft_consensus.cc:3055] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:54.242760  1096 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.262732  1374 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:54.263592  1248 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.266502  1384 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.267158  1410 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:54.268074 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.271301  1394 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.221766  1403 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.282363  1391 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.285734  1415 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.302866  1416 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.312657 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.354494  1276 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:54.211198 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 135108us
I20260709 13:12:54.313746 30112 raft_consensus.cc:2889] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:54.324952 30110 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
W20260709 13:12:54.330291 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001095c0 after lost signal to thread 29970
I20260709 13:12:54.214094  1385 consensus_queue.cc:260] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.337366 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.341796 30184 raft_consensus.cc:2393] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 5: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:54.386312  1385 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.386933 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.341521  1376 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.396205  1376 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.342932 29936 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 4 to 6, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 6 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.345427 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.398202 30109 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.348326 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.348465 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.306866  1360 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:54.355942 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.406497 30032 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:54.356068 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.356401 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.333563  1226 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:54.359082 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.362038 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.411509 30180 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:54.364032 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.366863 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.364756 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.412580 30030 raft_consensus.cc:3060] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:54.354924  1213 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.350859  1336 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.357488  1055 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.355697  1395 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:54.162144 30077 connection.cc:256] RPC call timeout handler was delayed by -3.6920746099999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:12:54.430120 30077 connection.cc:256] RPC call timeout handler was delayed by -3.5174746099999084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:12:54.430697 30077 connection.cc:256] RPC call timeout handler was delayed by -3.3032746100000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:12:54.431241 30077 connection.cc:256] RPC call timeout handler was delayed by -3.3032746100000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:12:54.428778 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:54.431668 30077 connection.cc:256] RPC call timeout handler was delayed by -3.2644259139999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:12:54.379324 30031 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:54.344960  1314 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:54.387696 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1680 after lost signal to thread 29984
W20260709 13:12:54.436759 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8080 after lost signal to thread 30001
W20260709 13:12:54.437083 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001a47e0 after lost signal to thread 30002
W20260709 13:12:54.438162 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001301a0 after lost signal to thread 30062
W20260709 13:12:54.438547 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800108420 after lost signal to thread 30076
W20260709 13:12:54.438835 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8ac0 after lost signal to thread 30079
W20260709 13:12:54.439213 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003009c0 after lost signal to thread 30088
I20260709 13:12:54.439452 30109 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:54.439778 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001c72e0 after lost signal to thread 30109
W20260709 13:12:54.440160 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003484c0 after lost signal to thread 30112
W20260709 13:12:54.440766 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800141780 after lost signal to thread 30137
W20260709 13:12:54.441092 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003519a0 after lost signal to thread 30138
I20260709 13:12:54.386353 30183 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:12:54.412981 30181 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:12:54.425473 30184 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:54.390486  1399 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:54.426491 29936 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 5 to 7, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:54.419684  1226 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:54.376924 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64314.7us
I20260709 13:12:54.448753 30151 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:54.364722  1361 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.427582  1380 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.363910  1374 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.433641 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.427841 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.444500 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:54.441366 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb520 after lost signal to thread 30150
I20260709 13:12:54.454485 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.465883 30032 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:54.466149 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080030e380 after lost signal to thread 30151
W20260709 13:12:54.466464 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5440 after lost signal to thread 30153
I20260709 13:12:54.467871 30178 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:12:54.468503 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080035e460 after lost signal to thread 30197
W20260709 13:12:54.468986 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080037b300 after lost signal to thread 30211
I20260709 13:12:54.469214 30038 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:54.459332  1248 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.460094  1377 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:54.458370  1405 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.467865  1416 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.467679  1399 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:54.453763  1401 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.449225  1384 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:54.447476 30077 connection.cc:256] RPC call timeout handler was delayed by -3.1371821770001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:12:54.423851  1213 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:54.446233 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 101166us
W20260709 13:12:54.513207 30077 connection.cc:256] RPC call timeout handler was delayed by -3.0513600839999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 13:12:54.513762 30077 connection.cc:256] RPC call timeout handler was delayed by -3.0273632779999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:12:54.514137 30077 connection.cc:256] RPC call timeout handler was delayed by -2.9850632780000979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 13:12:54.514447 30077 connection.cc:256] RPC call timeout handler was delayed by -2.9458259140001246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:12:54.514810 30077 connection.cc:256] RPC call timeout handler was delayed by -2.8370746099999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
I20260709 13:12:54.473254 30036 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:54.515066 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.494081 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.496085 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.470214 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003638e0 after lost signal to thread 30765
I20260709 13:12:54.497095 30030 raft_consensus.cc:2468] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:54.481937 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.482366 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.519510 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.520311 30740 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:12:54.521013 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:54.517068 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca460 after lost signal to thread 30766
I20260709 13:12:54.521217  1373 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.477564  1276 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.522188 30738 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:54.489164  1394 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.518072 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.491114  1378 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:54.490130 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.552692 30031 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:12:54.451105  1226 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.493491  1399 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.531677 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.562933 30185 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.487284  1314 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:54.495788 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.566323 30035 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:54.490485 30033 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:12:54.518092 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.569872 30030 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:54.522460 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.578152 30036 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:54.472123  1380 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.533807 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.526257 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.579409 30181 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.480984 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.580313 30032 raft_consensus.cc:3060] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.480350 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.473764  1374 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:54.515134 30077 connection.cc:256] RPC call timeout handler was delayed by -2.775725914000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:12:54.491950  1416 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.528735  1361 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:54.539072 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 88637.8us
W20260709 13:12:54.594714 30077 connection.cc:256] RPC call timeout handler was delayed by -2.6112595290001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:12:54.595105 30077 connection.cc:256] RPC call timeout handler was delayed by -2.6112595290001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:12:54.595384 30077 connection.cc:256] RPC call timeout handler was delayed by -2.5710696160001589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:12:54.595643 30077 connection.cc:256] RPC call timeout handler was delayed by -2.5255430279999018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 13:12:54.539426 30180 raft_consensus.cc:2410] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:54.500663  1403 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.468072  1142 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.446883 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:54.541563 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800299260 after lost signal to thread 1096
I20260709 13:12:54.542900 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:54.549194 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.560093 30029 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
W20260709 13:12:54.599326 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 56538.8us
I20260709 13:12:54.599099 30184 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
W20260709 13:12:54.564210 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 210361us
I20260709 13:12:54.587127 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.593055 30178 raft_consensus.cc:2410] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:54.543650  1384 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.594453 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.496941 30037 raft_consensus.cc:2468] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
W20260709 13:12:54.595906 30077 connection.cc:256] RPC call timeout handler was delayed by -2.5136001109999597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2666s for a response
I20260709 13:12:54.596134 30187 raft_consensus.cc:606] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.526257  1395 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.596603 30038 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:54.599089 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080030b1e0 after lost signal to thread 1133
I20260709 13:12:54.601367 30030 raft_consensus.cc:2410] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:12:54.607482 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6320 after lost signal to thread 1142
W20260709 13:12:54.607769 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6720 after lost signal to thread 1155
W20260709 13:12:54.608055 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080035b0e0 after lost signal to thread 1213
W20260709 13:12:54.608348 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080004bd40 after lost signal to thread 1215
W20260709 13:12:54.608687 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003865e0 after lost signal to thread 1226
W20260709 13:12:54.608963 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9d20 after lost signal to thread 1230
W20260709 13:12:54.609257 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800325f40 after lost signal to thread 1248
W20260709 13:12:54.609613 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9e00 after lost signal to thread 1263
W20260709 13:12:54.609944 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080018a4a0 after lost signal to thread 1321
W20260709 13:12:54.610224 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080032a8e0 after lost signal to thread 1334
W20260709 13:12:54.610509 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa3e0 after lost signal to thread 1336
W20260709 13:12:54.610781 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800358ca0 after lost signal to thread 1337
W20260709 13:12:54.611102 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003df220 after lost signal to thread 1349
W20260709 13:12:54.612280 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003922c0 after lost signal to thread 1352
W20260709 13:12:54.612540 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002c08e0 after lost signal to thread 1354
W20260709 13:12:54.605072 30077 connection.cc:256] RPC call timeout handler was delayed by -2.4353001110000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27530000000000004s for a response
I20260709 13:12:54.605165 30187 raft_consensus.cc:614] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:54.606797 30035 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:54.616771 30153 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:54.614464 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.616294 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:54.614813 30704 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.614238 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.625470 30036 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:12:54.613442 30077 connection.cc:256] RPC call timeout handler was delayed by -2.4050746099999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29940000000000005s for a response
W20260709 13:12:54.626034 30077 connection.cc:256] RPC call timeout handler was delayed by -2.3042746099999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3106s for a response
W20260709 13:12:54.626338 30077 connection.cc:256] RPC call timeout handler was delayed by -2.1563001110000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3063s for a response
W20260709 13:12:54.626600 30077 connection.cc:256] RPC call timeout handler was delayed by -1.9747259140001461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30600000000000005s for a response
I20260709 13:12:54.626449 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:54.627009 30077 connection.cc:256] RPC call timeout handler was delayed by -1.1782430279997698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3502s for a response
I20260709 13:12:54.619675 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:54.623507 30704 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:54.623916 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:54.620827 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.624671 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.628906 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:54.612866 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080012c6c0 after lost signal to thread 1370
I20260709 13:12:54.625079 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:54.629730 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8300 after lost signal to thread 1371
W20260709 13:12:54.630038 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800352240 after lost signal to thread 1372
W20260709 13:12:54.630324 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080036a2a0 after lost signal to thread 1374
W20260709 13:12:54.630584 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001f60c0 after lost signal to thread 1375
W20260709 13:12:54.630839 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080039c280 after lost signal to thread 1376
W20260709 13:12:54.631105 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800227260 after lost signal to thread 1377
W20260709 13:12:54.631369 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800385280 after lost signal to thread 1378
W20260709 13:12:54.631615 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb2a0 after lost signal to thread 1379
W20260709 13:12:54.631862 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800306fa0 after lost signal to thread 1380
W20260709 13:12:54.631958 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.633342 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:54.632112 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc320 after lost signal to thread 1381
W20260709 13:12:54.635241 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08001daea0 after lost signal to thread 1382
I20260709 13:12:54.607632  1384 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.654073 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.625022  1142 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:54.697219 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.661723 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.699222 30109 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.662889 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.665210 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.673760 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.700022 30180 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.674154 30112 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.676249 30035 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.658593 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.796203 30030 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:54.659299 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.797154 30178 raft_consensus.cc:2410] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:54.659694 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.658106 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.798072 30037 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:54.798159 30036 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:54.799199 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.619884  1383 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:12:54.612763  1429 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:54.682178 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080028c540 after lost signal to thread 1383
I20260709 13:12:54.682983 30185 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
W20260709 13:12:54.810104 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003762c0 after lost signal to thread 1384
W20260709 13:12:54.810525 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003312c0 after lost signal to thread 1388
W20260709 13:12:54.810835 30208 debug-util.cc:398] Leaking SignalData structure 0x7b080035fd00 after lost signal to thread 1389
W20260709 13:12:54.811138 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef4e0 after lost signal to thread 1391
W20260709 13:12:54.811403 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08002dff40 after lost signal to thread 1392
I20260709 13:12:54.696484  1384 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.814385 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.683668 30029 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:54.683629 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:54.816198 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 132780us
I20260709 13:12:54.653371  1401 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:54.818331 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.660493 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.633603  1382 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:54.653422  1055 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:54.612572  1389 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.703227 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.655231  1431 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:54.800089 30036 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:54.803990 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.618374 30038 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
W20260709 13:12:54.811782 30208 debug-util.cc:398] Leaking SignalData structure 0x7b08003248c0 after lost signal to thread 1394
I20260709 13:12:54.617920  1276 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.820382 30184 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
W20260709 13:12:54.821184 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 197753us
I20260709 13:12:54.819254 30033 raft_consensus.cc:2376] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10. Re-sending same reply.
I20260709 13:12:54.832728 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.812780  1429 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.834551 30031 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:54.833242 30106 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.795399  1435 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:54.835295 30208 debug-util.cc:398] Leaking SignalData structure 0x7b0800190ca0 after lost signal to thread 1395
I20260709 13:12:54.846176 30038 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:12:54.846164 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.852658 30030 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:12:54.846491 30033 raft_consensus.cc:1240] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:54.851615 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:54.854733 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.855190 30106 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:54.857317 30036 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:54.859127 30036 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:54.860746 30035 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:54.697499  1215 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:12:54.821698  1382 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.879626 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:54.880517 30037 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:54.882534 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.883315 30187 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:54.884362 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.885202 30187 raft_consensus.cc:2368] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
W20260709 13:12:54.885614 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34f51764a89048468a6faa21020812b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:12:54.886471 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 262024us
I20260709 13:12:54.887639 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.888388 30105 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:54.889894 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.890753 30108 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:54.835614  1394 raft_consensus.cc:2804] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:54.891841 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.892817 30113 raft_consensus.cc:2393] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:54.894079 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.894892 30111 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:12:54.895637 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.897820 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.898247 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.898644 30104 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:54.898945 30739 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:54.899056 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:54.841112  1429 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:54.897890 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.897895 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:12:54.842144  1388 consensus_meta.cc:287] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:12:54.796875  1142 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:54.914263 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:54.916075 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.916947 30106 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:54.918169 30740 raft_consensus.cc:2368] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:54.920710 30181 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:54.922120 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.923050 30109 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:12:54.924682 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.926136 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:54.865963 30033 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:54.927330 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.851758 30038 pending_rounds.cc:85] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 4
I20260709 13:12:54.928143 30038 pending_rounds.cc:107] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:54.868203 30112 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:54.928510 30106 raft_consensus.cc:2376] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8. Re-sending same reply.
I20260709 13:12:54.868314 30030 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:54.870805 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:54.930478 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.930572 30107 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.932272 30030 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:54.871657 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:54.872874 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.933669 30110 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.821323  1055 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.823017  1360 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.913247  1394 raft_consensus.cc:697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:54.935487 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.935901 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.936043 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:54.936158 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.928449 30038 raft_consensus.cc:2889] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:54.935633 30037 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:54.940369 30032 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:54.878242 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.947183 30031 raft_consensus.cc:1240] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:54.926931  1434 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:12:54.915165  1373 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.943706  1055 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:54.947297 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.910418  1382 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.947824 30004 leader_election.cc:400] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:54.949350 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.953500 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:54.988677 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.989065 30112 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.989516 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:54.990412 30004 leader_election.cc:403] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.990283 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.992342 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:54.993119 30112 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:54.981746  1416 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.015344  1394 consensus_queue.cc:237] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.016093  1226 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.018996  1226 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:54.956512 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.023175 30180 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:54.958027 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.025286 30183 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:54.928525  1429 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.962280 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:54.962867  1438 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:12:54.965735 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 346090us
I20260709 13:12:55.067883 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:54.946300 30106 raft_consensus.cc:2393] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 5: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:54.914366  1213 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:54.955049 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:54.990329 30185 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:12:54.994421 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 55994.8us
W20260709 13:12:54.994829 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.921605  1388 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.002789 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.005618 30737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:12:54.999356  1373 raft_consensus.cc:3060] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.092618 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.006865  1142 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:55.035166 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 435042us
I20260709 13:12:55.060271 30110 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:12:54.863637 30035 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:55.064716 30109 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.064893 30107 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:55.094022 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:55.096014 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.107784 30185 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:55.097422 30106 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:55.097589 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.099086 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.104496 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.110378 30180 raft_consensus.cc:2410] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:55.107033 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.115176 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:55.116267 30109 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.116495  1442 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:55.117024  1442 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:55.121783 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.123096 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.124241 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:55.125248 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.126595 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.127321 30185 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 6: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.125281 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:55.129344 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.130048 30179 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:55.130152 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:55.130470 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.131057 30107 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:55.117254 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.132814 30109 raft_consensus.cc:2368] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:55.131801 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.137621 30107 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
W20260709 13:12:55.142082 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.142395 30106 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.143641 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.144531 30183 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:55.144665 30109 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:55.128054 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.146960 30185 raft_consensus.cc:2368] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:12:55.137671 30112 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:55.089802  1431 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:55.151120 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.141996  1395 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:55.158361 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.158800  1213 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:55.100770  1055 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.159610 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.159883 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.160439 30180 raft_consensus.cc:2410] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:55.161113  1055 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:55.152244 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.162618  1429 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.162541  1382 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.163074 30186 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:55.164718 30113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:12:55.165341 30113 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.165513  1435 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:55.165764 30113 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.166320 30187 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:55.167395 30178 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:12:55.103417  1263 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.152730 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.154068 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:55.178987 30110 raft_consensus.cc:2393] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:55.178989 30184 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:55.161249 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:55.155975 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.169085 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.151686  1442 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.153769 30106 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:55.184394 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.182539 30180 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:55.185101 30183 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:55.192040 30185 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:55.157800  1395 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.207276  1388 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.178241  1263 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.208416 30183 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:55.211404 30181 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:55.212239 30113 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.219184 30112 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:55.220858 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.222503 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 290139us
I20260709 13:12:55.209025  1395 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:55.225912 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:55.225553 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:55.229194 30030 raft_consensus.cc:3060] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.214653  1263 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.231237 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:55.238749 30032 raft_consensus.cc:3060] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.253726 30113 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.272994 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:55.273900 30037 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.277323 30030 raft_consensus.cc:2468] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
W20260709 13:12:55.301144 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 187029us
I20260709 13:12:55.307458 30032 raft_consensus.cc:2468] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:12:55.233376  1055 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:12:55.241849  1142 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:12:55.313575 30077 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.564s (SENT)
I20260709 13:12:55.247377  1226 consensus_queue.cc:1059] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:12:55.276211  1382 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.328833 30037 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:55.276974  1384 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.331787 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.256311  1431 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.346027 30737 raft_consensus.cc:606] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:12:55.346588 30737 raft_consensus.cc:614] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:55.349213 30736 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:55.342052  1416 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:55.351367 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.351761 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet dadd68eba45b4971b4072c8ef0de88d5: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:12:55.352538 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 253546us
I20260709 13:12:55.359601 30181 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:55.355997 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 225953us
I20260709 13:12:55.360702 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:55.366575 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.371122 30185 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:55.377851 30182 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:55.380846 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.381691 30181 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.395154 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.395898 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:55.395207 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.402279  1384 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.404944 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:55.406000 30739 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:55.407177 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:55.408141 30734 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:55.371304  1399 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.399825 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.419239 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.420045 30183 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:12:55.429550 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.437479 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.438378 30182 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:55.418380 30077 leader_election.cc:336] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 2.117s (SENT)
I20260709 13:12:55.439661 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.456863 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:55.457816 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 97244.2us
I20260709 13:12:55.458019 30184 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:55.453495 30030 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:12:55.466249  1439 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.546s	user 0.006s	sys 0.011s
I20260709 13:12:55.455418  1416 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.466483  1453 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:55.486919  1454 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:55.455338  1458 raft_consensus.cc:2764] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:55.440809  1399 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.464926 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:55.515571 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 126902us
I20260709 13:12:55.471623 30001 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:55.519560 30183 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:55.540786 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.541344 30183 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:55.521435 30181 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:55.546255 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.547139 30181 raft_consensus.cc:2410] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:12:55.534050  1360 consensus_meta.cc:287] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.002s
W20260709 13:12:55.535308  1446 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:55.538087 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.550818 30186 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:55.553921 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:55.556681 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 85139.6us
I20260709 13:12:55.562772 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:55.551980  1360 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:55.559818 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.557363  1403 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:55.573300 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:55.562179  1458 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:55.573334 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48392.4us
I20260709 13:12:55.565970 30183 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:55.578783 30001 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:55.585033  1263 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.596048 30732 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:55.585530  1457 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.598289  1457 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:55.598830  1457 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.585645  1453 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:12:55.570240  1454 raft_consensus.cc:2764] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:55.605713  1263 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.607409  1395 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.609735 30037 raft_consensus.cc:1240] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:55.582973 30001 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:55.617163  1454 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:55.617805  1454 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:55.618891  1454 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:55.621536  1446 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:55.623636 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 2043) took 1040 ms. Trace:
I20260709 13:12:55.624143 30034 rpcz_store.cc:276] 0709 13:12:54.582913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.857154 (+274241us) service_pool.cc:224] Handling call
0709 13:12:54.857927 (+   773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.859103 (+  1176us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:54.913080 (+ 53977us) log.cc:844] Serialized 14 byte log entry
0709 13:12:55.369923 (+456843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.378921 (+  8998us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.379110 (+   189us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:55.379437 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:12:55.501596 (+122159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.501655 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.623360 (+121705us) raft_consensus.cc:1685] finished
0709 13:12:55.623388 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.623565 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113259,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":110,"raft.queue_time_us":400712,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":12370,"thread_start_us":578017,"threads_started":3,"wal-append.queue_time_us":454887}
I20260709 13:12:55.580178  1458 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:55.627660  1458 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.579728  1468 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.629951  1468 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:55.630441  1468 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.640333 30186 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:55.644573 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:55.647836  1399 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:55.648279 30179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50696 (request call id 679) took 1485 ms (client timeout 1803 ms). Trace:
W20260709 13:12:55.648829 30179 rpcz_store.cc:269] 0709 13:12:54.162597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.162766 (+   169us) service_pool.cc:224] Handling call
0709 13:12:55.647996 (+1485230us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54002977d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:55.648162 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060809984}
I20260709 13:12:55.650188 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:55.651062 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 545107us
I20260709 13:12:55.652631 30704 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:55.653718 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.655679 30741 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:55.655959  1373 consensus_meta.cc:287] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.001s
I20260709 13:12:55.656394  1373 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:55.656608  1435 raft_consensus.cc:2804] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:55.657940  1395 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.659802  1394 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:55.663381 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:55.664288 30109 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.666617 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:55.675709 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.677189 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 304842us
I20260709 13:12:55.645783 30186 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:55.678462 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.685914  1389 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.673647  1403 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:55.693032 30151 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:55.738835 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 45893.4us
I20260709 13:12:55.693553  1435 raft_consensus.cc:697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:55.694087 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.694093 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:12:55.695309  1401 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:55.699388  1215 raft_consensus.cc:3055] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:55.675678 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.716786 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:55.750384 30109 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.719437 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:55.701390  1458 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.715458  1354 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:55.739725 30151 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:55.754626 30151 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:12:55.768201 30004 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7a9a88da98d43b8a556cba3e2768e28. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.768819  1213 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:55.740525  1403 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:55.769480  1213 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:55.769814  1403 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:55.770726  1213 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:55.775004 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.775928  1360 consensus_queue.cc:1059] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:55.777514  1352 raft_consensus.cc:3055] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:55.778059  1352 raft_consensus.cc:740] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:55.778369  1470 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:55.751634 30732 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
W20260709 13:12:55.753049 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.749308  1215 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:12:55.757150 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.757615  1142 raft_consensus.cc:2804] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:55.743497 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:55.744729  1226 raft_consensus.cc:2804] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:55.779747  1352 consensus_queue.cc:260] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.809654 30109 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:55.811177 30704 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:55.811782 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 136185us
I20260709 13:12:55.746387 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:55.784770 30038 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:55.794878  1336 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.738387  1392 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:12:55.787699  1401 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:55.821835  1401 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:55.823366  1401 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:55.795941 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.795322 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 64389.9us
I20260709 13:12:55.798576  1473 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.832867  1473 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.814465 30183 raft_consensus.cc:2393] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:55.833526  1473 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.787034  1435 consensus_queue.cc:237] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.752532  1416 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:12:55.809295  1352 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:55.812767 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.809532  1394 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.800542  1142 raft_consensus.cc:697] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:55.811928  1226 raft_consensus.cc:697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:55.802312  1384 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:12:55.792979 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 114611us
W20260709 13:12:55.866420 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 53785.8us
I20260709 13:12:55.870985 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.872289 30109 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:55.873634 30002 leader_election.cc:400] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:55.816820  1452 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:55.876154 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 74466.1us
I20260709 13:12:55.836921  1454 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.885470 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:55.886199 30001 leader_election.cc:336] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.969s (SENT)
I20260709 13:12:55.869984  1484 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:55.914016 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.818035  1457 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.836063  1385 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:12:55.841415  1403 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.927130  1483 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:55.927698  1483 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:55.928171  1416 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.928784  1483 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.873085  1394 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.835196  1336 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.909339  1484 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.947722 30037 raft_consensus.cc:1240] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:55.921116  1475 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:55.954437 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.871443  1215 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.955817 30002 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.898379  1454 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:55.959548  1382 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:55.961510  1142 consensus_queue.cc:237] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.925302  1354 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:12:55.971881 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 100968us
I20260709 13:12:55.974633 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.968318  1395 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:55.981130 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.953832  1484 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.970484  1483 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:55.970541  1385 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.953557  1226 consensus_queue.cc:237] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:55.983433  1395 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.983676  1403 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:55.981980  1453 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:55.985915  1394 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:55.988029 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:56.010736 30186 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 5.
I20260709 13:12:56.011863 30077 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:55.993153 30001 leader_election.cc:336] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.082s (SENT)
I20260709 13:12:56.018318 30705 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:56.019318 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 90062.8us
I20260709 13:12:56.020244 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:56.023761 30107 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:56.000032  1395 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.015985 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:55.996927  1452 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:12:56.026576 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45556.9us
I20260709 13:12:56.014329  1475 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:56.028818 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:56.034749 30077 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:56.030247 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.031608  1403 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:56.036895  1453 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:56.037772 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.036641  1401 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:56.039057  1401 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:56.040182  1401 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.041663  1403 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:56.041998 30112 raft_consensus.cc:1240] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:56.042642  1489 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:12:56.045069 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.046372 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.046458 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:55.998960  1385 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.020197  1493 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:56.050416 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.042740  1403 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.029122  1382 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:56.027171  1392 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.055079 30106 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 4.
I20260709 13:12:56.056840 30113 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:56.057837 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.064708 30108 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:56.058079 30109 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:56.058859 30105 raft_consensus.cc:1240] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:56.059263 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.066542 30110 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:56.045120  1458 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:56.061087 30112 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:56.047716  1478 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:56.059873 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.050051  1453 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:56.061100  1488 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:12:56.071578 30104 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:56.069072 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:56.072329 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.079627 30106 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:56.078475 30108 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:56.065356  1382 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.081508 30002 leader_election.cc:400] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:12:56.083050 30002 leader_election.cc:403] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.081414 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:56.093230 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.117920  1055 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:56.118476  1055 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:56.119374 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.120188 30104 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:56.120442 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.120944 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.086107  1382 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:56.121073 30107 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:56.127379 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.128542 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.129796 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.132915  1454 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:56.131527 30106 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:56.066771  1392 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.133467 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.134460 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.134819 30107 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:56.135248 30111 raft_consensus.cc:2393] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:56.135828 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.136052 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.136698 30107 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:56.137143 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.137562 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.138298 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:12:56.138713 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57353.1us
I20260709 13:12:56.139514 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.139659 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.141153 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.142580 30107 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:12:56.143167 30111 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:56.143456 30106 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:56.085903  1458 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:56.144381  1458 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.144831  1458 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.153677 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.082873  1478 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:56.165684 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49241.7us
W20260709 13:12:56.170957 30001 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.144s (SENT)
I20260709 13:12:56.172060 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:56.112819  1475 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:12:56.188988 30111 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:12:56.242197 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.169137  1453 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:12:56.165333  1454 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.169533  1452 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.073223  1495 consensus_queue.cc:1059] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 13:12:56.339476 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.349999 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 177972us
W20260709 13:12:56.351840  1449 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:12:56.349089  1488 log.cc:927] Time spent T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.107s	user 0.008s	sys 0.000s
W20260709 13:12:56.349741  1468 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.719s	user 0.015s	sys 0.000s
I20260709 13:12:56.367231 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:56.369069 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:56.346334  1213 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:56.374423 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.377252 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 389952us
I20260709 13:12:56.359506  1336 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:56.360044  1475 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:56.391376 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.392661 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.403759 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.472538 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.478336 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.501036 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.501829 30107 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:56.551102 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.552336 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:56.553388 30705 leader_election.cc:336] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.766s (SENT)
I20260709 13:12:56.556962 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.373994  1468 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.471872  1490 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.576889 30104 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:56.579243  1454 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:56.579317 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.581460 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.582983 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:56.584453 30104 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:56.380277  1213 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.586377 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.559713  1336 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.602695 30104 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:56.472182  1509 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:56.602793 30107 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:12:56.604804 30032 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:56.618086 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:56.618186  1394 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:56.626868 30705 leader_election.cc:336] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.919s (SENT)
I20260709 13:12:56.631196  1508 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:56.632035  1508 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:56.632601  1508 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:56.632073  1511 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:12:56.632714  1504 log.cc:927] Time spent T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:12:56.633917  1458 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.591487  1490 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.624257  1336 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.716681  1493 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.570583  1478 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:56.727276  1395 consensus_meta.cc:287] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
W20260709 13:12:56.740329  1382 consensus_meta.cc:287] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.618s	user 0.014s	sys 0.000s
W20260709 13:12:56.769112 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.779307 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 410304us
I20260709 13:12:56.800771 30001 leader_election.cc:400] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:56.802119 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:56.804203 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.815537 30732 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:12:56.790728  1473 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.003s
W20260709 13:12:56.797465  1483 consensus_meta.cc:287] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.002s
I20260709 13:12:56.830894 30185 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:56.772174  1226 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:56.710593  1213 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:56.805241  1484 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.805s	user 0.011s	sys 0.002s
I20260709 13:12:56.842705  1453 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:56.848381  1475 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:56.850984  1055 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.891180  1055 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.891644 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2186) took 1065 ms. Trace:
I20260709 13:12:56.853017 30179 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:56.857952  1523 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:12:56.861102 30002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.049s	sys 0.081s
W20260709 13:12:56.895157 30002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.050s	sys 0.081s
W20260709 13:12:56.895771 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 742209us
I20260709 13:12:56.892211 30032 rpcz_store.cc:276] 0709 13:12:55.826339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.826589 (+   250us) service_pool.cc:224] Handling call
0709 13:12:55.826971 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.609596 (+782625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.891334 (+281738us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003e17d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:12:56.891563 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788416256}
I20260709 13:12:56.896826  1509 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:56.806383  1395 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.898644  1494 raft_consensus.cc:3055] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:56.898927 30741 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:56.899240  1395 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:56.814642  1454 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:56.900138  1454 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.900622  1454 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:56.895233  1518 consensus_queue.cc:1175] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8d2f11cccca04a7683da4080ab797bd7" responder_term: 13 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: [12.11-12.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:56.864187 30107 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:56.830180  1373 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:56.902396  1498 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.556s	user 0.011s	sys 0.004s
I20260709 13:12:56.917140 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:56.880831  1522 consensus_queue.cc:1059] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:56.917893  1509 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:56.919134 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:56.886950  1336 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:56.887238  1468 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:56.889588  1490 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:56.889926  1458 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:56.890292  1475 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:56.851568 30186 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:56.928206  1395 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:56.928659  1395 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.893625 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:56.861647 30111 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:56.870303 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.902269  1523 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.874122  1483 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.930785  1395 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.931034  1483 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.904099  1457 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:56.933039  1514 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:56.905606  1431 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:56.806172  1493 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.911831  1389 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:56.911856  1454 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:56.864483  1473 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.882097  1384 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:56.919320  1509 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:56.885704  1392 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:56.899096  1494 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:56.921298  1336 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:56.925640  1458 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.926141  1490 raft_consensus.cc:3055] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:56.930495 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.825505  1382 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:56.951812 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 399558us
I20260709 13:12:56.947976  1389 consensus_queue.cc:1243] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer 98b3b699b87245df85d3aa84c13f5691 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:56.894246  1484 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:56.970130  1483 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:56.968427  1509 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:57.008909 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 234899us
I20260709 13:12:57.014909 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:12:57.037051 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.008011  1444 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:56.992180  1490 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:56.990527  1514 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:12:57.048568  1521 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:12:57.052048  1508 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.056097  1493 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.057951  1473 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:57.059754  1454 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.062140  1528 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:57.062601  1528 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.062952  1528 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:57.065768  1520 consensus_queue.cc:1059] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:57.068004  1523 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:57.068631  1523 raft_consensus.cc:3055] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:57.068974  1523 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:56.930804  1475 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:57.077657 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.079919 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.072714 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:57.091315 30736 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:57.072299 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:57.093357 30741 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.091410 30038 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:12:57.106549 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.110522 30035 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:57.112048 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.112908 30032 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:57.117810 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:57.118420 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.070696  1484 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:57.118574 30736 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:12:57.091828  1454 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.047106  1444 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:57.132266 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:57.132797 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.133661 30038 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:12:57.129104 30079 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:57.130605 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 310410us
I20260709 13:12:57.139488 30032 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:57.133181 30735 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:57.069296  1395 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.154871 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:57.115242  1055 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:12:57.157882 30032 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:57.158282 30079 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:57.167765 30035 raft_consensus.cc:1275] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:12:57.155548 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 235300us
I20260709 13:12:57.143937  1416 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:57.172452 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.070289  1494 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.182067 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.177311  1483 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.187651 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.190495 30032 raft_consensus.cc:1275] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:57.141436  1454 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.185371 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:57.154114  1458 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:57.174196  1416 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.174427  1453 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:57.156425  1336 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:12:57.170547 30001 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:57.136842  1523 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.162622  1468 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:57.124183  1509 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.212052 30037 raft_consensus.cc:2410] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:57.214141  1509 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:57.215396  1526 consensus_queue.cc:1175] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98b3b699b87245df85d3aa84c13f5691" responder_term: 8 status { last_received { term: 8 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 8 index: 4 } }
I20260709 13:12:57.191773  1483 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.216902  1483 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:57.227494 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.199335  1416 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:57.202461  1453 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:57.232304 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 185544us
I20260709 13:12:57.235565 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.168212  1490 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.259684 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.261474 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.212659  1508 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:57.265211 30707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.034s	sys 0.052s
W20260709 13:12:57.265738 30707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.035s	sys 0.052s
I20260709 13:12:57.199244  1473 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:57.237706  1453 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:57.276175 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.264925  1458 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:57.283233  1458 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:57.284297  1458 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.285868  1458 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.293500  1530 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.293720  1336 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:57.295048  1535 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:12:57.295245  1336 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.296267  1538 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:57.296708  1538 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:57.297549  1538 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.299227  1538 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.300300  1531 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:57.301144  1531 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:57.302210  1531 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.302802  1454 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:12:57.306059  1532 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:12:57.307468 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1700) took 1226 ms. Trace:
I20260709 13:12:57.307894 30112 rpcz_store.cc:276] 0709 13:12:56.081455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.081579 (+   124us) service_pool.cc:224] Handling call
0709 13:12:56.081892 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.346998 (+265106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.347046 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.633662 (+286616us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c0005b048. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:56.634141 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.116748 (+482607us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:57.116780 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.116837 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.307005 (+190168us) raft_consensus.cc:1685] finished
0709 13:12:57.307030 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.307381 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33689,"raft.queue_time_us":5719,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":60350,"spinlock_wait_cycles":24599296,"thread_start_us":746874,"threads_started":2,"wal-append.queue_time_us":543823}
W20260709 13:12:57.312117 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 383482us
W20260709 13:12:57.313730 30077 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.877s (SENT)
I20260709 13:12:57.314414 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:57.326694 30741 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:57.294070  1530 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:57.331908 30077 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.996s (SENT)
W20260709 13:12:57.333693 30077 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 2.153s (SENT)
I20260709 13:12:57.310390  1336 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:57.344287  1528 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.325137  1514 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.348182  1514 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.351771  1528 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:57.335100  1530 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.368171 30741 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:57.369835  1385 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.371443  1534 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.371677 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:57.372488 30735 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:57.372442  1534 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.375386  1539 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:57.376487  1539 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:56.822266 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:57.392045  1503 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.799s	user 0.004s	sys 0.000s
I20260709 13:12:57.395802  1444 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.326620  1505 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:57.402575 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.406466 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 72777.6us
W20260709 13:12:57.407872 30077 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 2.227s (SENT)
I20260709 13:12:57.408640 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:57.427583 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 242308us
W20260709 13:12:57.431294 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 261587us
I20260709 13:12:57.439889 30151 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:57.440951 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:57.447623 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:57.415548  1336 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:57.455253 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 47420us
W20260709 13:12:57.457386 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.462184 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.463181 30037 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:57.468881 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.469738 30108 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:57.430507  1444 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.471612 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 859) took 1416 ms. Trace:
I20260709 13:12:57.445639  1493 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:57.476588 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 303030us
I20260709 13:12:57.472237 30113 rpcz_store.cc:276] 0709 13:12:56.055425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.062501 (+  7076us) service_pool.cc:224] Handling call
0709 13:12:56.062805 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.063133 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.063159 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.063541 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.170166 (+106625us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:56.170224 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.170340 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.391083 (+1220743us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:57.463912 (+ 72829us) raft_consensus.cc:1685] finished
0709 13:12:57.463946 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.471517 (+  7571us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":981,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":22901120,"thread_start_us":106201,"threads_started":1,"wal-append.queue_time_us":317916}
I20260709 13:12:57.459056  1526 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.469364  1454 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.450034  1522 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:57.500626 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.500782 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.504374 30030 raft_consensus.cc:2376] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10. Re-sending same reply.
I20260709 13:12:57.507478 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:57.510623 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 249258us
I20260709 13:12:57.512645 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.514354 30038 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:57.514773 30037 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:57.476670  1484 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:57.516937 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.519189 30037 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.505329 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.520218 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.522562 30036 raft_consensus.cc:2393] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:57.481046  1542 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:57.526048 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.526696 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.527384 30030 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:57.527935 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:57.528892 30033 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:57.529521 30032 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:57.487494  1548 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:57.471486  1483 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.530561 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.465231  1336 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.547225 30031 raft_consensus.cc:1275] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:57.548156 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.545663  1055 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:57.496215  1213 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:12:57.553078 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:57.550698 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.556175 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.552102 30030 raft_consensus.cc:2368] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 9. Current term is 10.
I20260709 13:12:57.557224 30038 raft_consensus.cc:1275] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:57.497215  1526 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.557957 30031 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:57.556588 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.502673  1528 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:57.558578 30036 raft_consensus.cc:2376] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6. Re-sending same reply.
I20260709 13:12:57.559930 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.543780  1548 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.563081 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.560379 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.550406  1531 raft_consensus.cc:993] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:57.561120 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.561244 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.563714 30111 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.556725 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.557682  1055 consensus_queue.cc:1048] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:12:57.566310 30033 raft_consensus.cc:2376] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9. Re-sending same reply.
I20260709 13:12:57.567698  1382 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:57.568231  1526 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.572150 30037 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:12:57.573863 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.574337 30031 raft_consensus.cc:1275] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:57.574859  1544 ts_tablet_manager.cc:933] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:12:57.576274  1450 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:57.576812  1450 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.577150  1450 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:57.578423  1490 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:57.581583  1537 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.270s	user 0.001s	sys 0.001s
I20260709 13:12:57.520824  1416 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.528800  1484 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.550179  1542 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:57.582993 30036 raft_consensus.cc:2376] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9. Re-sending same reply.
W20260709 13:12:57.563267  1502 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 1.198s	user 0.000s	sys 0.004s
I20260709 13:12:57.595207 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.596005 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.597646 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:12:57.599278 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 71427.9us
I20260709 13:12:57.600781 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.601854 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.602417  1523 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:57.602494 30031 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:57.603497  1416 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.604303 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:57.606024  1514 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:57.606602  1555 consensus_queue.cc:1048] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:12:57.607246 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.608047 30104 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:57.493176  1539 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:57.610520  1547 log.cc:927] Time spent T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:12:57.611663 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.612109 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.617079 30111 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:57.545344  1360 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.619681 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.593860  1457 raft_consensus.cc:1081] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:12:57.620813 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:12:57.639416 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 124006us
I20260709 13:12:57.640046 30038 raft_consensus.cc:2393] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:57.564893  1548 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:57.600214  1392 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:57.634061 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.638316 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.648658 30033 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:57.632769  1544 tablet_copy_client.cc:323] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:12:57.645795 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.641932 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.648903 30031 raft_consensus.cc:2376] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11. Re-sending same reply.
I20260709 13:12:57.651546 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.656602 30113 raft_consensus.cc:2393] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:57.652127 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:57.644032  1213 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:57.663398 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.665069 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.640534  1542 raft_consensus.cc:697] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:57.646868  1522 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.648238  1392 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:57.671690 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.676901 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:57.675386 30077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.995s (SENT) [suppressed 72 similar messages]
I20260709 13:12:57.679992 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:57.666116  1360 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:57.669232  1213 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.670830  1508 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:57.693830 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.674139  1555 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:57.675208  1534 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.700367 30107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:12:57.679517  1528 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.707293 30107 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.710628 30107 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:57.691617  1454 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:57.719977  1566 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:57.721499  1546 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:12:57.670476  1505 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:57.705996  1373 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.724493  1550 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.726956  1563 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.701713  1213 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:57.736511 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.736300 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.723160 30107 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.682003  1522 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.713117  1526 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.743162 30034 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:12:57.743324 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.743782 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.758731 30037 raft_consensus.cc:1275] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:57.758898 30030 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.745462 30004 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:57.748083 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.747483 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.734493  1528 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.760263 30038 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:57.739701  1566 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:57.769766 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.770519  1553 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.770651  1569 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:57.746870  1565 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.772728 30034 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
W20260709 13:12:57.798475 30077 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.500s (SENT)
W20260709 13:12:57.776875 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 96932.4us
I20260709 13:12:57.804872 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:57.806144 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:57.804934 30030 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
W20260709 13:12:57.807000 30077 leader_election.cc:336] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.627s (SENT)
I20260709 13:12:57.807098 30107 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:57.746446  1373 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.729841  1392 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.813503 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.776309  1508 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:57.772342  1566 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:57.761207  1542 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:57.822044  1554 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:12:57.824525  1538 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.001s
I20260709 13:12:57.749491  1550 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:57.829974  1392 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:57.812156  1453 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.003s
W20260709 13:12:57.830410  1573 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:57.830675 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.909682 30031 raft_consensus.cc:2376] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11. Re-sending same reply.
I20260709 13:12:57.831037  1360 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.830725  1530 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:57.817838  1559 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:12:57.760568  1526 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.824631  1450 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.835736 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:57.836036 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:57.970563 30112 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:57.970645 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:57.816735  1560 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:12:57.766839  1528 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.841205 30077 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:57.974478 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 133340us
I20260709 13:12:57.811389  1563 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:57.809231  1484 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:57.915046 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:57.976612 30029 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:57.923629  1522 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:57.924755  1475 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:57.908865  1453 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.907459  1508 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:57.948678  1550 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:57.991168 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 182242us
I20260709 13:12:57.810388  1565 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.984817  1566 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.030934  1526 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:58.035516  1213 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:57.949656 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.038486 30038 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.039484 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.040731 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:57.949952  1557 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:12:57.951237  1569 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:57.962312 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:57.838295 30107 pending_rounds.cc:85] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:12:58.043545 30107 pending_rounds.cc:107] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:58.043864 30107 raft_consensus.cc:2889] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.971423 30031 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:58.044749 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet b7a9a88da98d43b8a556cba3e2768e28 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:12:57.975409 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:58.045789 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 70496.5us
I20260709 13:12:57.987818  1505 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:58.049104 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.049656  1505 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.050213  1453 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:58.050828  1530 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.051123 30179 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:57.987226 30112 raft_consensus.cc:2468] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:12:58.044945 30031 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:58.052800 30705 leader_election.cc:336] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.558s (SENT)
I20260709 13:12:58.053197 30038 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.013947  1508 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:58.054347 30705 leader_election.cc:336] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.699s (SENT)
I20260709 13:12:58.054962 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:58.050112  1505 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.064836 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.065795 30732 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:12:58.068415 30029 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:12:58.061340 30031 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.106753 30031 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.107090 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.108922 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.110575  1360 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:58.071560 30077 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.758s (SENT)
I20260709 13:12:58.111934 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:58.074728 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.070833 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet b7a9a88da98d43b8a556cba3e2768e28 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-b7a9a88da98d43b8a556cba3e2768e28
I20260709 13:12:58.082840  1431 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:58.083596  1442 consensus_queue.cc:1048] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:58.118781  1484 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:58.122164 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.124044 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.125077 30038 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.083683 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.086861  1527 consensus_queue.cc:1048] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:58.088280 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.090606  1550 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:12:58.071995  1563 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:58.128522  1563 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:58.129380 30029 raft_consensus.cc:2393] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.069235  1492 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.062676  1514 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:58.132226 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 60708.2us
W20260709 13:12:58.070053 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 73522.3us
I20260709 13:12:58.114502  1534 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.099169  1336 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:58.133700 30077 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.808s (SENT)
W20260709 13:12:58.142818 30077 leader_election.cc:336] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.810s (SENT)
I20260709 13:12:58.143352 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:58.144833 30077 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.829s (SENT)
I20260709 13:12:58.136068 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.145813 30180 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:58.137163 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:58.138607 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55004us
I20260709 13:12:58.147209 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.147343 30187 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.147436 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:58.148984 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.149307 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.149533 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.149962 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:58.140780 30741 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.150859 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.151584 30184 raft_consensus.cc:2376] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10. Re-sending same reply.
I20260709 13:12:58.150861 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:58.148435 30077 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.829s (SENT)
I20260709 13:12:58.153111 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.152566 30187 raft_consensus.cc:2410] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:58.153216 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.153798 30029 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
W20260709 13:12:58.155115 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.157012 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.157192 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.157882 30179 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.157721 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.158664 30181 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:58.159003 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.159518 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.159806 30179 raft_consensus.cc:2393] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 7: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.160715 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.160758 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.161542  1215 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:58.041307  1548 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.189388 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.190429 30109 raft_consensus.cc:2393] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:58.190492 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.191843 30187 raft_consensus.cc:2410] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:58.193735 30105 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:58.194718 30179 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.195170 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:58.195971 30105 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:58.165778 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.196974 30185 raft_consensus.cc:2376] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8. Re-sending same reply.
I20260709 13:12:58.166061 30181 raft_consensus.cc:2393] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.157213 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.198729 30178 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.174394 30108 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:58.175848 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.202096 30110 raft_consensus.cc:2410] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:58.177513 30106 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:58.204424 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.205086 30029 raft_consensus.cc:2376] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7. Re-sending same reply.
I20260709 13:12:58.157845 30180 raft_consensus.cc:2376] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8. Re-sending same reply.
I20260709 13:12:58.193132 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.208495 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.165207  1527 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.209578 30179 raft_consensus.cc:2410] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:58.208534 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.211057 30186 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:12:58.216876 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.223927 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:12:58.225557 30104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.020s	sys 0.009s
I20260709 13:12:58.157632  1528 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:58.226361 30104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.020s	sys 0.009s
I20260709 13:12:58.200537 30108 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:12:58.228199 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.166206  1484 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:58.235266 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:58.241102 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.165032  1505 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.203830  1493 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:58.250329 30031 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:58.262162 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.263334 30186 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:58.232558  1403 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:58.212007  1468 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.268169  1493 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:58.267908  1468 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.270569 30184 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:58.270753  1468 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.265271 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.270993 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.236040  1556 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:58.271641 30178 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.272289 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.272665 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.273085 30029 raft_consensus.cc:2376] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9. Re-sending same reply.
I20260709 13:12:58.273515 30184 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:12:58.273986 30180 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:58.274122 30187 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:58.274359 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.274969 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.275007 30184 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:58.275520 30181 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:58.275841  1548 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:58.275520 30180 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.277004 30185 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:58.277880 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.274008 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.279183  1442 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:58.279656  1373 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.279914  1442 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:58.239600  1416 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:58.280932  1416 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:58.267020 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.281078  1442 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.282399 30031 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.281987  1416 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.131708  1492 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.283741 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.284930 30031 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.285667 30111 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:58.286319 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.287083 30029 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:58.152361  1534 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.292040 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.295339 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.296761 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.297996 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.298784 30037 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.298626  1389 consensus_queue.cc:1048] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:58.299757 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.300565 30037 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.301760 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.302450 30036 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:58.303372 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.304814 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.305667 30030 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.303404 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.308315 30036 raft_consensus.cc:2393] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.308234  1395 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:58.310299 30036 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:58.323138 30105 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:58.326635 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.327852 30029 raft_consensus.cc:2393] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:58.306937 30030 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:58.330593 30030 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:12:58.335695 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 344248us
I20260709 13:12:58.343600 30704 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:58.344831 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.359640 30037 raft_consensus.cc:2393] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:12:58.356348 30031 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:12:58.396860 30110 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:58.422716 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.423898 30187 raft_consensus.cc:2368] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:58.424911 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.426613 30187 raft_consensus.cc:2410] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:12:58.427448 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.016s
W20260709 13:12:58.427927 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.016s
W20260709 13:12:58.430639 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 281626us
I20260709 13:12:58.432415 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:58.433095 30033 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:58.233085  1526 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 13:12:58.437992 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.440878 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.444945 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.445250 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.445709 30181 raft_consensus.cc:2368] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:58.446637 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.450747 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.451258 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.447355 30185 raft_consensus.cc:2376] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8. Re-sending same reply.
I20260709 13:12:58.454725 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.455516 30185 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.415030  1505 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.245863  1525 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.185s
I20260709 13:12:58.439343  1528 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.428480  1352 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.439528  1555 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.465371 30033 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:58.435973  1055 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.475679 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:58.468802 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.476342 30029 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:58.442224  1548 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.476775 30181 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:12:58.460954 30184 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 5.
I20260709 13:12:58.471333 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.481917 30036 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:58.475713 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 247639us
I20260709 13:12:58.478068 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:58.486927 30031 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:58.488500 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.486352 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:58.485339 30186 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:12:58.491714 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:58.505520 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.506345 30181 raft_consensus.cc:2368] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:58.252389  1563 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:58.510169 30077 leader_election.cc:336] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.981s (SENT)
I20260709 13:12:58.518728 30077 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.509945 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:58.490917  1448 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.552167 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:58.554119 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.554512 30181 raft_consensus.cc:2410] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:12:58.510100  1552 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:12:58.564162 30184 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:12:58.492542  1505 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.481645  1352 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.485808  1492 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:58.475227  1528 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.568883 30038 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:58.485896  1055 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.483526  1555 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.484654  1548 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:58.575147 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 65090.2us
W20260709 13:12:58.634600 30077 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.996s (SENT)
I20260709 13:12:58.635093 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.540287  1403 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:58.546119  1518 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.583648  1508 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:58.585505  1578 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:58.587146  1399 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:58.588312  1580 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:58.567032  1493 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:58.595932 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.596472 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.544849 30185 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:58.657069 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.551412  1526 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:58.542351  1589 raft_consensus.cc:2804] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:58.618278 30031 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:12:58.621163 30178 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:58.627696 30036 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:58.628201 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:12:58.621790  1529 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 1.438s	user 0.001s	sys 0.014s
W20260709 13:12:58.628305  1552 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:58.644587 30180 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:58.569972  1591 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:12:58.567499  1448 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:58.651120 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 218780us
W20260709 13:12:58.652185 30077 leader_election.cc:336] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 1.996s (SENT)
I20260709 13:12:58.633520  1492 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:58.661273 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.667842 30182 raft_consensus.cc:2368] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9.
I20260709 13:12:58.643033  1403 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:58.655414  1399 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:58.669078 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
W20260709 13:12:58.677271 30077 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 2.005s (SENT)
I20260709 13:12:58.677906 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:12:58.679443 30077 leader_election.cc:336] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 2.070s (SENT)
I20260709 13:12:58.679962 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.657598  1595 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:58.651016  1518 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.667800  1526 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:12:58.689414 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.667389  1534 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.692373 30181 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:58.696519  1399 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.698539 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.705993 30178 raft_consensus.cc:2393] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:58.669236  1492 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:58.706833 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.707787 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.654747  1508 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.656946  1578 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.699610  1584 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.699925 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.711061 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.711725 30186 raft_consensus.cc:2393] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:12:58.701437  1483 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:58.702080  1581 log.cc:927] Time spent T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.002s
I20260709 13:12:58.702688 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:12:58.703794 30187 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:12:58.674162  1403 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:58.703135 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.709324 30178 raft_consensus.cc:2368] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:12:58.743716 30178 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:58.699093 30151 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:58.675807  1589 raft_consensus.cc:697] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:58.683748  1493 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:58.753001 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.716234 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.755059 30186 raft_consensus.cc:2410] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:58.756698 30186 raft_consensus.cc:1240] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:58.683334  1215 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:58.734634 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:58.739751 30187 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:58.759063 30183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 716) took 1773 ms. Trace:
I20260709 13:12:58.759297 30187 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:58.759456 30183 rpcz_store.cc:276] 0709 13:12:56.985780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.985972 (+   192us) service_pool.cc:224] Handling call
0709 13:12:56.986538 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.987031 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.987078 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.002904 (+ 15826us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.937716 (+934812us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b180045eec0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:12:58.234433 (+296717us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:58.234481 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.234558 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.735190 (+500632us) raft_consensus.cc:1685] finished
0709 13:12:58.735216 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.758958 (+ 23742us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23155,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":28620,"spinlock_wait_cycles":62365312,"thread_start_us":296430,"threads_started":1,"wal-append.queue_time_us":1421742}
I20260709 13:12:58.735038 30180 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:58.750052  1515 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:12:58.763465 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 58389.4us
I20260709 13:12:58.738314 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.707816  1484 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.746481 30736 raft_consensus.cc:2410] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:58.747044 30004 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:58.686519  1594 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:58.708737  1492 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.766181 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.771489 30180 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:12:58.782749 30185 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:12:58.783736 30077 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Timed out: RequestConsensusVote RPC to 127.28.62.131:36297 timed out after 2.170s (SENT)
I20260709 13:12:58.758773  1399 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.759303  1215 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.797211 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.788370  1525 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:58.742990  1584 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.814749 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.809290  1542 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:58.808104  1594 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:58.810928  1352 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:58.780540  1484 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.845184 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.815022  1599 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:58.844310  1263 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:58.844053  1450 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:58.848261  1416 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.831594  1555 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.826115  1528 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.842790  1442 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:58.863090 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:58.803859  1526 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:58.849359  1542 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:58.854177  1595 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:58.807440  1589 consensus_queue.cc:237] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.846515  1548 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:58.858868  1515 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:58.889323 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.890599 30180 raft_consensus.cc:2410] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:58.891862 30736 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:58.895205 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 156986us
I20260709 13:12:58.853683  1599 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:58.891463  1594 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:58.904335  1594 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:58.904855 29925 maintenance_manager.cc:419] P 5ee583f4769f453a90eb7fcae5ac930b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033352
I20260709 13:12:58.919044 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:58.921085 30180 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:12:58.893729  1518 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:58.924782 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 225746us
W20260709 13:12:58.925419 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.932675 30002 leader_election.cc:400] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
I20260709 13:12:58.933005 30002 leader_election.cc:403] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:58.894491  1493 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:58.894778  1483 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:58.907572  1578 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:58.932094 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:58.902995  1508 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.896776  1534 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:12:58.921962  1215 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.929718  1473 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:58.971751 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 94674.1us
I20260709 13:12:58.967573 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:58.929332  1395 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:58.965544 30151 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:58.964604  1597 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:12:58.977010 30151 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:58.972833 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:58.906764  1594 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:12:58.996748 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57712.2us
I20260709 13:12:59.003007 30105 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:59.003245 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.963955  1484 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.005205 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.972267  1578 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:59.039142 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36342 (request call id 880) took 1079 ms. Trace:
W20260709 13:12:59.024715  1614 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:12:59.025707  1603 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:12:58.977523  1473 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.038743 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.040782 30111 rpcz_store.cc:276] 0709 13:12:57.959813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.962056 (+  2243us) service_pool.cc:224] Handling call
0709 13:12:59.030080 (+1068024us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000a00d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:59.039069 (+  8989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557689600}
I20260709 13:12:59.023021 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:58.941684  1542 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:58.999953  1601 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:12:58.974107  1584 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:59.000881  1609 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:58.969861  1508 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8.
W20260709 13:12:59.046489 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46551.1us
W20260709 13:12:59.044932 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 112324us
I20260709 13:12:58.974609  1607 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:12:59.088711 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.001768  1548 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:59.061894 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:59.091812 30104 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:59.076045  1604 log.cc:927] Time spent T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:12:59.053349 30735 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:12:59.077358 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.077699 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:59.097084 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.098205 30111 raft_consensus.cc:2393] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:59.082206  1473 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:58.995637  1395 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.084365 30181 raft_consensus.cc:2410] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:59.053261  1484 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:59.086007 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:59.038724  1483 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:59.059686 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.093930 30002 leader_election.cc:400] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7.
I20260709 13:12:59.105690 30732 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.936774  1515 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.100378 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.111668 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:59.039573  1578 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.112854 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:59.114897 30153 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:12:59.118427 30002 leader_election.cc:400] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10.
I20260709 13:12:59.119505 30002 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.119647 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:59.119782 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:59.120432 30179 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:12:59.121362 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.132288 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.099391  1609 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:59.121659 30180 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:59.158953  1508 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:12:59.160110  1615 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:12:59.134039  1578 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.166932  1395 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.167080  1594 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:59.159044 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.149511 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:12:59.152331 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.195549 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 874) took 1360 ms. Trace:
W20260709 13:12:59.124404  1605 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:12:59.197265 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:59.102841  1548 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:59.137166 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.195631 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:12:59.174178 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.172782 30104 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:12:59.197811 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.211786 30107 rpcz_store.cc:276] 0709 13:12:57.834707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.837670 (+  2963us) service_pool.cc:224] Handling call
0709 13:12:57.838086 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:58.044569 (+206483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.044602 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:58.594725 (+550123us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2c0005b048. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:58.595482 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 13:12:58.854613 (+259131us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:58.854656 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.854747 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.169468 (+314721us) raft_consensus.cc:1685] finished
0709 13:12:59.169494 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.195366 (+ 25872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12127,"raft.queue_time_us":16215,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9123,"spinlock_wait_cycles":26703872,"thread_start_us":220814,"threads_started":1,"wal-append.queue_time_us":275961}
I20260709 13:12:59.185621 30732 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:59.211611 30738 raft_consensus.cc:2410] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:59.211968 30740 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:59.214694 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:12:59.135737  1484 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:12:59.219918 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82895.9us
W20260709 13:12:59.221019 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46952.3us
I20260709 13:12:59.109565  1483 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:59.135221  1556 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.242645 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:59.242754 30002 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.140311  1584 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.253242 30187 raft_consensus.cc:2376] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9. Re-sending same reply.
I20260709 13:12:59.243847 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:12:59.204130  1550 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 1.077s	user 0.004s	sys 0.014s
I20260709 13:12:59.249539 30150 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.258273 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.260268 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.267014 30110 raft_consensus.cc:1240] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:59.269686 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.271281 30186 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:59.259243 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:59.272831 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:59.182679  1618 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:59.275628 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:59.217718  1566 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:59.135818  1585 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.477s	user 0.003s	sys 0.001s
I20260709 13:12:59.282749 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.253541  1556 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.293973 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2206) took 1647 ms. Trace:
I20260709 13:12:59.282922 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.283922 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:59.296197 30187 raft_consensus.cc:2410] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:59.294560 30032 rpcz_store.cc:276] 0709 13:12:57.646115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.648026 (+  1911us) service_pool.cc:224] Handling call
0709 13:12:57.662568 (+ 14542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:57.669791 (+  7223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.669840 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:58.038806 (+368966us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2c000e1358. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:12:58.040097 (+  1291us) log.cc:844] Serialized 52 byte log entry
0709 13:12:58.473654 (+433557us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:58.546440 (+ 72786us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.552025 (+  5585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.552159 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.049466 (+497307us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:12:59.293694 (+244228us) raft_consensus.cc:1685] finished
0709 13:12:59.293724 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.293896 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10849,"prepare.queue_time_us":71935,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":11918,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":12648,"spinlock_wait_cycles":21199104,"thread_start_us":432957,"threads_started":1,"wal-append.queue_time_us":587583}
I20260709 13:12:59.237696  1395 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:59.265709 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:12:59.299765 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.300019 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:59.256152  1505 consensus_meta.cc:287] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260709 13:12:59.263561  1352 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.286231  1555 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.302637 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.303958 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:12:59.278132  1399 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:59.296877  1566 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.279919  1525 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.218914  1508 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.287072  1534 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:59.303256  1389 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:59.311431 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.303270  1518 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.306613  1505 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.313930 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:12:59.299361  1556 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.302368  1442 raft_consensus.cc:2764] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:59.284262  1589 consensus_queue.cc:1048] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:12:59.356739 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 92328.4us
I20260709 13:12:59.328663  1493 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.306288  1395 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:12:59.365561 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 63045.8us
I20260709 13:12:59.309253  1526 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.329528  1389 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.287019  1551 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:12:59.367091 30150 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:12:59.328356  1584 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:59.376201 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 74375.3us
I20260709 13:12:59.378916 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:12:59.381671  1518 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.381743  1399 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:59.359196  1596 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:59.359232  1566 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.365494  1494 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:59.303543  1607 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:12:59.395320 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 135152us
W20260709 13:12:59.395373 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 83934.9us
I20260709 13:12:59.397063 30737 raft_consensus.cc:1240] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:59.397222  1616 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:59.311790  1483 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.402277 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.373339  1389 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.403429 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:12:59.394686  1527 consensus_meta.cc:287] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 1.168s	user 0.022s	sys 0.003s
I20260709 13:12:59.418411 30035 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.404107 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.419390 30036 raft_consensus.cc:2376] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11. Re-sending same reply.
I20260709 13:12:59.404377 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.409999 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.421458 30034 raft_consensus.cc:2393] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:12:59.375306  1594 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:59.397630  1564 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 1.738s	user 0.006s	sys 0.016s
I20260709 13:12:59.322163  1548 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.416332 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.391280  1566 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.391963  1399 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:59.438603 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.451386 30032 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.439407 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.440539 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.454531 30037 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:12:59.328558  1609 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.430625  1594 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.372326  1484 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.439738  1527 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.450913  1566 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.562050  1483 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:59.576108  1594 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:59.582499  1621 log.cc:927] Time spent T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:12:59.447821 30035 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:12:59.572826  1403 consensus_meta.cc:287] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 13:12:59.592870  1403 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.564225  1473 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:59.597635  1403 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:59.598906  1403 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:59.596756  1473 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.601477  1403 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:59.602530  1403 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.604691 30735 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:59.582499  1632 log.cc:927] Time spent T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:12:59.577765  1528 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:59.610060  1534 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:12:59.619190  1534 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:12:59.621848  1623 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:12:59.622831  1622 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:12:59.418040  1616 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.632403 30735 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:12:59.654418  1627 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:12:59.654572  1448 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:59.578717  1395 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.650084  1399 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.670930  1508 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:59.617430  1528 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:12:59.695492  1595 consensus_meta.cc:287] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.000s
W20260709 13:12:59.753373 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.671121  1619 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:12:59.798172  1595 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:59.798888  1492 consensus_meta.cc:287] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.991s	user 0.015s	sys 0.001s
W20260709 13:12:59.692106  1625 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:12:59.799700  1492 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.801640 30736 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:59.699294  1616 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.700258  1550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44700 (request call id 13) took 4286 ms. Trace:
I20260709 13:12:59.786095  1473 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:12:59.751566 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 311938us
I20260709 13:12:59.795040  1606 raft_consensus.cc:2764] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:12:59.793191 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 163130us
I20260709 13:12:59.799530  1595 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:59.706463  1618 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:59.757683 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:12:59.807724 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2469) took 1296 ms. Trace:
I20260709 13:12:59.815618 30184 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:59.705766  1594 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.822726  1645 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:12:59.823961  1645 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.812175  1213 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:59.824952  1594 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.813110  1595 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.826211  1055 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:12:59.827922 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.828658  1595 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.699782  1578 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.819042  1534 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.817976  1647 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:12:59.815076 30178 rpcz_store.cc:276] 0709 13:12:58.510799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.745088 (+234289us) service_pool.cc:224] Handling call
0709 13:12:58.748580 (+  3492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.900449 (+151869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.900489 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:58.901075 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.087715 (+186640us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:59.087752 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.087834 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.807300 (+719466us) raft_consensus.cc:1685] finished
0709 13:12:59.807334 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.807560 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22278,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":13581,"thread_start_us":276728,"threads_started":2,"wal-append.queue_time_us":351650}
I20260709 13:12:59.753844 30032 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:12:59.808324  1550 rpcz_store.cc:276] 0709 13:12:55.409201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.409430 (+   229us) service_pool.cc:224] Handling call
0709 13:12:55.534669 (+125239us) log.cc:844] Serialized 506 byte log entry
0709 13:12:55.781740 (+247071us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b18000aeb20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe602cb0b 00007fcbe60b1b63 00007fcbe60d9752 00007fcbeb099d29
0709 13:12:56.040242 (+258502us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b18000aeb20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:56.631191 (+590949us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18000aeb20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:12:59.694986 (+3063795us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63838,"raft.queue_time_us":93039,"raft.run_cpu_time_us":2846,"raft.run_wall_time_us":74179,"spinlock_wait_cycles":60843008,"thread_start_us":180063,"threads_started":1,"wal-append.queue_time_us":211049,"wal-append.run_cpu_time_us":1902,"wal-append.run_wall_time_us":1001916}
I20260709 13:12:59.838068 30187 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:59.823031  1528 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:59.835216  1514 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:59.840688  1534 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.841459 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.842670 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.842224  1647 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.836948 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.843830  1473 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.836331 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:12:59.829378 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43012 (request call id 675) took 1128 ms. Trace:
I20260709 13:12:59.844326 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.846516 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.848379 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.857081 30036 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:59.851289  1514 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:12:59.859299  1473 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.860397  1645 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.862146  1473 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.863080 30735 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:59.866101 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.866988  1534 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.867178 30030 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:59.868052 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.870698 30033 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.873843 30029 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:12:59.875638  1508 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.876989  1578 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:12:59.860085  1514 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.877821  1525 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:59.877849 30038 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:12:59.879662  1647 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:12:59.880353  1647 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:59.881007 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.855223 30741 rpcz_store.cc:276] 0709 13:12:58.701242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.712343 (+ 11101us) service_pool.cc:224] Handling call
0709 13:12:59.828842 (+1116499us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400617bd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:59.829141 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020502784}
I20260709 13:12:59.876736  1508 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:12:59.911011 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.925715  1055 consensus_queue.cc:1059] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:59.927088  1055 consensus_queue.cc:1243] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:59.927819  1055 raft_consensus.cc:3055] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:59.928184  1055 raft_consensus.cc:740] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:12:59.932643 30151 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:59.925834 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 57997.6us
I20260709 13:12:59.934369  1578 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.935897 30181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2459) took 1515 ms. Trace:
I20260709 13:12:59.939685 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:12:59.941596 30038 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:12:59.878646  1525 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.938489 30181 rpcz_store.cc:276] 0709 13:12:58.419945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.710608 (+290663us) service_pool.cc:224] Handling call
0709 13:12:59.935420 (+1224812us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54003b1d54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:12:59.935669 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719783680}
I20260709 13:12:59.958235 30036 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:12:59.958251 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:12:59.958113  1620 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:12:59.966058 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:12:59.967028 30741 raft_consensus.cc:2376] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10. Re-sending same reply.
I20260709 13:12:59.966060 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.941300  1055 consensus_queue.cc:260] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.971623  1213 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.975684  1213 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:12:59.976310  1213 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.978724  1620 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:12:59.984259 30048 tablet_copy_source_session.cc:215] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:12:59.985344 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet 729e969847cf4fbcb29c2681ec03a97a: Illegal state: Replica 34f51764a89048468a6faa21020812b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:12:59.987874  1525 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:12:59.989497 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:12:59.990931 30037 raft_consensus.cc:2393] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:12:59.992985  1641 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:12:59.995003  1646 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:12:59.957506  1618 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.010262 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:12:59.996822  1648 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:13:00.014778 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.019840 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.012293  1055 raft_consensus.cc:3060] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:00.017794 30078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.020s
I20260709 13:12:59.963860  1578 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:00.029039 30078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.003s	sys 0.020s
I20260709 13:13:00.034642 30113 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:00.037554 30036 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.038914 30105 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:00.040203  1618 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:00.044248 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 82302.6us
I20260709 13:13:00.045090 30109 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:00.057783  1528 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.058425  1528 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.058801  1528 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:00.060078  1389 consensus_meta.cc:287] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.014s
W20260709 13:13:00.061906  1611 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.930s	user 0.004s	sys 0.004s
I20260709 13:13:00.062390  1431 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:00.065189  1263 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:00.065696  1263 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:00.066845 30004 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:00.061925  1650 consensus_queue.cc:1059] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:13:00.070793  1650 consensus_queue.cc:1243] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer 98b3b699b87245df85d3aa84c13f5691 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:00.071677  1650 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:00.071848 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.072218  1650 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:00.041900 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.074003  1629 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:00.074671 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 61746.2us
W20260709 13:13:00.075371  1657 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:00.076650  1399 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:00.074007 30038 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:13:00.080607  1448 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.082059 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 138210us
I20260709 13:13:00.081806  1448 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:00.077466  1416 consensus_meta.cc:287] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 1.084s	user 0.003s	sys 0.017s
I20260709 13:13:00.077987  1620 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.067693  1263 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:00.080994 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.060662  1389 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.089617 30033 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
W20260709 13:13:00.061156  1493 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.008s
I20260709 13:13:00.092832 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.074054  1215 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:00.099390 30036 raft_consensus.cc:2468] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:13:00.085826  1494 consensus_meta.cc:287] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.018s
I20260709 13:13:00.077145  1399 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.108747 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.111725 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 962) took 1103 ms. Trace:
I20260709 13:13:00.088666  1448 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.112382 30736 rpcz_store.cc:276] 0709 13:12:58.999096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.000053 (+   957us) service_pool.cc:224] Handling call
0709 13:12:59.000371 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.802198 (+801827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.081273 (+279075us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54005d0f54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:00.101897 (+ 20624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841610496}
I20260709 13:13:00.085870  1416 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.102165  1215 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:00.110085  1399 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:00.134337 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.149914 30741 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:00.153645 30048 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:44710 (request call id 691) took 2107 ms. Trace:
I20260709 13:13:00.154371 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.154898 30732 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:00.155157  1389 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.147819 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:00.129305  1493 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.164752  1403 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.165143  1566 consensus_meta.cc:287] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.543s	user 0.015s	sys 0.003s
I20260709 13:13:00.142758  1215 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.145913  1492 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.160384  1263 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:00.169973  1548 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:00.164800  1600 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.166949  1484 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.185361 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.186600 30735 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 9: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:00.196195 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 561) took 1076 ms. Trace:
I20260709 13:13:00.173862  1578 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.207579  1213 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.180011  1548 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.218890 30105 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:00.219194  1548 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.221953 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:00.222949  1618 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.194454  1617 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:13:00.224166 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:00.225554  1483 consensus_meta.cc:287] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.010s
I20260709 13:13:00.199424 30734 rpcz_store.cc:276] 0709 13:12:59.120059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.120323 (+   264us) service_pool.cc:224] Handling call
0709 13:12:59.153507 (+ 33184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:59.183072 (+ 29565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.183120 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.216838 (+ 33718us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.422925 (+206087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:59.422969 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.423042 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.991802 (+568760us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:13:00.187555 (+195753us) raft_consensus.cc:1685] finished
0709 13:13:00.187580 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.195983 (+  8403us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20547,"raft.queue_time_us":18302,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22470,"spinlock_wait_cycles":9995008,"thread_start_us":138529,"threads_started":1,"wal-append.queue_time_us":393364}
W20260709 13:13:00.226610 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 96318.3us
I20260709 13:13:00.227120  1565 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.228732 30151 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.165499  1403 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.154341 30048 rpcz_store.cc:276] 0709 13:12:58.043909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.044435 (+   526us) service_pool.cc:224] Handling call
0709 13:12:59.983280 (+1938845us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540020add4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60dd3f7 00007fcbeb073036 00007fcbeb07ca3e 00007fcbe294027b 00007fcbeb07c9ba 00007fcbeb077acc 00007fcbeb072c7b 00007fcbeb0678d1 00007fcbea11b4b4 00007fcbea11b442
0709 13:13:00.147682 (+164402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3989035392}
W20260709 13:13:00.231352 30185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33134 (request call id 2468) took 1743 ms (client timeout 1959 ms). Trace:
I20260709 13:13:00.231635 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:13:00.231989 30185 rpcz_store.cc:269] 0709 13:12:58.488010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.656832 (+168822us) service_pool.cc:224] Handling call
0709 13:13:00.231002 (+1574170us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b54000654d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:00.231179 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194743680}
W20260709 13:13:00.235421 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.137185  1650 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.187809 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:00.238994 30151 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.165668  1566 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.200217  1508 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.231388  1403 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.279042  1213 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.284031 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.285251  1596 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.286150  1596 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.289940  1609 raft_consensus.cc:2804] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.290872  1609 raft_consensus.cc:697] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:00.292305  1609 consensus_queue.cc:237] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.276679  1630 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:13:00.277747  1542 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.214390  1600 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.253211  1448 raft_consensus.cc:2804] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:00.297951  1566 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:00.350323 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 109292us
W20260709 13:13:00.276074  1660 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:13:00.267285 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:00.352231 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 103913us
I20260709 13:13:00.302579  1629 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.303880 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 86720.3us
W20260709 13:13:00.311172 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.390749 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.312095  1618 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.315865  1664 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:13:00.321821 30180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2124) took 1072 ms. Trace:
I20260709 13:13:00.323942 30734 raft_consensus.cc:1240] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:00.342782 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.328696 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:00.325918 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.325264 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:13:00.367363 30707 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.250360  1578 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:00.354327  1542 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:13:00.325310  1652 log.cc:927] Time spent T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.632s	user 0.004s	sys 0.000s
I20260709 13:13:00.394286  1629 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.345638  1514 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.348078  1399 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.398352 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:00.399152  1620 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:00.330312  1665 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:13:00.321866  1658 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
W20260709 13:13:00.317377  1556 consensus_meta.cc:287] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.952s	user 0.018s	sys 0.000s
I20260709 13:13:00.317487  1650 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:00.347609  1599 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.418725 30739 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:13:00.408352  1542 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.402652 30180 rpcz_store.cc:276] 0709 13:12:59.249091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.273647 (+ 24556us) service_pool.cc:224] Handling call
0709 13:12:59.274078 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:59.281481 (+  7403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:59.281511 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:59.291058 (+  9547us) log.cc:844] Serialized 52 byte log entry
0709 13:12:59.392878 (+101820us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:59.605877 (+212999us) log.cc:844] Serialized 14 byte log entry
0709 13:13:00.288254 (+682377us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18002bb880. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe5c89d70 00007fcbe5c7d293 00007fcbe5c72cea 00007fcbe5c7323a 00007fcbe60dda2a 00007fcbe60ed0bf 00007fcbe60ed038
0709 13:13:00.321033 (+ 32779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.321189 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.321260 (+    71us) raft_consensus.cc:1685] finished
0709 13:13:00.321377 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.321602 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":602019,"prepare.queue_time_us":181615,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":4611,"raft.queue_time_us":8015,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6835,"spinlock_wait_cycles":8957312,"thread_start_us":241638,"threads_started":2,"wal-append.queue_time_us":280750}
I20260709 13:13:00.434206 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:00.435909 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:00.434938 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 260222us
I20260709 13:13:00.421672  1448 raft_consensus.cc:697] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:00.422616  1618 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.426230  1566 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.445864 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.442655 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:00.449980 30187 raft_consensus.cc:2368] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
I20260709 13:13:00.451928 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.453122 30036 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:00.454919 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.454962 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.456414 30030 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.463843 30113 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:00.472751 30038 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:00.437057  1578 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.427186  1556 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.492192  1484 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.493038 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2123) took 1244 ms. Trace:
W20260709 13:13:00.524561  1670 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:00.523454 30186 rpcz_store.cc:276] 0709 13:12:59.248768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.285745 (+ 36977us) service_pool.cc:224] Handling call
0709 13:12:59.288946 (+  3201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:59.289457 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:59.289497 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.305900 (+ 16403us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.763795 (+457895us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:59.763939 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.764110 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:00.324368 (+560258us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:13:00.472483 (+148115us) raft_consensus.cc:1685] finished
0709 13:13:00.472508 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.492806 (+ 20298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7244,"raft.queue_time_us":1583,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2859,"spinlock_wait_cycles":19720064,"thread_start_us":419879,"threads_started":1,"wal-append.queue_time_us":349672}
I20260709 13:13:00.497844 30178 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:13:00.525593 30178 pending_rounds.cc:85] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 5
I20260709 13:13:00.525921 30178 pending_rounds.cc:107] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:13:00.526252 30178 raft_consensus.cc:2889] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:00.527758 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.530119  1620 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:00.530311  1484 consensus_queue.cc:1059] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:00.531497  1403 raft_consensus.cc:3055] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:00.531785  1399 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.531903  1403 raft_consensus.cc:740] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:00.532568 30736 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:13:00.498832  1448 consensus_queue.cc:237] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.499739 30110 raft_consensus.cc:1275] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:13:00.524868  1556 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.501631  1618 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.469420  1483 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.501967 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.502465  1566 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.502866 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1728) took 1426 ms. Trace:
I20260709 13:13:00.540411 30037 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:13:00.503521 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 105293us
W20260709 13:13:00.507462  1667 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:00.507881 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:00.509629  1563 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:00.510459 30033 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:00.460630  1592 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.515822 30705 leader_election.cc:400] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
I20260709 13:13:00.553189 30705 leader_election.cc:403] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.448848  1606 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:00.461071  1493 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.540252 30034 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.540247 30109 rpcz_store.cc:276] 0709 13:12:59.076524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.094273 (+ 17749us) service_pool.cc:224] Handling call
0709 13:13:00.502532 (+1408259us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400353ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:00.502733 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568012672}
I20260709 13:13:00.544737 30030 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:00.517270  1596 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.580749 30738 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.539194  1548 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.597536  1548 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.601951 30038 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:00.602906  1578 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.603778 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.606076  1629 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:00.607311  1671 log.cc:927] Time spent T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:13:00.609359  1600 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:00.636544  1382 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:00.642403  1215 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.643517  1542 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.644618  1215 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.646062 30181 raft_consensus.cc:1240] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:00.646018 30741 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:00.650490  1484 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:00.651055  1484 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:00.652236  1484 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:00.641309 30002 connection.cc:256] RPC call timeout handler was delayed by -1.1010157850000724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:13:00.654985 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0857157850000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:13:00.655297 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0794157850000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:13:00.655582 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0452157850002095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:13:00.656013 30002 connection.cc:256] RPC call timeout handler was delayed by -1.0227157850001731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:13:00.657060  1484 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.517740  1528 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.659793  1528 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:00.594499 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 121898us
W20260709 13:13:00.663424 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.666967 30153 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.616204 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.675668 30036 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.615487 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:00.680254 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64855.9us
I20260709 13:13:00.578109  1606 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:00.702407 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:00.616545  1508 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.705282 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:00.578299  1563 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.704937 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:00.687173  1617 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:00.689152  1548 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:00.615566  1655 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:00.717160 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.714159 30036 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9.
I20260709 13:13:00.618314  1620 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:13:00.719703 29933 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 5 to 7, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.727864  1505 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:00.728745  1505 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.730991 30079 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:00.731827  1505 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.732764 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:00.687002  1610 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:13:00.739889  1620 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:00.740547  1620 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:00.719729 30108 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:00.745965 30035 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:00.681814  1483 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:13:00.737221 29936 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 261) took 21010 ms (client timeout 15000 ms). Trace:
I20260709 13:13:00.724161 30181 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:00.749322 30151 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.750506 30738 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:00.706058  1578 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.757015 30033 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.756907 30741 raft_consensus.cc:2376] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9. Re-sending same reply.
I20260709 13:13:00.724784  1542 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:00.762419  1566 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:00.765702 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.766235  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a9a88da98d43b8a556cba3e2768e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:00.766356 30035 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.717319  1055 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.718106  1548 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:00.778075 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 53104.2us
I20260709 13:13:00.779299  1382 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 6. Current term is 7.
I20260709 13:13:00.779904  1548 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.782855 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.780025 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:00.785312 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.786286 30038 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:00.795928 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.796804 30036 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.801059  1528 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:00.752163  1617 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:00.755803  1609 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.724757  1508 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.814886 30735 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:13:00.815325 30735 pending_rounds.cc:85] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 7
I20260709 13:13:00.815539 30735 pending_rounds.cc:107] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:13:00.815770 30735 raft_consensus.cc:2889] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.815866  1483 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:00.817008 29984 auto_rebalancer.cc:629] Failed to schedule move for tablet 3ff2caa8c9ec4f85b73c3be44168d116: Illegal state: Replica ef9ab4d665234a799376bf42ef5d058c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:00.802980  1542 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:00.771404  1215 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:13:00.818068 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:00.803337  1493 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.792388  1517 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:13:00.805033  1566 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:00.776795  1578 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.778388  1606 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.782110  1055 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.845762 30037 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
W20260709 13:13:00.849370 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 192862us
I20260709 13:13:00.776185  1620 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.793663  1655 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:00.870749  1684 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:00.871598  1055 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:00.872458 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61402.2us
I20260709 13:13:00.873627  1431 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.874284 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.905632 30029 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.881464 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:00.834496  1566 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.902757 30035 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:00.851223  1542 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:00.867622  1606 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.919224 30151 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:00.827395  1609 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.869505  1675 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:00.950659 30033 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:00.952006 30036 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:13:00.954820 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.955626 30035 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:00.907495  1514 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.907718  1566 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.960846  1650 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:00.969144 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 61587.6us
W20260709 13:13:00.752712 29936 rpcz_store.cc:269] 0709 13:12:39.727045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.727491 (+   446us) service_pool.cc:224] Handling call
0709 13:13:00.736946 (+21009455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:54.906013 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:54.906830 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:54.906888 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:12:54.906916 (+    28us) tablet.cc:662] Decoding operations
0709 13:12:54.908125 (+  1209us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:54.908212 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:54.908255 (+    43us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:12:54.909096 (+   841us) tablet.cc:701] Row locks acquired
0709 13:12:54.909117 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:54.909329 (+   212us) write_op.cc:270] Start()
0709 13:12:54.919614 (+ 10285us) write_op.cc:276] Timestamp: P: 1783602774909260 usec, L: 0
0709 13:12:54.919654 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:12:54.951785 (+ 32131us) log.cc:844] Serialized 2865 byte log entry
0709 13:12:55.646018 (+694233us) op_driver.cc:464] REPLICATION: finished
0709 13:12:55.815691 (+169673us) write_op.cc:301] APPLY: starting
0709 13:12:55.834476 (+ 18785us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:55.896135 (+ 61659us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:55.907423 (+ 11288us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:56.032725 (+125302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:56.066446 (+ 33721us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:12:56.070794 (+  4348us) write_op.cc:312] APPLY: finished
0709 13:12:56.146463 (+ 75669us) log.cc:844] Serialized 59 byte log entry
0709 13:12:56.260731 (+114268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:56.347041 (+ 86310us) write_op.cc:454] Released schema lock
0709 13:12:56.349024 (+  1983us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:56.378362 (+ 29338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:56.382506 (+  4144us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1260919,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":156336,"apply.run_cpu_time_us":6835,"apply.run_wall_time_us":551106,"num_ops":7,"prepare.queue_time_us":365190,"prepare.run_cpu_time_us":27723,"prepare.run_wall_time_us":411868,"raft.queue_time_us":166764,"raft.run_cpu_time_us":35428,"raft.run_wall_time_us":103852,"replication_time_us":720994,"thread_start_us":791181,"threads_started":4,"wal-append.queue_time_us":452521,"wal-append.run_cpu_time_us":22558,"wal-append.run_wall_time_us":1958918}]]}
I20260709 13:13:00.970896  1215 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:00.971674  1687 log.cc:927] Time spent T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:00.971607  1215 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:00.968989  1650 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:00.951146  1399 raft_consensus.cc:2804] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:00.976934 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.977959 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:00.948414  1382 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:00.977367  1563 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:01.004722 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 292906us
I20260709 13:13:01.005679 30034 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:01.008322 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:00.985752  1399 raft_consensus.cc:697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:00.959189  1617 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:01.013212 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.998910  1618 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.014930 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:01.015951 30079 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:00.977627  1514 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:00.976472  1675 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.021664 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:01.027915 30034 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:01.028837  1681 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
W20260709 13:13:01.026569 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 274748us
I20260709 13:13:01.030874 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:01.016324  1563 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:01.032820 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:00.980691  1403 consensus_queue.cc:260] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.037505 30740 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:01.037907  1403 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.004177  1382 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.035528 30738 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.032761  1563 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.036618  1694 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:01.036309  1618 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.034721  1565 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.054355  1683 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.002s
W20260709 13:13:01.052477  1688 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 13:13:01.052820  1563 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:01.044273  1685 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:13:01.068652 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.010952  1542 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.061575 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.076189 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:01.076855 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.054500  1514 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.092730 30738 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:01.054440  1655 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:01.095923 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 188571us
I20260709 13:13:01.096253  1691 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:13:01.088992  1600 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:01.097954 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.098448  1600 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:01.098910  1600 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.099506 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.100286 30178 raft_consensus.cc:2393] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:01.067972  1578 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.032121  1650 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.108875 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.110160 30178 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:01.110333 30179 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:01.110536 30183 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:01.079499  1694 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:01.119279 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.094476  1681 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:01.128664 30038 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:01.070087  1610 consensus_queue.cc:1048] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:13:01.132784 30181 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 14: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:01.133605 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.073365  1492 consensus_queue.cc:1059] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:13:01.052543  1399 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.136258 30185 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:13:01.145555 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.146378 30736 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:01.104995  1528 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:01.119382  1508 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.119279  1609 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.162233 30180 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:01.163381  1618 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.165536 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.166354  1694 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.134202  1578 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.083621  1565 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.094007  1448 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:13:01.168284  1382 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.141027  1681 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:13:01.171660 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 43789.6us
I20260709 13:13:01.170975 30180 pending_rounds.cc:85] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 4
I20260709 13:13:01.200693 30180 pending_rounds.cc:107] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:01.201074 30180 raft_consensus.cc:2889] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:01.201516 30002 leader_election.cc:400] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9.
I20260709 13:13:01.181334 30182 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:01.202486 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.202831  1618 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.203298  1630 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.203557  1618 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.193297  1514 raft_consensus.cc:3055] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:01.213721 30077 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:01.214758  1655 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:01.215317  1655 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:01.216503  1655 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.189011  1548 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.222848 30186 raft_consensus.cc:2393] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 6: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:13:01.241330  1680 log.cc:927] Time spent T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.347s	user 0.002s	sys 0.000s
W20260709 13:13:01.242591 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.186661 30029 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:01.138957  1629 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:01.155259  1650 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:01.245604 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.246498 30153 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.247525 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.187004  1508 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.272864 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 54553us
I20260709 13:13:01.272171 30705 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.213822  1514 raft_consensus.cc:740] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:01.278407  1691 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:01.285955  1691 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.286477  1514 consensus_queue.cc:260] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.287806  1514 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.288121  1691 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.290532  1618 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.291191  1565 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.293892  1444 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:01.278553  1629 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.302039  1675 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.249001  1578 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.249194  1528 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.311903  1629 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:01.312754  1215 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.313335  1578 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.269891  1508 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.316392  1508 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:01.318926  1600 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.319435  1681 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.320499  1563 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.266785  1055 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:01.321837  1693 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.322399  1693 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.324483  1693 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:01.321002  1563 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.348382 30036 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:01.348693 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.346482 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:01.350273 30738 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:13:01.351470 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 149052us
I20260709 13:13:01.354532 30079 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:01.360404 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:01.371996 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:01.374644 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.375280 30036 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:01.379318 30732 raft_consensus.cc:2410] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:13:01.321837  1055 raft_consensus.cc:697] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:01.383674 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:01.400266  1444 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:01.401654  1682 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.401923 30738 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:01.402274  1682 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.404722  1682 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.406414 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.407609  1448 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.407675 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.408510  1448 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:01.409066  1448 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.410601  1578 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:01.411388  1578 raft_consensus.cc:697] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:13:01.411907 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 63372.2us
I20260709 13:13:01.413044  1578 consensus_queue.cc:237] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.410043  1556 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:01.413935  1055 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.410765  1448 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.372864  1691 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:01.417172 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.423782 30036 raft_consensus.cc:2410] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:01.429764 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:01.431617 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:01.440047 30108 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.422061  1691 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.386323  1565 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:01.454414  1484 consensus_meta.cc:287] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.000s
I20260709 13:13:01.443427  1528 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.458230 30002 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.442654  1691 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.446943 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.449898 30030 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:13:01.451591  1606 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.007s
I20260709 13:13:01.452652  1600 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.452908  1563 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:01.460314 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.471386 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.475315 30038 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
W20260709 13:13:01.447037  1695 log.cc:927] Time spent T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:13:01.479614 30105 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:01.479462 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.482676 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.480561 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.485949 30106 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:01.491317 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.458455  1566 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.459146  1508 raft_consensus.cc:2764] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:13:01.498337 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.498567 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.498852 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:01.501996 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.502842 30109 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:13:01.503243 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.499306 30106 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:01.442863  1403 consensus_queue.cc:1059] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:13:01.514178 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.515012 30112 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:01.476186  1542 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.491101  1699 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.471814  1565 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.549798 30106 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.515851  1548 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:01.552583 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:01.555405 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97320us
I20260709 13:13:01.554165 30113 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:13:01.553795 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 143778us
I20260709 13:13:01.559181  1528 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:01.564224 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.564409 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.575100 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.582580 30151 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.549518  1542 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.593169 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.595468 30104 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:01.595669 30031 raft_consensus.cc:2410] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:13:01.597026 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.598798 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.600067 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:01.585325 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.577702  1556 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:01.600958 30180 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.580427  1548 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:01.580528  1629 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:01.609440 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:01.614369 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.577517  1609 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:01.618592 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.620633 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.621943 30113 raft_consensus.cc:2410] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:13:01.618094 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.618618 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.625294 30107 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:13:01.630892 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 66760.9us
W20260709 13:13:01.633101 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.617700  1548 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:01.618465  1675 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:01.635452 30002 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.613027  1556 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.641583  1675 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.643340  1717 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:13:01.644337 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.676740 30111 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:01.663662 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.671077 30732 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:01.672088 30002 leader_election.cc:400] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:13:01.684716 30106 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:01.632580  1715 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:01.724473 30107 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:01.714107 30108 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:01.724262 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:01.726784 30036 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.670346 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:01.658358  1707 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:13:01.730386 30110 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: [6.7-10.9]
W20260709 13:13:01.650199  1701 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:13:01.738715 30732 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:13:01.663851  1566 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.739180 30732 pending_rounds.cc:85] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Aborting all ops after (but not including) 7
I20260709 13:13:01.739476 30732 pending_rounds.cc:107] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:13:01.739720 30732 raft_consensus.cc:2889] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:01.739614  1694 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:01.651665  1215 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:01.741184  1215 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:01.741827 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.743482  1215 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.743737  1617 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:01.745074 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 73239.5us
I20260709 13:13:01.746301 30002 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:01.671270  1618 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:01.751071  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:43012 (request call id 672) took 4679 ms. Trace:
I20260709 13:13:01.662935  1548 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.664748  1675 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:01.753304 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.755000  1542 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.757087  1565 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.758608  1483 raft_consensus.cc:3055] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:01.759146  1483 raft_consensus.cc:740] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:01.658016  1704 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:13:01.649449  1703 log.cc:927] Time spent T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:13:01.781514 30738 raft_consensus.cc:1240] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:01.648991  1702 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:13:01.751545  1544 rpcz_store.cc:276] 0709 13:12:57.071583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.071749 (+   166us) service_pool.cc:224] Handling call
0709 13:12:57.575226 (+503477us) ts_tablet_manager.cc:934] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
0709 13:13:00.757209 (+3181983us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:01.352572 (+595363us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:01.363599 (+ 11027us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:01.750112 (+386513us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:01.750473 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:01.750819 (+   346us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:01.750946 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":12414,"tablet-copy.queue_time_us":264145,"thread_start_us":201029,"threads_started":2}
I20260709 13:13:01.788165  1618 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.760175  1483 consensus_queue.cc:260] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.797729 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.723716  1715 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.792718  1675 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:01.819336 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.820154 30029 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:01.809669 30180 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:01.831343 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:01.855681  1403 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.856350  1403 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:01.858088  1701 log.cc:927] Time spent T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:13:01.859797 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51611.6us
I20260709 13:13:01.861297 30036 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:13:01.830106  1710 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:13:01.888996 30705 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:01.673125  1448 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:01.826651  1720 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:13:01.819155  1715 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:01.781991  1629 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:13:01.829897  1675 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:01.822516  1699 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:13:01.922200 30077 connection.cc:256] RPC call timeout handler was delayed by -2.123055106000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:13:01.879258  1544 tablet_copy_client.cc:806] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:01.937327 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.921670  1444 raft_consensus.cc:2804] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:01.957901 30180 raft_consensus.cc:2393] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:01.981707 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:01.981842 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:01.982626 30180 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:01.982707 30186 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.920917  1691 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:01.971941  1444 raft_consensus.cc:697] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:02.002774 30104 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:01.979651  1694 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.004285 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 115413us
W20260709 13:13:02.008291 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 85908.6us
I20260709 13:13:02.003823 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.012954 30180 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:01.988415  1544 tablet_copy_client.cc:670] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:02.020401 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c1b7d91eea54fb4990789f41041df86 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:50288
I20260709 13:13:02.022522 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:01.994351  1606 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.021838 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.025676 30111 raft_consensus.cc:2410] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:13:02.027864 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.029740 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.031440  1729 consensus_queue.cc:1059] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:02.032542 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.034132  1739 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:02.041689 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.042485 30112 raft_consensus.cc:3060] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:02.043537 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 117214us
I20260709 13:13:02.040836 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.050407 30110 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:02.051466 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.053828 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.054087 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.054775 30180 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:02.036160  1739 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.078109  1739 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:02.079182 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 68171us
W20260709 13:13:02.080247 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.081804 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.082602 30108 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 5.
I20260709 13:13:02.080662 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.037850  1403 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:02.086826 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.087445 30111 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:02.088972 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.090116 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:02.090446 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.090960 30740 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:02.091672 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.092121 30180 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:02.092886  1448 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:02.092206 30107 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:02.093475 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.094358 30111 raft_consensus.cc:2410] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:13:02.098268 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.099547 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.100078 30106 raft_consensus.cc:3060] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.101660 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.101853 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.102281 30105 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:02.103739  1733 raft_consensus.cc:3055] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:02.104138  1733 raft_consensus.cc:740] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:02.105122  1733 consensus_queue.cc:260] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.103161 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.082964  1617 raft_consensus.cc:476] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:02.106928 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.107095 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.108085 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.111513 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:02.112140  1719 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:13:02.113567 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:02.016047  1694 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.030572  1606 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:02.115061 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.090103 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.115127 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:02.115676 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.103199 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.108088 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.114967 30110 raft_consensus.cc:2368] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10.
I20260709 13:13:02.142906 30105 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:02.143926 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.145661 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.147802 30110 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:02.149189 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.147274 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.151000 30111 raft_consensus.cc:2376] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8. Re-sending same reply.
I20260709 13:13:02.152386 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.153260 30105 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:02.155186 30111 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:02.155742 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.156560 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.154388 30106 raft_consensus.cc:2468] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:02.159209 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.161521 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.157159 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.165001 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.159405 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.025076  1731 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:13:02.164590 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 49528.5us
I20260709 13:13:02.166327 30109 raft_consensus.cc:2410] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:13:02.120694 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.169957 30106 raft_consensus.cc:2410] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:13:02.170197 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.171898 30109 raft_consensus.cc:2410] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:02.173326 30180 raft_consensus.cc:1240] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:02.177089 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.177675 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.177804 30113 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:02.179874 30109 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:02.179204 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.191128 30105 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:02.192016 30106 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:02.183089 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.193619 30180 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:02.113317  1444 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.170389  1617 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:02.225558  1617 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.226009  1617 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:02.228520  1630 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:02.233141  1694 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:02.234993 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.181313 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.239277 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.240272 30180 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:13:02.199249 30106 raft_consensus.cc:3055] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:02.208443  1606 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:02.210374 30186 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:02.215505  1722 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.328s	user 0.000s	sys 0.004s
I20260709 13:13:02.217767 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:02.218645  1508 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:02.224398 30104 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:02.229143  1630 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.252328 30111 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:13:02.259316 30113 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:02.266430 30113 pending_rounds.cc:85] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 4
I20260709 13:13:02.266744 30113 pending_rounds.cc:107] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:02.267027 30113 raft_consensus.cc:2889] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.244258 30106 raft_consensus.cc:740] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:02.261637 30107 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 6.
I20260709 13:13:02.260680  1508 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:02.277118  1508 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:02.325292 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.265254  1694 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:02.335809 30004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.017s	sys 0.019s
I20260709 13:13:02.291128  1630 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:02.333843 30002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.020s
W20260709 13:13:02.344937 30002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.016s	sys 0.020s
W20260709 13:13:02.345499 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 557356us
I20260709 13:13:02.336727 30186 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:13:02.343679 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 126048us
W20260709 13:13:02.336416 30004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.018s	sys 0.019s
W20260709 13:13:02.346773 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 543023us
I20260709 13:13:02.349898 30105 raft_consensus.cc:2410] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:02.350175 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.350796 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.351550 30180 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:02.352896 30106 consensus_queue.cc:260] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.368022 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:02.344281  1694 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:02.371348 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:02.367362 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:02.374033 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:02.374537 30032 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:02.374694 30034 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:02.377641 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 257055us
I20260709 13:13:02.358932  1215 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:02.378778 30001 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:02.382010 30106 raft_consensus.cc:3060] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:02.376065  1694 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.382510  1620 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.413322 30106 raft_consensus.cc:1275] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:02.414116 30106 pending_rounds.cc:85] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 4
I20260709 13:13:02.414381 30106 pending_rounds.cc:107] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:13:02.414624 30106 raft_consensus.cc:2889] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.396198  1731 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.411195  1215 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:02.430426  1055 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:13:02.418572  1745 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.445715  1215 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.446549  1745 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.448930  1745 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:02.458636  1448 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.459280  1448 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.460942  1448 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:02.463472  1746 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:13:02.466575  1715 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:13:02.467023  1715 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.468951  1715 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:02.471508 30187 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:13:02.473767 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.476334 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:02.469026  1691 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:02.488943 30112 raft_consensus.cc:2468] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:02.490630 30109 raft_consensus.cc:1275] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:02.492544 30034 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:02.494270 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.475595  1731 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:02.498831  1731 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:02.501367  1759 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:02.501654  1731 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:02.503396  1565 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.501420 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59805.4us
I20260709 13:13:02.506048 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:02.507697 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 121226us
I20260709 13:13:02.511154 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:02.512485 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:02.506898  1715 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:02.510210  1606 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:02.503979  1565 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.529110 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:02.539754 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.558669 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 46297.1us
I20260709 13:13:02.519035  1753 raft_consensus.cc:2764] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:13:02.530464  1606 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:02.568302  1752 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:02.569607 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.582257  1748 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:02.588917 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:02.579241  1606 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.577505  1715 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:02.573835  1743 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:13:02.606604  1618 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.607187  1618 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.579679  1752 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:02.643590 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 133955us
I20260709 13:13:02.644582 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.584903  1563 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:13:02.608529  1748 raft_consensus.cc:2764] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:13:02.641440  1761 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:13:02.613750  1752 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.653820 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:02.652422  1691 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:02.631654  1508 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.629971  1759 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:13:02.688216 30035 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:02.691565  1752 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.696254 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:02.697005 30037 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:02.666254 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.701459  1508 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:02.702589 30705 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 2.378s (SENT) [suppressed 24 similar messages]
I20260709 13:13:02.702716  1563 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.655622  1691 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:02.704134  1752 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:02.704392  1691 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:02.704636  1694 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.708500  1694 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:02.649605  1758 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:13:02.673981  1715 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.705169  1629 raft_consensus.cc:3055] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:02.676565  1565 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:02.652968  1655 consensus_queue.cc:1059] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:13:02.636771  1617 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.679859  1748 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.685563  1556 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:02.649262  1730 consensus_queue.cc:1059] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:13:02.686959 30034 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:02.687139 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:02.675800  1618 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:02.769002 30109 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:02.717903 30037 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
W20260709 13:13:02.717880 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64155.5us
I20260709 13:13:02.722190 30035 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:02.733736 30741 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:02.740728 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:02.723064  1629 raft_consensus.cc:740] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:02.756882  1556 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.776952 30734 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:02.758919  1617 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:02.738966  1748 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.775401 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.803285 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:02.803978 30037 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.805223 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:02.806141 30035 raft_consensus.cc:2410] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:02.800635 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.735934  1610 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.827782 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:02.831429 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 144350us
W20260709 13:13:02.833146 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.799443  1618 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.838327 30030 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:02.845747 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:02.810210  1655 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:02.848527 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 90147.9us
I20260709 13:13:02.827215  1694 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:02.857246 30035 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:02.731398  1731 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.802719  1691 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:02.867686 30037 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:02.852638  1508 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:02.851382  1655 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:02.829483  1758 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:13:02.827131  1610 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.810439  1448 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:13:02.886940 30032 raft_consensus.cc:1240] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:02.838922  1630 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:02.898141 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.910828  1630 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:02.915486 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.886222  1694 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:02.890793  1733 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:02.889556  1655 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:02.907204  1617 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.944886 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 53337.2us
I20260709 13:13:02.946645 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.952176 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:02.953334 30705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.952595 30150 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.986311 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.992427 30113 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:02.988013  1691 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:02.988793 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:02.993846 30108 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.873711  1629 consensus_queue.cc:260] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:02.991304 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.920300  1548 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:02.993363 30106 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:02.996151 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:02.998055 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:02.998555 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46047.1us
W20260709 13:13:02.999517  1776 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:13:03.002489  1610 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.003404  1731 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.008113 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:02.951648  1770 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:03.014586 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:03.008869 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:02.994714  1565 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:02.944142  1617 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:13:02.993384  1741 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:03.020660  1748 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.020800  1739 raft_consensus.cc:3055] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:03.021353  1739 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.016373  1215 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:13:03.006057  1448 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:03.011929  1691 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:03.024700  1715 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:03.025048  1691 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:03.015187 30107 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.025542  1691 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:03.016498 30151 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:03.017215 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.032430 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.009119  1563 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:03.033677 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:03.033763  1563 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:03.034320  1563 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:02.993230 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 2c1b7d91eea54fb4990789f41041df86 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
W20260709 13:13:03.035080 29920 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 204246us
I20260709 13:13:03.033105 30113 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:03.019415  1770 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.039728  1770 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.002502  1694 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.039537 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.010943  1606 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.044718 30151 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:03.045653 30104 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:03.046957  1055 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:03.047570  1055 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:03.048507  1055 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.046808  1718 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:13:03.050416  1718 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:03.050777  1718 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:13:03.051329  1757 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
W20260709 13:13:03.052322 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 206704us
I20260709 13:13:03.053622  1747 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.054203  1606 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.054723  1483 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:03.055830  1610 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.056710  1610 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:03.057577 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 190277us
I20260709 13:13:03.057919  1508 consensus_queue.cc:1059] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:03.058372 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.058867  1610 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:03.059396  1610 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:03.059746  1771 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.059942 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.061493  1759 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:03.061583  1731 consensus_queue.cc:1059] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:03.047353  1682 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:03.062640  1682 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:03.063244  1682 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:03.064172  1682 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.064999  1629 raft_consensus.cc:3060] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.066592  1508 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:03.067757  1734 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:03.068668  1508 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:03.072026  1508 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:03.072108 30004 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.072778  1630 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.092621  1630 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.072705  1508 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.096639  1508 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:03.070232 30104 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:03.097031 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:03.097241 30104 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:03.097330 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:03.076696  1771 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.044303 30113 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:03.020910  1566 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:03.098093 30104 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.098641 30736 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:03.099061 30104 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.046754  1760 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:03.101784  1760 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:03.078861 30107 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:03.102769  1760 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.103471  1784 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:03.062639 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.081919 30029 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:13:03.105808 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.105978  1771 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:03.106525  1771 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:03.106810 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44273.5us
I20260709 13:13:03.106874 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:03.107532 30734 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.094825  1630 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.108270  1630 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:03.106892  1771 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.109664  1508 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:03.110225  1508 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.112497  1508 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:03.086243 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 68912.4us
I20260709 13:13:03.087183 30738 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:03.089074 30112 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:13:03.105450  1655 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.117166 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.116792  1718 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.118247  1718 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.119272  1655 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.090166  1731 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:03.068367 30002 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.117424 30105 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:03.123134 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54779.7us
I20260709 13:13:03.097705 30732 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.108753  1630 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.123210 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:03.081631  1682 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.121578  1731 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.126159 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.127494 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.127635 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.135190 30106 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.145449 30112 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:13:03.116791 30104 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:03.149930  1528 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:03.150292  1556 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:03.151532 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:03.152385 30105 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:03.128903 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.087255 30108 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:03.153851 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.153967 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.154601 30113 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:03.154525 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.155827 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.157873 30037 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:03.161000 30032 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:03.161945 30030 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:03.170013 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.171157 30150 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.172155 30108 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:03.178822 30736 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:03.178939 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.176810 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.180087 30187 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:03.130606  1753 raft_consensus.cc:2764] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:13:03.184680  1730 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.195405  1730 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.172605  1733 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:13:03.161322  1565 consensus_queue.cc:1059] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:13:03.206624  1448 raft_consensus.cc:3055] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:03.207290  1448 raft_consensus.cc:740] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:03.173532  1763 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.142417  1699 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:13:03.208369  1448 consensus_queue.cc:260] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.210274  1448 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:03.210762  1617 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.216940 30732 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:03.189774  1566 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:03.206732  1731 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.219417  1731 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:03.173744  1508 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:03.221683  1508 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.221545 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:03.222251  1508 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:03.222710  1566 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:03.223210  1566 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.223627  1566 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.226029 30110 raft_consensus.cc:2410] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:13:03.226295 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.226975 30035 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:03.227823 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.232477 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.233695  1578 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:03.152844  1771 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.235433 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.235970  1771 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:03.236439 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.188642  1618 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.236775  1630 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.177991  1734 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.238492  1734 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.124023  1739 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:03.252636 30734 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:03.253073 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.259785 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.287134  1578 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.287981 30105 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:03.186318 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.329986 30108 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:03.289958 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.188516  1748 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:03.275635 30079 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:03.301580 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 82374.2us
I20260709 13:13:03.241591  1743 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.243011  1773 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.301237  1717 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.343632 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.393730 30034 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.143764  1215 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 13:13:03.319458 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.367774 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.397096 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.367980 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.396538 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1747) took 1311 ms. Trace:
I20260709 13:13:03.191071  1655 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:03.397778 30029 raft_consensus.cc:2468] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:03.397835 30036 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:03.369334 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:03.379581 30035 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:03.388330 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:03.341573 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 51715.9us
I20260709 13:13:03.401186 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.400094 30032 raft_consensus.cc:2368] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:03.402401 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:03.397811 30110 rpcz_store.cc:276] 0709 13:13:02.085516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.148854 (+ 63338us) service_pool.cc:224] Handling call
0709 13:13:03.393679 (+1244825us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400305cd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:03.396470 (+  2791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472359680}
I20260709 13:13:03.269052 30106 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:03.396507 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:03.390228 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 245737us
I20260709 13:13:03.406786 30031 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:03.315302  1730 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:03.410635  1055 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.412389  1763 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:03.393764  1606 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:03.425660  1606 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.428089  1606 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:03.428689  1655 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.432262  1655 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.441843  1739 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:03.447877  1548 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:03.450723  1734 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:03.452066 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.454756  1691 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.387137  1618 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:03.457823  1618 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.459527 30034 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:03.404523 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 129040us
I20260709 13:13:03.368592  1565 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:03.461700 30079 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.397117  1748 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.302230  1563 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.463734  1748 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.408751  1743 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.409883 30105 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:03.466425 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.466425  1483 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:03.468530  1743 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:03.468672 30105 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:03.469077  1483 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:03.410017 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:03.468765 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.470376 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 60468.4us
I20260709 13:13:03.471143 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.410313  1617 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:03.459146  1618 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.476361 30034 raft_consensus.cc:1217] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-10.6]   Dedup: 10.6->[]
I20260709 13:13:03.476948  1618 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:03.477591 30034 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:13:03.341506  1620 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:03.475418  1617 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:03.492358 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.475605 30150 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:13:03.493490 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 210903us
W20260709 13:13:03.482879 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 86969.9us
I20260709 13:13:03.476101  1556 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.495941 30001 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.498658 30034 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:03.505648 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.503715 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:03.506284 30741 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:13:03.495016 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:03.507876 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:03.510332 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.510708 30034 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:03.519315 30004 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.529529 30150 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:03.493641  1565 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:03.531116 30004 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:03.539083 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.505493  1215 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:03.555193 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.555414 30034 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:03.553041 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:03.559291 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 59592us
I20260709 13:13:03.509706  1734 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:03.565035 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:03.493356  1542 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:13:03.571475 30034 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:13:03.524174  1736 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:03.526831  1699 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:03.506366  1682 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:13:03.578702 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.400041  1773 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.506717  1517 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:13:03.594203 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.509553  1717 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:13:03.555229  1691 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.558818  1730 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.503968  1620 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.558749  1556 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.505623  1723 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:13:03.561254  1733 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:03.562276  1055 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.559912  1563 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.564412  1215 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:03.612689  1770 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.644222 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 134650us
I20260709 13:13:03.617022 30037 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:03.646121 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.623363 30029 raft_consensus.cc:1217] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:13:03.648268 30029 raft_consensus.cc:1240] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:03.556394  1763 consensus_queue.cc:1048] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:13:03.575908  1736 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.629365 30031 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:03.577960  1734 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.559804  1753 consensus_queue.cc:1059] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:13:03.527954  1609 consensus_queue.cc:1048] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:13:03.572590  1483 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.658376 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.654438 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.632119  1517 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:03.695050 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.631613  1733 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.666082 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:03.661541 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 132158us
I20260709 13:13:03.668287 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.572187  1760 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:13:03.682929 30184 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:03.647640  1215 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.658558  1736 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.700317 30029 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:03.702438 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.614020  1617 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.719369 30035 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:03.706700 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:03.693885  1517 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:03.738788 30033 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:03.741173 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.660656  1770 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.742355 30029 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:03.740557 30037 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:03.703328  1733 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:03.757023 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.757421 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.758560 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.760447 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.732496  1801 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.761322 30180 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:03.697491  1699 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:03.773814 30181 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:03.741961  1743 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:03.753691  1578 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:03.777205 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:03.786587 30179 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.718138  1508 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.783658 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:03.784984 30184 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:03.791091 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:03.791900 30184 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.793742  1606 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.794317  1606 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.796272 30029 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:03.799795 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.801978 30183 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:03.802973 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.803604 30037 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:03.805541  1795 log.cc:927] Time spent T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:13:03.806659  1508 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:03.786151  1578 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:03.807354  1799 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:03.807710  1578 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:03.809302  1798 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:13:03.780817  1743 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:13:03.798033  1566 consensus_meta.cc:287] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.001s
I20260709 13:13:03.811636  1743 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.812556  1566 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.753376  1548 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:13:03.753875  1556 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:13:03.785977  1747 consensus_meta.cc:287] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.002s
I20260709 13:13:03.813159  1743 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:03.822225 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.828176 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:03.865020 30183 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:03.832814 30184 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:03.848322  1699 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.849035 30179 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:03.775596  1734 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:03.850313 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.870157 30037 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.851197 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.853870 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:03.871579 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.859858  1517 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.777482  1801 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:03.873191 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.880468 30184 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
W20260709 13:13:03.831481  1791 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:13:03.879066 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:03.888754 30179 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:03.874063 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.872128  1786 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:13:03.895138 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.868798  1747 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.896291 30181 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:13:03.901888 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:03.902751 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:03.894780  1448 consensus_meta.cc:287] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:13:03.907398 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:03.909279 30184 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:13:03.934058 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 158700us
W20260709 13:13:03.935680 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.903450  1718 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.002s
I20260709 13:13:03.990162 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:04.008502 30037 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:04.010121 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:13:04.011147 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.030474 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.079018 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.043215 30179 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:04.081365 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:04.090631 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.093273 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:13:04.097770  1790 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:13:04.100320  1804 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:13:04.102299 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:04.103207 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.104656 30037 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 14: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:04.108978 30183 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:13:03.992710  1629 consensus_meta.cc:287] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.002s
I20260709 13:13:03.980715  1620 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:04.051468  1791 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:04.113991 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.128207 30035 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
W20260709 13:13:04.070924  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.004s	sys 0.009s
I20260709 13:13:03.980345  1745 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.141s
W20260709 13:13:04.149470 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.153167 30037 raft_consensus.cc:1240] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:04.155588 30035 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:04.134574  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.004s	sys 0.010s
I20260709 13:13:04.164058 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:03.992364  1578 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.142549  1770 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:04.176515 30705 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.803s (SENT)
W20260709 13:13:04.163055  1618 consensus_meta.cc:287] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.002s
I20260709 13:13:04.182868 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:04.188757 30033 raft_consensus.cc:2468] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:04.189455 30036 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:04.193447 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:04.198333 30035 raft_consensus.cc:2376] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 9. Re-sending same reply.
I20260709 13:13:04.203512 30182 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:04.205389 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.210796 30030 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:04.198132  1802 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:04.221289 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.223726 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.217448  1758 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:04.228575 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.229470 30030 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:04.224088  1823 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:04.234524 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:04.235610  1814 log.cc:927] Time spent T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:13:04.235581 30035 raft_consensus.cc:2393] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:04.228538  1758 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:04.300570  1578 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:04.313130  1816 log.cc:927] Time spent T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:13:04.312947  1758 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.314317  1758 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:04.315768  1818 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:13:04.244450  1823 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.317831 30036 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:04.319063 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.319908 30036 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:13:04.320106  1736 consensus_meta.cc:287] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 13:13:04.319983  1823 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.320876 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:04.321736 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:04.242429  1801 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.357461 30038 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 14: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
W20260709 13:13:04.381857 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.312261  1810 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.188s	user 0.000s	sys 0.002s
I20260709 13:13:04.320815  1736 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:04.422868  1825 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:13:04.427872 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.434614 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:04.435382 30107 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 6.
I20260709 13:13:04.438431 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.439752 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:04.440912  1215 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.001s
I20260709 13:13:04.441107 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.442046 30186 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:04.442422 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.443089 30178 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:04.444944 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.446376 30179 raft_consensus.cc:2410] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 2.
W20260709 13:13:04.448258  1743 consensus_meta.cc:287] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.001s
I20260709 13:13:04.417627  1629 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:04.449910  1629 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.452181  1629 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.454567 30113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1785) took 1431 ms. Trace:
I20260709 13:13:04.458313 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.455276 30113 rpcz_store.cc:276] 0709 13:13:02.989361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.098778 (+109417us) service_pool.cc:224] Handling call
0709 13:13:03.154443 (+ 55665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.155230 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.420344 (+1265114us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b5400046fd0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d28ad 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:04.420526 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127337728}
I20260709 13:13:04.472473 30029 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 7.
I20260709 13:13:04.486867 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 951) took 1326 ms. Trace:
I20260709 13:13:04.487391 30108 rpcz_store.cc:276] 0709 13:13:03.160427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.429529 (+269102us) service_pool.cc:224] Handling call
0709 13:13:03.430065 (+   536us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:13:03.430734 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.430779 (+    45us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:13:03.431867 (+  1088us) log.cc:844] Serialized 104 byte log entry
0709 13:13:03.572080 (+140213us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:03.614422 (+ 42342us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.424621 (+810199us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b18002aec20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:13:04.485985 (+ 61364us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b18002aec20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe9acb3c7 00007fcbe60dd9a7 00007fcbe60ed0bf 00007fcbe60ed038
0709 13:13:04.486237 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.486487 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.486568 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:04.486613 (+    45us) raft_consensus.cc:1685] finished
0709 13:13:04.486627 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.486797 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7441,"prepare.queue_time_us":45625,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":4585,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10765,"spinlock_wait_cycles":20609024,"thread_start_us":139739,"threads_started":1,"wal-append.queue_time_us":204891}
I20260709 13:13:04.500190 30186 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:04.503400 30180 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:13:04.457674  1736 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.506995 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.513567 30704 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:04.517061 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:04.518201 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.502378  1629 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.506117  1733 consensus_meta.cc:287] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:13:04.441334  1215 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.498163  1617 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:04.530470 30037 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:04.531397 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.522794 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:04.526257 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.527104 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.533643 30184 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:04.536512 30183 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:13:04.540001 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.523257  1823 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:04.545454 30178 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:04.546454 30180 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:04.551326 30187 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:04.553268 30178 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:04.530452  1629 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.568663 30186 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:04.582629 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.586347 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:04.546885  1823 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.593084 30186 raft_consensus.cc:1240] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:04.595468 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.530786  1733 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.601732 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.604658 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.608160 30180 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:04.543826  1617 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.592031  1823 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.615376 30038 raft_consensus.cc:1240] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:13:04.617797 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:04.588817  1815 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:13:04.607846  1763 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:13:04.592653  1803 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:13:04.636909 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:04.640652 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.628988  1699 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.632735  1758 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:04.627280 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:04.676775 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.678965  1215 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:04.679692  1773 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:04.649381  1699 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.684540  1699 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:04.685853 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.695617 30031 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:13:04.698087  1828 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:13:04.704753 30031 raft_consensus.cc:1240] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:13:04.652837  1758 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:04.720079 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.746696  1617 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.738844  1733 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:04.749686  1758 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:04.755290 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2299) took 1175 ms. Trace:
I20260709 13:13:04.757899 30035 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:04.757879  1823 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.762064  1823 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.766170 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:04.767019 30113 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.755836 30032 rpcz_store.cc:276] 0709 13:13:03.579822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.579935 (+   113us) service_pool.cc:224] Handling call
0709 13:13:03.580256 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.580480 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:03.701544 (+121064us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.753773 (+1052229us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b180003e6e0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe9acb3c7 00007fcbe60dd9a7 00007fcbe60ed0bf 00007fcbe60ed038
0709 13:13:04.754004 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.754483 (+   479us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.754664 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.754715 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:04.754778 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.754867 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:04.755177 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50915,"prepare.queue_time_us":172001,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3258,"raft.queue_time_us":31785,"raft.run_wall_time_us":14377,"spinlock_wait_cycles":28011264,"thread_start_us":81854,"threads_started":1}
I20260709 13:13:04.774888  1606 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:04.780194 30113 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
W20260709 13:13:04.782210 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 133374us
I20260709 13:13:04.789726 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.788111 30704 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:04.803894 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:04.805258 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.805377 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:04.805454 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.809655 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:04.803694  1823 raft_consensus.cc:2804] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:04.817353 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.810907  1630 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.822697  1630 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:04.831578  1823 raft_consensus.cc:697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:04.832749  1823 consensus_queue.cc:237] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.839287  1629 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:04.853659 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:04.854416 30732 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:04.875442 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:04.876156 30732 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:04.880590 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:04.878225  1609 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.883033  1215 consensus_queue.cc:1059] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:04.882992  1609 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.884042  1803 raft_consensus.cc:3055] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:04.881453  1763 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:13:04.884601  1803 raft_consensus.cc:740] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:04.885748  1803 consensus_queue.cc:260] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.887359  1803 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.893443 30182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2144) took 1136 ms. Trace:
I20260709 13:13:04.893894 30182 rpcz_store.cc:276] 0709 13:13:03.757032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.757179 (+   147us) service_pool.cc:224] Handling call
0709 13:13:04.893198 (+1136019us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540016ec54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:04.893356 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020378880}
I20260709 13:13:04.898213 30181 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:13:04.879112  1801 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:04.899785  1801 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:04.901989  1801 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:04.905958 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:04.911360 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.918864 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.922330 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:04.924878 30077 connection.cc:256] RPC call timeout handler was delayed by -1.3496266649999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:13:04.925830 30077 connection.cc:256] RPC call timeout handler was delayed by -1.3127266649999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:13:04.926232 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.926769 30077 connection.cc:256] RPC call timeout handler was delayed by -1.26322666499982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:13:04.918262 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.875586  1629 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:04.950233 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.950431 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.952365 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.952848 30185 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 6.
I20260709 13:13:04.959698 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:04.960759 30182 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:04.962088 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 152830us
I20260709 13:13:04.963340 30002 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:04.874547  1733 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.968266 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:04.968695 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:04.929764  1630 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:04.930387  1215 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:13:04.993330 30704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:04.983280 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.007624 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:04.957924  1556 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:05.018472 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:05.020493 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:05.039361 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43022 (request call id 994) took 1375 ms. Trace:
I20260709 13:13:05.039816 30741 rpcz_store.cc:276] 0709 13:13:03.664231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.665610 (+  1379us) service_pool.cc:224] Handling call
0709 13:13:03.668111 (+  2501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.668313 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:03.698092 (+ 29779us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.038900 (+1340808us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800232480. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe5c7b4bc 00007fcbe2fc948b 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287
0709 13:13:05.039000 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.039048 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:05.039094 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.039164 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.039302 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15332,"prepare.queue_time_us":30403,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5770,"raft.queue_time_us":76627,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":24064,"spinlock_wait_cycles":5799680,"thread_start_us":66163,"threads_started":1}
I20260709 13:13:04.963999  1629 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:04.972038  1733 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.046823 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:05.069010 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.068955 30181 raft_consensus.cc:3060] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:05.019850  1736 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:05.066577  1609 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.037873  1608 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.042317  1544 tablet_copy_client.cc:538] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:05.042058  1630 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.067608  1840 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:05.084601 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 953) took 1865 ms. Trace:
I20260709 13:13:05.106693 30110 rpcz_store.cc:276] 0709 13:13:03.219553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.408947 (+189394us) service_pool.cc:224] Handling call
0709 13:13:03.409235 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.435097 (+ 25862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.435148 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.435214 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:03.435263 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.084193 (+1648930us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540030b1d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:05.084247 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.084510 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58903296}
I20260709 13:13:05.017169  1215 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.100677 30741 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:05.021852  1556 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.044307  1823 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:13:05.097774  1845 log.cc:927] Time spent T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:05.100023  1801 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:05.115093 30732 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:05.118022 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.120105 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.120944 30734 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:05.138906 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:05.140518 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 213166us
W20260709 13:13:05.144605 30077 connection.cc:256] RPC call timeout handler was delayed by -1.2182266649999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2291s for a response
I20260709 13:13:05.127696  1655 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:05.163967 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:05.166545 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.168267 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.171881 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 151498us
I20260709 13:13:05.156562  1606 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:05.175319 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.129412  1770 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:13:05.160485  1483 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.183127 30182 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:05.160296  1403 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:13:05.198446 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 229844us
I20260709 13:13:05.171224  1850 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.177868  1606 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.191138  1483 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.210310 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.196609  1823 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:05.174062  1655 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.222904  1655 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.223546  1655 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.224035  1655 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.207443  1606 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:05.218717  1556 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.218845  1733 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.219412  1629 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:05.233788 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.207183  1617 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.262490  1617 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:05.264773  1836 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.443s	user 0.002s	sys 0.000s
I20260709 13:13:05.207638  1850 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.267535  1850 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.225281  1215 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:05.275943  1833 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.462s	user 0.000s	sys 0.003s
I20260709 13:13:05.276490  1854 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:05.277074  1854 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.279371  1854 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.285353  1566 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:05.290154  1801 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.296060 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:05.297197 30035 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:05.301678 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.302618 30032 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:13:05.303376 30181 raft_consensus.cc:2468] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:13:05.238699 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.239629 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.198305  1403 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:05.229797  1843 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:13:05.223938  1770 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:05.247691  1483 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.250139  1655 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.243468  1853 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:13:05.306229 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.331573 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 92976.4us
I20260709 13:13:05.265141  1617 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:05.344488 30150 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.545s (SENT)
I20260709 13:13:05.346625  1733 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.343873  1699 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.366852 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.373859 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2297) took 1794 ms. Trace:
I20260709 13:13:05.383378 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2143) took 1626 ms. Trace:
W20260709 13:13:05.383654 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 187663us
I20260709 13:13:05.383802 30187 rpcz_store.cc:276] 0709 13:13:03.756549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.756734 (+   185us) service_pool.cc:224] Handling call
0709 13:13:05.383170 (+1626436us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54002661d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:05.383321 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824745856}
I20260709 13:13:05.382687 30034 rpcz_store.cc:276] 0709 13:13:03.579218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.583404 (+  4186us) service_pool.cc:224] Handling call
0709 13:13:03.583794 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:03.627800 (+ 44006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:03.627843 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:03.639731 (+ 11888us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.751812 (+112081us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:03.751864 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.752200 (+   336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.371789 (+1619589us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b2400190da8. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2e6c9c4 00007fcbe2e6aacb 00007fcbe3025dc9 00007fcbe3025a55 00007fcbe3024fb0 00007fcbe5c9b488 00007fcbe5c9bbe8 00007fcbe5c73398 00007fcbe5c6e76a 00007fcbe5c6dbb6
0709 13:13:05.373562 (+  1773us) raft_consensus.cc:1685] finished
0709 13:13:05.373584 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.373796 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7227,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5190,"spinlock_wait_cycles":53315968,"thread_start_us":49058,"threads_started":1,"wal-append.queue_time_us":306715}
I20260709 13:13:05.386323 30004 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:05.387315 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:05.369236  1544 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:13:05.396900 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.382179  1772 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:05.413100 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.413127 30187 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:13:05.417152 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.418339 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 208105us
I20260709 13:13:05.388582  1618 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:05.383534  1734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.016s
I20260709 13:13:05.401481  1606 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.399638  1629 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.370134  1733 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.434054 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.370437  1699 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.439073 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.376190  1566 consensus_queue.cc:1059] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:13:05.399372  1772 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:05.440505 30705 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:05.518220 30029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 2129) took 1652 ms (client timeout 1582 ms). Trace:
I20260709 13:13:05.441371 30077 leader_election.cc:400] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:05.533466 30077 leader_election.cc:403] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:05.458021 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.534937 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 93721.5us
I20260709 13:13:05.399833  1841 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:05.533200 30029 rpcz_store.cc:269] 0709 13:13:03.852983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.871248 (+ 18265us) service_pool.cc:224] Handling call
0709 13:13:05.505284 (+1634036us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540030af54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:05.505385 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326885248}
W20260709 13:13:05.440845  1734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.006s	sys 0.017s
W20260709 13:13:05.538893 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 99951.9us
I20260709 13:13:05.425958  1853 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:05.516129 30107 raft_consensus.cc:1275] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:05.542685 30036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2306) took 1077 ms. Trace:
W20260709 13:13:05.548161 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 107732us
I20260709 13:13:05.550099 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:05.555516 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 84048.4us
I20260709 13:13:05.399549  1847 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:05.564852 30150 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.721s (SENT)
I20260709 13:13:05.509385  1517 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:05.464996  1723 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:05.536404  1850 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:05.512521  1403 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.463322  1763 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:05.562363 30036 rpcz_store.cc:276] 0709 13:13:04.465614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.465833 (+   219us) service_pool.cc:224] Handling call
0709 13:13:04.466326 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.466619 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:04.772198 (+305579us) log.cc:844] Serialized 14 byte log entry
0709 13:13:04.970528 (+198330us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.283854 (+313326us) spinlock_profiling.cc:243] Waited 974 us on lock 0x7b18001ddd60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe9acb3c7 00007fcbe60dd9a7 00007fcbe60ed0bf 00007fcbe60ed038
0709 13:13:05.533108 (+249254us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.534128 (+  1020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.534191 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:05.534255 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.534335 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.542622 (+  8287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318135,"prepare.queue_time_us":484806,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":2248,"raft.queue_time_us":146883,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":19802,"spinlock_wait_cycles":3451520,"thread_start_us":573097,"threads_started":4,"wal-append.queue_time_us":34209}
I20260709 13:13:05.592515 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.550034  1846 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:05.542906  1770 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:05.556879  1841 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.598995 30036 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:05.442509  1618 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.601567 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.570243  1847 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:05.588956  1743 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:05.603600 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.570333  1382 raft_consensus.cc:2804] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:05.606272 30037 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:05.606294 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.600271 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.623449 30032 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:05.623812 30029 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:05.598960  1853 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.596107  1860 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:05.648085 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.600109  1629 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:05.605127  1682 raft_consensus.cc:3055] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:05.591009  1483 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:13:05.595486  1840 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:05.648743 30029 raft_consensus.cc:2376] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10. Re-sending same reply.
I20260709 13:13:05.611747  1403 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:05.649632 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 84819.1us
I20260709 13:13:05.611056  1841 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:05.612185  1847 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:05.655066 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.657860 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.669929 30181 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:05.658476 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.658804 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.659159 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.696223 30184 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:05.596617  1723 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.603267  1849 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:13:05.649340 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:05.663542 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.653380  1682 raft_consensus.cc:740] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:05.624917  1743 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:05.673046  1863 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:13:05.674391 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2515) took 1117 ms. Trace:
I20260709 13:13:05.675932  1606 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.677731  1699 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.679875 30029 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:05.647519  1770 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:05.618299  1856 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:13:05.590905  1803 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:05.603956  1763 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.671563 30186 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:05.648402  1860 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:05.648897  1382 raft_consensus.cc:697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:05.672173 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:05.705879 30032 raft_consensus.cc:2376] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10. Re-sending same reply.
W20260709 13:13:05.711437 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.720263  1823 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.716768 30178 rpcz_store.cc:276] 0709 13:13:04.556674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.578435 (+ 21761us) service_pool.cc:224] Handling call
0709 13:13:04.591796 (+ 13361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.592153 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.592181 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:05.352360 (+760179us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b2c00111558. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:13:05.352955 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.549109 (+196154us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:05.549149 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.549219 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.674119 (+124900us) raft_consensus.cc:1685] finished
0709 13:13:05.674138 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.674333 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3340,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10432,"spinlock_wait_cycles":9962368,"thread_start_us":159276,"threads_started":1,"wal-append.queue_time_us":263391}
I20260709 13:13:05.602005  1772 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.657011  1629 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.724665  1403 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.745477 30185 raft_consensus.cc:2376] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9. Re-sending same reply.
W20260709 13:13:05.751612 30150 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.866s (SENT)
I20260709 13:13:05.654568  1853 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.753639  1772 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:05.760092 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 149605us
I20260709 13:13:05.753197  1682 consensus_queue.cc:260] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:05.661661 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 64693us
I20260709 13:13:05.725906  1854 consensus_queue.cc:1048] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:13:05.751864  1618 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.778565 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.787906 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.788749 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:05.789201 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.789968 30038 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:05.782436 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.789377 30032 raft_consensus.cc:3060] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:05.771251 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 166107us
I20260709 13:13:05.754081  1403 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.730509  1803 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.807164 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.812064 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:05.816457 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:05.816527 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 52432.9us
I20260709 13:13:05.765594  1770 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.826531 30738 raft_consensus.cc:2410] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:13:05.783342  1723 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:05.803922  1733 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.780248  1483 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:05.835187 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.844197 30031 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:05.805277  1855 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:05.830729 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:05.845196 30736 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:05.845530 29924 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.446s	user 0.021s	sys 0.031s
I20260709 13:13:05.823452  1682 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:05.828981  1866 log.cc:927] Time spent T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:13:05.754573  1823 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:05.859083 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.859819 30178 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:05.862250 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.863137 30178 raft_consensus.cc:2410] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:13:05.863266 30032 raft_consensus.cc:2468] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:05.826753 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:05.864060 30150 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.049s (SENT)
I20260709 13:13:05.864537 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:05.867201 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 60372.2us
I20260709 13:13:05.871944 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:05.847127  1483 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:05.847913  1855 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:05.860541 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:05.883097 30736 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:05.882505 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55808.3us
I20260709 13:13:05.838976  1770 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:05.930709 30150 leader_election.cc:336] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.099s (SENT)
I20260709 13:13:05.938791 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:05.939682 30032 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:13:05.940116 30150 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.141s (SENT)
W20260709 13:13:05.940828 30706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.941586 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:05.943225 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 56000.9us
I20260709 13:13:05.944547 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:05.948961  1770 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.949772  1855 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:05.950865  1855 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:05.929975  1578 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:05.843281  1382 consensus_queue.cc:237] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:05.955672  1871 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:13:05.964880 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:05.888417  1748 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:05.937516  1865 log.cc:927] Time spent T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:13:05.889101  1887 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:05.969874 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:05.979169  1763 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:05.983515  1853 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:05.990017  1556 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:05.972611  1748 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.973984  1618 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:05.975124  1758 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:13:05.968536  1655 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:13:05.973810  1883 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:13:06.030648 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 145573us
W20260709 13:13:06.008728 30150 leader_election.cc:336] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.166s (SENT)
I20260709 13:13:05.973641  1882 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:13:06.015928 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:05.972821  1770 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:06.019114 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 50321.3us
W20260709 13:13:06.043725 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 73913.4us
I20260709 13:13:05.967900  1743 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.038343 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:06.045692 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:06.044183 30002 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.031069  1748 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.030959  1618 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:06.053869 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 75649.2us
I20260709 13:13:06.050796 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:06.055864 30150 leader_election.cc:336] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.206s (SENT)
I20260709 13:13:06.031805  1483 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.043660  1770 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.066746 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.049782  1803 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:06.065743 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.063175 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.056255  1544 tablet_bootstrap.cc:700] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Time spent opening tablet: real 0.104s	user 0.004s	sys 0.001s
I20260709 13:13:06.073958 30178 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:06.052186  1617 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:06.075419 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.057477  1630 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:06.058079  1556 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:06.058362  1618 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:06.058439  1853 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:06.066847  1606 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:06.051856  1655 consensus_queue.cc:1059] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:13:06.066701  1734 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.069922  1770 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.066617  1403 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.048820  1895 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:06.079721  1617 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.088701  1630 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.106236 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.089942  1483 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:06.098568  1853 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.113072 30030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:06.118994  1630 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.096724  1517 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:06.098356  1883 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:13:06.094599  1733 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:06.083616  1892 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:06.106256 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.109277  1617 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:06.148233  1894 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:13:06.168032  1655 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:06.185659  1655 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.186197  1655 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:06.188403  1556 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.152606  1847 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.111132  1734 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.189363  1556 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.200088 30030 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:06.200554 30030 raft_consensus.cc:614] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:06.201490 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 95291.5us
I20260709 13:13:06.161337  1733 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.161019  1883 consensus_queue.cc:1243] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:06.153198  1517 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:06.201730  1847 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.218549 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.238031 30035 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:06.238304  1823 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.168942  1856 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:13:06.213629  1903 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:06.220206  1733 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.269095 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:06.218173  1906 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:06.232420  1517 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.192916  1841 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.257916  1882 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.281183 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 136333us
I20260709 13:13:06.267637  1606 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:06.289299 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61363.6us
I20260709 13:13:06.149271 29924 maintenance_manager.cc:643] P 5ee583f4769f453a90eb7fcae5ac930b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.243s	user 0.225s	sys 0.079s Metrics: {"bytes_written":29818,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":83408,"dirs.run_cpu_time_us":484,"dirs.run_wall_time_us":1504,"drs_written":1,"lbm_read_time_us":46157,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":2,"lbm_write_time_us":305614,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":315427,"threads_started":2,"update_count":1,"wal-append.queue_time_us":358463}
I20260709 13:13:06.307039 30036 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:06.290948  1900 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.318277  1556 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:06.310266  1606 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.318626  1900 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.320976  1900 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:06.284732  1882 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:06.322069  1877 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.500s	user 0.004s	sys 0.000s
I20260709 13:13:06.285024  1734 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.324090  1882 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.328331  1841 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.272408  1903 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.329932  1853 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.331182  1903 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.331014 29931 catalog_manager.cc:5697] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 6, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:06.330217 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.337034 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.337118 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 68109.2us
W20260709 13:13:06.338287 29933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 244) took 32344 ms (client timeout 15000 ms). Trace:
I20260709 13:13:06.339457 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:06.338824 29933 rpcz_store.cc:269] 0709 13:12:33.993860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.994085 (+   225us) service_pool.cc:224] Handling call
0709 13:13:06.338187 (+32344102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.292551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.293113 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.293163 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:13:01.293181 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:01.293563 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.293658 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.293688 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:01.293983 (+   295us) tablet.cc:701] Row locks acquired
0709 13:13:01.294037 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:13:01.294208 (+   171us) write_op.cc:270] Start()
0709 13:13:01.294341 (+   133us) write_op.cc:276] Timestamp: P: 1783602781294149 usec, L: 0
0709 13:13:01.294377 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.295272 (+   895us) log.cc:844] Serialized 541 byte log entry
0709 13:13:02.044205 (+748933us) op_driver.cc:464] REPLICATION: finished
0709 13:13:02.440341 (+396136us) write_op.cc:301] APPLY: starting
0709 13:13:02.470487 (+ 30146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.470767 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.470856 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.471009 (+   153us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.511138 (+ 40129us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:13:02.513998 (+  2860us) write_op.cc:312] APPLY: finished
0709 13:13:02.574236 (+ 60238us) log.cc:844] Serialized 23 byte log entry
0709 13:13:02.587479 (+ 13243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.596706 (+  9227us) write_op.cc:454] Released schema lock
0709 13:13:02.606834 (+ 10128us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.607339 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.607384 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1230,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":348881,"apply.run_cpu_time_us":2768,"apply.run_wall_time_us":175544,"num_ops":1,"prepare.queue_time_us":185123,"prepare.run_cpu_time_us":50377,"prepare.run_wall_time_us":263547,"raft.queue_time_us":327291,"raft.run_cpu_time_us":35616,"raft.run_wall_time_us":380903,"replication_time_us":703958,"thread_start_us":748215,"threads_started":4,"wal-append.queue_time_us":303096,"wal-append.run_cpu_time_us":31692,"wal-append.run_wall_time_us":1999870}]]}
I20260709 13:13:06.345988 29931 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.336392  1618 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.349037 29925 maintenance_manager.cc:419] P 5ee583f4769f453a90eb7fcae5ac930b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9773 bytes on disk
I20260709 13:13:06.349946  1770 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.359208  1483 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:06.382979  1483 consensus_queue.cc:1243] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer ef9ab4d665234a799376bf42ef5d058c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:06.382650 29931 catalog_manager.cc:5697] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 10, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.383751  1770 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.385424 29924 maintenance_manager.cc:643] P 5ee583f4769f453a90eb7fcae5ac930b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":323,"lbm_reads_lt_1ms":4}
I20260709 13:13:06.384608 29931 catalog_manager.cc:5697] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 12, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:06.386905 29931 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 3 to 5, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 5 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:06.360767  1630 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.363159  1841 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:06.364811 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.308452  1883 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.367064  1748 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.404526  1883 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.389605 30029 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:06.406845  1748 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.391201 30037 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:06.407415  1883 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.382711  1566 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:06.408604  1566 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.409067  1841 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.410893  1566 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.336699  1853 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.411598  1853 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.413698  1853 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.368196  1773 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:06.414386  1773 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:06.415253  1773 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.371248  1734 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.407533  1817 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:06.418102  1817 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.401993  1629 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.420429  1817 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.403772 29931 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 10, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.418049  1734 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:06.421561 29931 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:06.423269  1734 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.411849  1841 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.423374 29931 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.425367 29931 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.432662  1517 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.434298 30736 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:06.399335  1618 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.427278 29931 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 12 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.437285  1517 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:06.450853  1906 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:06.450937 29931 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 8 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:06.458370 29931 catalog_manager.cc:5697] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:06.459932  1608 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:06.462952 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.471120  1608 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.471349 29931 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.473869 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.474601 30032 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:06.477653 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:06.468053 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.480618 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.482122 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.473114 29931 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:06.483341 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:06.473338  1608 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.484577  1608 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:06.492027 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.492913 30031 raft_consensus.cc:2410] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:13:06.494822 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:06.495425 30032 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.484964  1608 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:06.499404 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.501932 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.502583 30179 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
W20260709 13:13:06.510396 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 226756us
I20260709 13:13:06.365338  1655 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.511683 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.512250 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.522481  1606 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:13:06.524112 30150 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.374s (SENT)
I20260709 13:13:06.525231  1760 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.525738  1760 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.525753  1874 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.526607  1874 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.527837  1760 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.528270 30034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54306 (request call id 2330) took 1129 ms. Trace:
I20260709 13:13:06.528334  1760 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.528772  1874 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:06.519721 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.531194  1565 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:06.530994  1883 consensus_queue.cc:1059] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:06.531607  1565 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:06.531903  1883 raft_consensus.cc:3055] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:06.532001  1565 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.532378  1883 raft_consensus.cc:740] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:06.528736 30034 rpcz_store.cc:276] 0709 13:13:05.398898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.399048 (+   150us) service_pool.cc:224] Handling call
0709 13:13:05.399385 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.588012 (+188627us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:05.610236 (+ 22224us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.757154 (+146918us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.757320 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.757366 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:05.757598 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.426054 (+668456us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18002eea60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1
0709 13:13:06.527571 (+101517us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18002eea60. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419
0709 13:13:06.528043 (+   472us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540010e5d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:06.528083 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.528215 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199616,"prepare.queue_time_us":22809,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":12319,"raft.queue_time_us":167341,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":6206,"spinlock_wait_cycles":442364160}
I20260709 13:13:06.538858 30004 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.540820 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.542601 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:06.543231 30107 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:06.519249 30032 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:06.505379  1608 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.548771 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:06.586546 30179 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:13:06.587968 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:06.588788 30179 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:06.541143 30153 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:06.590143 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.591212 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:06.592453 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.587215 30705 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:06.595731 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.596155 30181 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:06.598775 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:06.599524 30732 raft_consensus.cc:2393] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:06.605886  1655 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.606853 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:06.528950  1760 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.618506 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:06.491044  1617 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:06.619346 30183 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:06.608613 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 97053.9us
I20260709 13:13:06.601349 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:06.597390 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 58504us
I20260709 13:13:06.610752 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.620980 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:06.607331 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:06.614754 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.533520  1883 consensus_queue.cc:260] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.622114 30738 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:06.629030 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:06.637871  1888 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.638630 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.638790  1888 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.585996  1734 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:06.512436  1733 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:06.694967 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.698277 30183 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:06.700768 30002 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:06.648034 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 106979us
W20260709 13:13:06.704828 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 83930.8us
I20260709 13:13:06.705717 30077 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.646544 30179 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:06.709064 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:06.732254 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.718041 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:13:06.762331 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44347.3us
I20260709 13:13:06.763492 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:13:06.766022 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 65395.3us
I20260709 13:13:06.626219  1743 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:06.618882  1913 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:06.713951 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.699512  1869 log.cc:927] Time spent T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:13:06.776508 30004 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.699178  1815 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:06.796443 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:06.800818 30704 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:06.710734  1883 raft_consensus.cc:3060] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.616086  1853 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
I20260709 13:13:06.757704  1655 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:06.813016 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 173480us
I20260709 13:13:06.811853 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:06.757575  1517 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:06.699340  1556 consensus_queue.cc:1059] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:13:06.777421  1743 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.824530 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:06.795503  1630 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.797824  1815 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:06.804595  1606 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:06.822364  1871 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:06.844779 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.773558  1914 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:06.804872  1734 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:06.833997  1743 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:06.841624 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 65204.6us
I20260709 13:13:06.837939  1781 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:06.807345  1748 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.853034 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.858999  1781 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.859527  1781 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.862879  1748 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:06.865573  1902 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:06.866460  1859 raft_consensus.cc:2804] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:06.867192  1859 raft_consensus.cc:697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:06.868965  1748 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.869767  1910 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:06.870118 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.870407  1910 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.870946  1910 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.848393  1734 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.881570  1734 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.885496  1760 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:06.843894  1606 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:06.887655  1606 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:06.851939  1566 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:06.892786 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 92003.2us
I20260709 13:13:06.834003  1913 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:06.868340  1859 consensus_queue.cc:237] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.846201  1882 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:06.844612  1815 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:06.924515 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 193676us
I20260709 13:13:06.926146 30002 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:06.830739  1517 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.936718  1733 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:06.857751  1914 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:06.917946  1773 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:06.949710 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 105008us
I20260709 13:13:06.950663 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:06.961853  1923 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.962733  1923 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:06.965948  1923 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:06.968642 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:06.969539 30178 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.935868  1882 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:06.938122  1913 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:06.984346 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:06.998440 30179 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 6.
I20260709 13:13:07.008009  1517 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:07.009554  1770 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:07.010524  1770 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:07.011153  1770 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.014127  1913 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.022365  1403 raft_consensus.cc:3055] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:07.022950  1403 raft_consensus.cc:740] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:07.023861  1403 consensus_queue.cc:260] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:07.026328  1916 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:13:07.028880 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 179228us
I20260709 13:13:06.995039  1617 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.039027 30178 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:07.032162  1403 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.971168  1914 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.053428  1888 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:07.060866 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 356463us
W20260709 13:13:07.051748  1900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.017s
W20260709 13:13:07.096313  1900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.002s	sys 0.018s
I20260709 13:13:07.077829  1823 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:07.090350  1770 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.142153  1823 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:07.157430 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 206811us
I20260709 13:13:07.158475 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:07.153312 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 72386.6us
I20260709 13:13:07.160181 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.146515  1823 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.080574  1882 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:07.150521  1920 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
W20260709 13:13:07.184216  1565 consensus_meta.cc:287] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.004s
I20260709 13:13:07.184686  1565 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.186806  1565 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:07.190227 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 337277us
I20260709 13:13:07.191495  1850 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:07.191962 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.193243  1850 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.193501  1902 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:07.193651  1748 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:07.193786  1850 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.194276  1748 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.194500  1902 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.196218  1850 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.196368  1748 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:07.197005 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 271114us
I20260709 13:13:07.092576  1781 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.198588  1853 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:07.199106  1853 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:07.200001  1781 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.199944  1853 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.202509 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.202934 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.203433 30185 raft_consensus.cc:2410] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:13:07.202447  1841 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.218937  1841 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.225322 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:13:07.226686  1608 consensus_meta.cc:287] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.004s
I20260709 13:13:07.226806 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.227206  1608 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.227942 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.228614 30031 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:07.229707 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.230355 30030 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 7.
I20260709 13:13:07.221277  1841 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:07.232555  1875 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:07.233064  1875 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.233477  1875 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.234880 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.235143 30002 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.235821 30110 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:07.237300 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.239777 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:07.241503 30150 leader_election.cc:336] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.672s (SENT)
I20260709 13:13:07.243038 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:07.244107  1924 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:07.244174 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.244889 30030 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:07.247426 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.242460 30182 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.258350 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.262631 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:07.248311  1927 log.cc:927] Time spent T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.106s	user 0.003s	sys 0.001s
W20260709 13:13:07.251332  1544 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.069s	user 0.005s	sys 0.000s
W20260709 13:13:07.277864 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.265161 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
W20260709 13:13:07.260084  1920 log.cc:927] Time spent T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.077s	user 0.002s	sys 0.003s
I20260709 13:13:07.265770 30185 raft_consensus.cc:2410] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:13:07.266146 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.259569  1841 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.268433  1910 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:07.259440  1940 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 13:13:07.271158  1606 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:07.272051  1934 log.cc:927] Time spent T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:13:07.280007 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 121624us
I20260709 13:13:07.282083  1860 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:07.259851  1908 log.cc:927] Time spent T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.059s	user 0.004s	sys 0.004s
I20260709 13:13:07.287235 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:07.261157 30030 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:07.276124  1734 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.307144 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:07.301090 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:07.295758 30110 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 13.
I20260709 13:13:07.306547 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:07.308616 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:07.309042 30178 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.306248 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.309360 30032 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:07.311632 30107 raft_consensus.cc:2468] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:07.319089 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:07.320981 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:07.285841  1856 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:07.324524 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:07.330896  1910 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.352514 30178 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 13.
W20260709 13:13:07.381768 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.265810  1850 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:07.386430 30035 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:07.341161 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:07.386112 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 61675.3us
I20260709 13:13:07.366153 30033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44710 (request call id 735) took 1158 ms. Trace:
W20260709 13:13:07.335078 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.354720 30182 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:07.334430 30185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:13:07.379585 30032 raft_consensus.cc:2468] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:07.334219 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.394708 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.315981  1898 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:07.389982 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48946us
W20260709 13:13:07.408385 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 74245.2us
I20260709 13:13:07.390003 30185 raft_consensus.cc:606] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:07.392616 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.299603  1841 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.415570 30106 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:07.394418 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.393868 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.388051 30033 rpcz_store.cc:276] 0709 13:13:06.207401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.207830 (+   429us) service_pool.cc:224] Handling call
0709 13:13:06.208336 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.208886 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:06.229757 (+ 20871us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.430820 (+201063us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b180004a4a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe6522 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:13:06.526981 (+ 96161us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b180004a4a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c7323a 00007fcbe60dda2a
0709 13:13:06.820095 (+293114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.830063 (+  9968us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.830231 (+   168us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:06.830514 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.188421 (+357907us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b180004a4a0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe60cb060 00007fcbe60dd716 00007fcbe60ee287 00007fcbe60ee208
0709 13:13:07.188624 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.188701 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.365834 (+177133us) raft_consensus.cc:1685] finished
0709 13:13:07.365866 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.366071 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17452,"prepare.queue_time_us":25096,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":360448,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":6202,"spinlock_wait_cycles":78528128,"thread_start_us":279874,"threads_started":1,"wal-append.queue_time_us":693076}
I20260709 13:13:07.417853 30112 raft_consensus.cc:2376] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12. Re-sending same reply.
I20260709 13:13:07.418499 30111 raft_consensus.cc:2376] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11. Re-sending same reply.
I20260709 13:13:07.418800 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.419605 30112 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:07.395164 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.393252 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.333896  1860 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.308228  1801 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:07.395447 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.432268 30105 raft_consensus.cc:2376] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11. Re-sending same reply.
I20260709 13:13:07.333964  1883 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:07.363108  1745 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:07.387539  1403 raft_consensus.cc:2764] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:13:07.421424 30113 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:07.397364 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.424540 30109 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:07.425891 30740 raft_consensus.cc:1240] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:07.439373 30110 raft_consensus.cc:2376] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11. Re-sending same reply.
I20260709 13:13:07.440304 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.416023  1802 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.416352  1578 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:07.361902  1939 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:07.430770 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.434175 30111 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:07.437193 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:07.437654 30112 raft_consensus.cc:2410] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:07.452458 30734 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:07.452847 30106 raft_consensus.cc:2368] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13.
I20260709 13:13:07.453696 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.395018  1930 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:07.454358 30106 raft_consensus.cc:2368] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:13:07.392338  1850 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:07.427371 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:07.441654 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.457234 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.442274 30113 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:07.444970  1734 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:07.446153  1875 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.429092  1815 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.457813 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.431589  1801 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:07.460482 30151 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.455794 30002 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.480221  1891 raft_consensus.cc:2804] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:07.480692  1801 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:07.483567  1925 raft_consensus.cc:3055] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:07.484112  1925 raft_consensus.cc:740] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:07.477748  1215 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:07.454347  1578 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.485321  1215 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.485813  1215 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:07.486325  1743 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.597s	user 0.017s	sys 0.007s
I20260709 13:13:07.486788  1743 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:07.488996  1743 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.489605  1578 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:07.490567  1606 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.492628  1815 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:07.494589  1841 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.495784  1748 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.496258  1748 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.475788 30112 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:13:07.504057 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.504999 30178 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:07.505757 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:07.506222 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.456970  1802 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.515273 30187 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:07.525660 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.561187 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.562783 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.563632 30112 raft_consensus.cc:2368] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13.
I20260709 13:13:07.564481 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.457165  1930 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:07.635208 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 129049us
I20260709 13:13:07.643193 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:07.643898 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 135067us
I20260709 13:13:07.655143 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:07.656008 30186 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:07.551108  1544 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 13:13:07.500017  1841 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:07.654647  1743 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:07.665820  1850 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.431839  1898 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.664384  1215 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.671204 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:07.643831  1930 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.684588 30032 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.675609 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.685026 30113 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:13:07.508483  1891 raft_consensus.cc:697] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:13:07.689318 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.679852  1773 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.725s	user 0.013s	sys 0.011s
I20260709 13:13:07.685452 30113 pending_rounds.cc:85] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 4
I20260709 13:13:07.693543 30113 pending_rounds.cc:107] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:07.693840 30113 raft_consensus.cc:2889] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:07.655584  1875 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.698660 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.699565 30112 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:07.700587 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.700819 30032 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:07.701360 30112 raft_consensus.cc:2393] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:07.677134  1743 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.703540 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.684311  1841 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:07.711642 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.717052 30186 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:07.702952  1773 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:07.709218  1743 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:07.722669 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:07.722882 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.726859 30112 raft_consensus.cc:2393] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 9: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:07.727409 30150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.979s (SENT) [suppressed 34 similar messages]
W20260709 13:13:07.724331  1949 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:13:07.732087  1891 consensus_queue.cc:237] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.728667  1682 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:07.751799 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.755162 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.767239 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:07.768697 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 219015us
I20260709 13:13:07.770850 30112 raft_consensus.cc:2410] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:07.774565 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.776229 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.778461  1629 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.756610  1682 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.820324 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.822095 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.768697  1841 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.845831 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.847107 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.842782  1802 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:07.850165  1915 log.cc:927] Time spent T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 1.150s	user 0.003s	sys 0.014s
I20260709 13:13:07.854091  1215 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:07.838198  1748 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.857223  1682 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:07.857291 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.848253 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.865907 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.870085 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:07.870947 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.873030 30182 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:07.873497 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.873845 30002 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.874233 30178 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:07.876968 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.878984 30104 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:07.880470 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.882189 30104 raft_consensus.cc:2410] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:13:07.882385 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.883061 30108 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:07.814654  1629 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.884132 30108 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.883989 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.886565 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:07.887296 30183 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.886565 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:07.881721  1847 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:07.892086  1847 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:07.893153  1847 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:13:07.894656  1945 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.724s	user 0.008s	sys 0.002s
W20260709 13:13:07.902743  1950 log.cc:927] Time spent T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.573s	user 0.005s	sys 0.003s
I20260709 13:13:07.906840  1556 consensus_queue.cc:1059] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:07.907914  1556 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:07.908275  1556 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:07.908501 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36342 (request call id 988) took 1280 ms. Trace:
I20260709 13:13:07.911770 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.913576  1760 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:07.909119  1556 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:07.916582  1760 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:07.917582  1760 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:07.923692 30178 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:07.924923 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.925007 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:07.932686 30037 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.926826 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:07.926621 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:07.925575 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.927160 30104 raft_consensus.cc:2368] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:13:07.934902 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:07.926544 30029 raft_consensus.cc:1275] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:07.927253 30183 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:07.931635 30036 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:07.938493 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:07.908952 30107 rpcz_store.cc:276] 0709 13:13:06.628317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.628708 (+   391us) service_pool.cc:224] Handling call
0709 13:13:07.908338 (+1279630us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b540029fed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:07.908446 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486530816}
I20260709 13:13:07.942879 30107 raft_consensus.cc:1240] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:07.944293 30107 raft_consensus.cc:1240] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:07.946130 30104 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:07.867893  1898 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:07.953673 30104 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:07.958096 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.958889 30104 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:07.960642 30151 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:07.921684  1556 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.966719 30033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:07.967552 30033 raft_consensus.cc:606] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:07.967994 30033 raft_consensus.cc:614] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:07.971177 30107 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:07.971299 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:07.971958 30104 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:07.967625 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:07.954489  1748 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:07.993057 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:07.975067 30037 raft_consensus.cc:2468] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:07.966068  1609 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:08.003058 30151 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:07.994451  1823 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:07.999805  1610 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:08.009872  1823 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:08.088702  1961 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:13:07.984795  1897 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:13:08.095800 30704 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:08.010067  1900 raft_consensus.cc:2804] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:08.100399  1801 consensus_meta.cc:287] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.006s
I20260709 13:13:08.110455 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:08.114795 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:08.056964  1544 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:08.119369 30104 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:13:08.124899 30002 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:08.126204 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
W20260709 13:13:08.099313  1578 consensus_meta.cc:287] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.001s
I20260709 13:13:08.109627  1823 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:08.135280  1965 log.cc:927] Time spent T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:13:08.122469 30037 raft_consensus.cc:606] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:08.000794  1748 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.140214 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:08.138365 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.145527 30738 raft_consensus.cc:2410] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:13:08.113315  1891 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:08.137866 30037 raft_consensus.cc:614] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:08.159600 30004 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:08.117482 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.165025 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.142401 30107 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:08.124066  1610 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:08.133605  1618 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:08.124114  1900 raft_consensus.cc:697] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:08.140631  1929 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:08.183511 30001 leader_election.cc:336] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.842s (SENT)
I20260709 13:13:08.191236 30001 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:08.100797  1925 consensus_queue.cc:260] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.184960 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.121582  1801 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.119216  1630 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:13:08.165743  1860 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.734s	user 0.005s	sys 0.006s
I20260709 13:13:08.138793  1898 consensus_queue.cc:1048] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:13:08.175674  1618 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.183823  1758 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:08.198931  1544 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.158650  1578 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.212355 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.216550 30106 raft_consensus.cc:2410] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:13:08.217267 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 75462.9us
I20260709 13:13:08.199857  1734 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:08.193305  1606 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:08.202118  1929 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:08.223719 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.169906  1891 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.209834  1618 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:08.231201 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.210701  1629 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.210330  1860 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:08.234459 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:08.242837 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.243634 30186 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:08.244146 30106 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:08.200700  1743 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:08.269280 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.269472 30112 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:13:08.270102 30112 pending_rounds.cc:85] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 6
I20260709 13:13:08.270428 30112 pending_rounds.cc:107] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:13:08.270532 30001 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.777s (SENT)
I20260709 13:13:08.270736 30112 raft_consensus.cc:2889] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:08.230027  1610 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:08.282401 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.288234 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.284117  1544 tablet_bootstrap.cc:492] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
W20260709 13:13:08.280128  1887 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:13:08.233970  1606 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.299300 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:08.301790  1969 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:13:08.303902  1981 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.304455  1608 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.305574  1891 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:08.307497  1606 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:08.308200 30106 raft_consensus.cc:2468] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:13:08.310268  1930 consensus_meta.cc:287] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.005s
I20260709 13:13:08.311004  1930 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.304462  1981 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.317888 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:08.301257  1973 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:08.296814  1939 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.325485 30004 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:08.326814 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:08.328244  1850 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:08.294852  1929 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:08.335069 30001 leader_election.cc:336] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.995s (SENT)
I20260709 13:13:08.335280  1939 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:08.335709 30001 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:08.285073  1900 consensus_queue.cc:237] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:08.325817 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.338245 30113 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:08.341619  1847 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:08.346001 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.323706 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.347673  1578 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:08.348472 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:08.349341  1748 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:08.349877 30110 raft_consensus.cc:2410] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:08.354409  1930 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:08.356432 30732 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:08.357301  1981 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:08.354588 30113 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:13:08.360131 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.345772  1610 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.363379 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.357430  1618 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:08.368614 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:08.370136 30034 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:08.373497 30107 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:08.325274  1544 ts_tablet_manager.cc:1403] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 2.956s	user 0.047s	sys 0.044s
I20260709 13:13:08.376770 30037 raft_consensus.cc:1275] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:08.380776 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:08.378809 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.381695 30038 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:08.382078 30106 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:08.376477  1801 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.384006 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:08.386428  1745 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:08.387036 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:08.388809 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:08.389276 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.389483 30037 raft_consensus.cc:606] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:08.389952 30037 raft_consensus.cc:614] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:08.391042 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.394914 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.397686 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99bf410d55b470d8191aa69458330db"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:08.398717 30034 raft_consensus.cc:606] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:08.399225 30034 raft_consensus.cc:614] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:08.408860 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:08.411238 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:08.423645 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.406243  1745 consensus_queue.cc:1048] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:13:08.397460  1517 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:08.431043  1517 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.431577  1517 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:08.440243 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.445139  1961 log.cc:927] Time spent T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:08.463248  1939 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.463577 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.467905 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44710 (request call id 746) took 1243 ms. Trace:
I20260709 13:13:08.468412 30035 rpcz_store.cc:276] 0709 13:13:07.224953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.225068 (+   115us) service_pool.cc:224] Handling call
0709 13:13:08.467681 (+1242613us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002ef4d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:08.467843 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368378240}
I20260709 13:13:08.461002 30038 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 8.
I20260709 13:13:08.474025 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:08.476895 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.477906 30105 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:08.484608 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:08.487205 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.495227 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.496217 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.498553 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.500857 30106 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:08.501873  1743 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.482827  1986 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:08.522701 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.524279 30106 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:08.482472  1823 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.546986  1986 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:08.547955  1986 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.550451 30111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1807) took 1134 ms. Trace:
I20260709 13:13:08.551064 30111 rpcz_store.cc:276] 0709 13:13:07.415594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.456171 (+ 40577us) service_pool.cc:224] Handling call
0709 13:13:07.456547 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:07.460931 (+  4384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.460952 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:07.591766 (+130814us) log.cc:844] Serialized 52 byte log entry
0709 13:13:07.755653 (+163887us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:13:07.794547 (+ 38894us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.794825 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.794922 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.470727 (+675805us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b1800374ce0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fb42a6 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1
0709 13:13:08.500251 (+ 29524us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b1800374ce0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fe63f3 00007fcbe2fe87c1 00007fcbe2fe8779 00007fcbe2fe8709 00007fcbe2fe86d1 00007fcbe2fe79cd 000000000038f354 000000000038f199 00007fcbe2fc983a
0709 13:13:08.550122 (+ 49871us) raft_consensus.cc:1685] finished
0709 13:13:08.550156 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.550365 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79276,"prepare.queue_time_us":76593,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":124,"raft.queue_time_us":432,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":30925,"spinlock_wait_cycles":13374592,"thread_start_us":104762,"threads_started":2,"wal-append.queue_time_us":141180}
I20260709 13:13:08.540032 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.546664 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.566694 30104 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:08.568958 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.579442 30104 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:08.577786  1909 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.007s	sys 0.029s
I20260709 13:13:08.596175 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.597038 30107 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
W20260709 13:13:08.593767  1909 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.007s	sys 0.030s
I20260709 13:13:08.610512  1823 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:08.611575 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:08.612190 30038 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.613087  1517 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.614039 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50320 (request call id 1809) took 1178 ms. Trace:
I20260709 13:13:08.614405 30110 rpcz_store.cc:276] 0709 13:13:07.435786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.440046 (+  4260us) service_pool.cc:224] Handling call
0709 13:13:08.613841 (+1173795us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540012fa54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:08.613983 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089910656}
I20260709 13:13:08.615362 30108 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:08.616149 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:08.616832 30035 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:08.621031 30004 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:08.622582 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.624873 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.627365  1610 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:08.627954  1610 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.628940  1925 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.630769  1610 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:08.631032  1967 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.520s	user 0.003s	sys 0.000s
I20260709 13:13:08.615337  1517 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:08.631074 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:08.637090 30035 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:08.637635 30034 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 13.
I20260709 13:13:08.634853 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.635432 30038 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:08.638316 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:08.640228 30705 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:08.641052 30705 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:08.641960  1618 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.641845 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.642683 30107 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:08.626585  1914 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:13:08.644073 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.644421 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.647042 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.647846 30110 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:08.648336 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:08.648495 30001 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.864s (SENT)
I20260709 13:13:08.649797 30732 raft_consensus.cc:1240] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:13:08.649667 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:08.650655 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.651258 30104 raft_consensus.cc:2376] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9. Re-sending same reply.
I20260709 13:13:08.657219 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.656620 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.658004 30112 raft_consensus.cc:3060] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.657119 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:08.660709 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 535699us
I20260709 13:13:08.661149 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:08.661737 30111 raft_consensus.cc:2376] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9. Re-sending same reply.
I20260709 13:13:08.674525 30035 raft_consensus.cc:1240] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:08.655146  1981 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:08.679339  1981 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:08.654621  1929 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:08.655985  1980 raft_consensus.cc:2804] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:08.684492 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:08.655694  1517 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:08.656136  1887 consensus_queue.cc:1059] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:13:08.710389  1618 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:08.696092  1517 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:08.684494  1981 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:08.753187 30110 raft_consensus.cc:3055] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:09.176244 30110 raft_consensus.cc:740] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.026984  1939 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:09.177953  1939 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.177353 30110 consensus_queue.cc:260] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.179255 30110 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.113277  1882 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.179942  1882 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:08.798935 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.172430  1517 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:09.183571 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:08.762303 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.184541 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.170480 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:08.792814 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.798200 30105 raft_consensus.cc:3055] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:09.185916 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:08.983541  1887 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.173516 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.200989 30038 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:09.201476 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.186244 30105 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.182307  1882 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:08.890178  1566 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:13:08.847117 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 163314us
I20260709 13:13:09.215857 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.216784 30184 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:13:08.892802 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.174489  1544 raft_consensus.cc:359] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:08.940454  1914 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.178843  1939 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:09.121520  1999 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:13:08.846068  1815 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.813122 30108 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:09.187707 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.231439 30108 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:08.833089 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.168727  1925 consensus_meta.cc:287] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.535s	user 0.003s	sys 0.007s
I20260709 13:13:08.758057 30112 raft_consensus.cc:2468] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:09.198477 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.238284 30106 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.211575 30038 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:13:08.846153  1990 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:13:09.217566 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.242182 30181 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:09.243077 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.218060 30179 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:09.220117 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:08.760190  1618 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.186682 30111 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:09.228591 30110 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:13:09.248389 30110 pending_rounds.cc:85] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:13:09.248682 30110 pending_rounds.cc:107] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:13:09.248946 30110 raft_consensus.cc:2889] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.232194 30108 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.230273 30183 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:09.251170 30108 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.212517 30105 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.256585 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.224378  1980 raft_consensus.cc:697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:09.245162 30182 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:09.232600 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.264974 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.264864 30150 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:09.265656 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.266003 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.224818  1544 raft_consensus.cc:740] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:13:09.259667 30105 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.268958 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:09.235940 30077 connection.cc:256] RPC call timeout handler was delayed by -3.906891891999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 13:13:09.273388 30112 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:09.274788 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.213241  1887 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.253854  1618 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:09.281154 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.286221 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.223327  1566 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.248049  1609 raft_consensus.cc:493] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:09.253512  2004 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.295636 30106 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
I20260709 13:13:09.233009  1914 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.272418  1924 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:09.290462  2001 log.cc:927] Time spent T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 13:13:09.246143  1815 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.323813 30109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1803) took 1927 ms. Trace:
I20260709 13:13:09.284729 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
I20260709 13:13:09.324851  1815 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:09.294904 30181 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:09.253975  1943 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:13:09.314283 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.272632  1888 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:13:09.253903  1891 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:13:09.329577  1578 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:09.324255 30109 rpcz_store.cc:276] 0709 13:13:07.396880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.440189 (+ 43309us) service_pool.cc:224] Handling call
0709 13:13:07.440490 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.440892 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.440925 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.443009 (+  2084us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.822986 (+379977us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b4800230358. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbeaffcaa1 00007fcbeaff3b37 00007fcbeaff39ca 00007fcbeb0eb26f 00007fcbeb0eaf37 00007fcbeb0ff55c 00007fcbeb0ff508 00007fcbeb0ff488 00007fcbeb0ff443 00007fcbeb0fe6ec 00007fcbea028a96
0709 13:13:08.327665 (+504679us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18003c0580. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2fc8e07 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b 00007fcbe5c72d23 00007fcbe5c730d1 00007fcbe608ea0f
0709 13:13:08.532020 (+204355us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:08.532069 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.532140 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.323601 (+791461us) raft_consensus.cc:1685] finished
0709 13:13:09.323623 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.323756 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":11571,"raft.run_wall_time_us":374484,"spinlock_wait_cycles":29688960,"thread_start_us":204142,"threads_started":1,"wal-append.queue_time_us":1148335}
I20260709 13:13:09.337932  1743 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.338682  1743 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.300325  1609 raft_consensus.cc:515] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.325044 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.321795  1929 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:09.360966 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.267740  2002 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:13:09.369827 30150 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:09.381245 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:09.341331  1743 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.384084 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.384621 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.343061  1887 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.385512 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.385802 30113 raft_consensus.cc:3060] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:13:09.390780 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.391045 30108 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:13:09.395318 30108 pending_rounds.cc:85] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:13:09.395663 30108 pending_rounds.cc:107] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:13:09.395959 30108 raft_consensus.cc:2889] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.373893 30183 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 13.
I20260709 13:13:09.377154 30105 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:13:09.398258 30105 pending_rounds.cc:85] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:13:09.398840 30105 pending_rounds.cc:107] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:13:09.399199 30105 raft_consensus.cc:2889] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:09.400506 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.296805  2004 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.405537 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:09.412784 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:09.416786 30150 leader_election.cc:400] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:13:09.417533 30150 leader_election.cc:403] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:13:09.389333  1578 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.419256  1925 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.407750  1891 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:09.421454  1944 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:09.429551  1618 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.431645  1900 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:09.433346 30113 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:09.440124 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.471709 30179 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:09.441819 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.318045  1544 consensus_queue.cc:260] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:09.442075 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.476567 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.442740 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.443224 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.443645  1609 leader_election.cc:290] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.450876  1566 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.488860 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.363502  1929 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.490638 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.492014 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.495303  1544 ts_tablet_manager.cc:1434] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 1.112s	user 0.019s	sys 0.007s
W20260709 13:13:09.495688  1544 ts_tablet_manager.cc:1467] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Tablet startup took 1114ms
I20260709 13:13:09.453608  1914 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.391937  1897 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.402963  1887 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.341723  1980 consensus_queue.cc:237] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.414965  1888 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:09.478585 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.498238 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.493353 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.462404  1743 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.514998 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.516144 30181 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:09.517150 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.480870  1723 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:09.520063 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.514292  1897 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.520790  1723 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.521278 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.524590 30181 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:13:09.526497  1897 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.517766  1887 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.526916  1723 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.526551  1929 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.528237 30184 raft_consensus.cc:1217] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Deduplicated request from leader. Original: 10.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:13:09.535279  1888 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:09.523969 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.585029 30187 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15.
W20260709 13:13:09.553535 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 293721us
I20260709 13:13:09.514166  1743 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.556725  1939 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.520244  1517 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.567335  1925 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11.
I20260709 13:13:09.583148 30184 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:09.583704 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.610574 30151 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:09.591301 30113 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:09.617460 30732 raft_consensus.cc:1240] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:09.609076  1897 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.625869 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:09.635890 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.642627 30182 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:09.644058 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:09.622051  1900 raft_consensus.cc:2804] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:09.648845 30185 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:09.649852 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.655454 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.607767  1888 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.638228  2008 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.660975 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.661077 30004 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:09.663468 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.665732 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.671123 30038 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:09.654551  1880 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:09.655576  2009 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:09.677201 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 206972us
I20260709 13:13:09.639487  1897 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.682632 30187 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:09.667443  1929 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.668130  1875 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:09.668974  1618 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.660223  1914 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.669839  1900 raft_consensus.cc:697] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:09.688423 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.704257 30113 raft_consensus.cc:2393] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 11: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:09.690017 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.706820 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.707662 30038 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.690711 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.709978 30105 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:09.691555 30031 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:09.711797 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.692843 30029 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:09.693051 30108 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:09.713222 30108 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.713914 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.714079 30108 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.714999 30108 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:09.693619 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.715607 30029 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:09.716238 30036 raft_consensus.cc:2368] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:13:09.717582 30036 raft_consensus.cc:1240] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:13:09.694546 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:09.695180 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:09.719092 30106 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.717012 30029 raft_consensus.cc:1217] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:13:09.697253 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:09.687388 30034 raft_consensus.cc:1240] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:09.719713 30029 raft_consensus.cc:1240] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:13:09.729511 30077 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:09.731288 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.680495  1989 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:09.736675 30108 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:13:09.738456 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.747882 30035 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:09.681454  1517 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:09.752053 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 344108us
I20260709 13:13:09.745810 30187 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:09.751756  1566 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:09.746615 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.746778 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:09.742725 30038 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:09.685590  2009 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.669747  2008 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.745690 30031 raft_consensus.cc:1275] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:09.752600 30106 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:09.755060 30185 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.750831  1609 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:09.760752  1989 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:09.703747  1929 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.749774  1618 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.769312 30104 raft_consensus.cc:2368] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11.
W20260709 13:13:09.746500 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49375.3us
I20260709 13:13:09.786923  1939 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:09.786798  1875 consensus_queue.cc:1059] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:09.788157 30187 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:09.749472 30108 pending_rounds.cc:85] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 4
I20260709 13:13:09.800836 30108 pending_rounds.cc:107] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:13:09.791759 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45054.7us
I20260709 13:13:09.802532 30077 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:09.759090  1887 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.739142  1914 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.799922 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.801205 30108 raft_consensus.cc:2889] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.804047 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.805387 30037 raft_consensus.cc:2410] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:09.807384 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.808454 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.793823  1743 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.810354 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.819319 30077 leader_election.cc:400] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15.
I20260709 13:13:09.819666 30077 leader_election.cc:403] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:09.812319 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.821208 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.821065 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:09.822304 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.822829 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.823254 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:09.823856 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.826515 30187 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:09.827019 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:09.496016  1544 ts_tablet_manager.cc:1469] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Trace:
0709 13:12:57.071583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.071749 (+   166us) service_pool.cc:224] Handling call
0709 13:12:57.575226 (+503477us) ts_tablet_manager.cc:934] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
0709 13:13:00.757209 (+3181983us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:13:01.352572 (+595363us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:01.363599 (+ 11027us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:13:01.750112 (+386513us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:13:01.750473 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:01.750819 (+   346us) ts_tablet_manager.cc:989] Replica registered.
0709 13:13:01.750946 (+   127us) inbound_call.cc:177] Queueing success response
0709 13:13:05.368767 (+3617821us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:13:08.383139 (+3014372us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:13:08.494762 (+111623us) tablet_replica.cc:261] Starting instrumentation
0709 13:13:08.584392 (+ 89630us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":12414,"mutex_wait_us":4217,"raft.queue_time_us":2642,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":14737,"tablet-copy.queue_time_us":264145,"tablet-download-pool.queue_time_us":73871,"tablet-download-pool.run_cpu_time_us":1611,"tablet-download-pool.run_wall_time_us":2929050,"thread_start_us":201029,"threads_started":2}
I20260709 13:13:09.828778 30031 raft_consensus.cc:2368] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15.
W20260709 13:13:09.829012  2016 log.cc:927] Time spent T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:09.805274  1618 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.830217  1914 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.793557  2010 consensus_queue.cc:1059] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:13:09.792220  1629 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:13:09.797088  2011 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:13:09.834573  2008 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.835603  1897 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.837190  1888 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.838480  1939 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:09.839422  1939 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15.
I20260709 13:13:09.846451  1929 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.800293  1609 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.850474 30184 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:09.829571 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.801463  2007 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:09.853834 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 209755us
I20260709 13:13:09.862409 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:09.858152 30739 raft_consensus.cc:1240] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:09.859565 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:09.831337  2009 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.868127 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.870128 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:09.870340 30033 raft_consensus.cc:1240] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:09.870867 30036 raft_consensus.cc:1217] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:13:09.871842 30036 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:09.873919 30031 raft_consensus.cc:1240] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:09.875375 30031 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:09.875814 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 48841.8us
I20260709 13:13:09.877012 30033 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.831338  1618 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.826272  2019 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:09.883033 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:09.887950 30738 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEARNER]: Advancing to term 10
I20260709 13:13:09.895615 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:09.849506  2002 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:13:09.852310  1743 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:13:09.914141 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:09.914496 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:09.915227 30734 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:09.901813  2019 consensus_queue.cc:1059] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:09.886762  1608 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:09.918018  2019 raft_consensus.cc:3055] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:09.918362  2019 raft_consensus.cc:740] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.919113  2019 consensus_queue.cc:260] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.879949  1914 consensus_queue.cc:1059] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:13:09.920167  1914 consensus_queue.cc:1243] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer ef9ab4d665234a799376bf42ef5d058c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:09.920352  2019 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:09.920650  1914 raft_consensus.cc:3055] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:09.921029  1914 raft_consensus.cc:740] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:09.902863  1924 consensus_meta.cc:287] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:13:09.921762  1924 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:09.921911  1914 consensus_queue.cc:260] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.923442  1914 raft_consensus.cc:3060] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.833156  1989 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.875821  2007 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.897089  1939 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:13:09.795743  1900 consensus_queue.cc:237] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.911350  2018 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:09.914816 30740 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:09.929697 30004 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:09.901909  1609 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:09.944931 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:09.952054 30182 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:09.947891  2009 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:09.953554  1618 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:09.955801  1618 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.956189 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:09.956959 30182 raft_consensus.cc:2393] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:09.956184  1618 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.958284  2004 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:09.958856  2025 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.959357  2025 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.961748  1939 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:09.962153  1939 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:09.962972  1939 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.964133  1939 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:09.966771  1618 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:09.895890  1887 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:13:09.968439  1887 consensus_queue.cc:1243] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer ef9ab4d665234a799376bf42ef5d058c log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:13:09.880615 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 236632us
I20260709 13:13:09.971071  2007 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.971801  2011 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.985564  2011 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:09.986111  2011 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.953436  2009 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:09.990088  2009 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:09.973278  2025 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:09.974728 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:09.968981  1887 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:13:09.984810 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.992336 30182 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.991413  2009 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:10.000964  1887 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:10.010876  1887 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.012166  1887 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:10.013784 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.016239 30182 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
W20260709 13:13:10.013693  1981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.011s	sys 0.018s
I20260709 13:13:10.022254 30739 raft_consensus.cc:1240] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:10.018595  1981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.011s	sys 0.019s
I20260709 13:13:10.024742 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.026824 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:10.027513 30739 raft_consensus.cc:3060] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:10.034916 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.035228 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.036577 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.037747 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.038616 30732 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:10.039014 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.042841 30739 raft_consensus.cc:2468] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:10.045653 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.048763  2010 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:10.053612 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.056711 30183 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:10.058153 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:10.060654 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 174149us
I20260709 13:13:10.065209 30153 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:10.066515 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 314593us
I20260709 13:13:10.085263 30153 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:10.087293 30153 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:10.088640  2002 consensus_queue.cc:1048] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:13:10.098170  1925 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.070956  1609 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:10.099011  1925 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:10.099429  1925 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.025177  2011 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.099673  1897 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:10.068153  1618 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.099761  1925 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.060716  1981 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:10.071578  2004 consensus_queue.cc:1059] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:10.049520  2010 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.073892  1939 consensus_queue.cc:1059] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:10.088312  1924 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:13:10.120848  1925 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.123273  1925 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.125834  1939 consensus_queue.cc:1243] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 8d2f11cccca04a7683da4080ab797bd7 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:10.125195  1924 consensus_queue.cc:1243] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:13:10.127170  2010 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.128669  2011 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.108747  1981 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.133122  1981 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:10.173481 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 389191us
I20260709 13:13:10.177373 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:10.178145 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.189602 30032 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:10.191951 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.198253 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.200590 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.204645 30037 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:10.206797 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.208316 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
W20260709 13:13:10.210034 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 328176us
W20260709 13:13:10.210749 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.211293 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.218815 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-b7a9a88da98d43b8a556cba3e2768e28 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:13:10.219573 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-b7a9a88da98d43b8a556cba3e2768e28 on tablet b7a9a88da98d43b8a556cba3e2768e28 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:10.221647 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.222895 30034 raft_consensus.cc:2393] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 9: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:10.225186 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:10.226191 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.226372 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.226819 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.226903 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.228503 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:10.229188 30106 raft_consensus.cc:1275] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:13:10.238852 30106 pending_rounds.cc:85] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:13:10.239274 30106 pending_rounds.cc:107] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:13:10.239670 30106 raft_consensus.cc:2889] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:10.239887 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.233525 30108 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:10.242127 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.243207 30105 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:10.244385 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.246939 30107 raft_consensus.cc:2410] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:13:10.242298 30108 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:10.251010 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.252408 30107 raft_consensus.cc:2410] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:13:10.256377 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.088487  1578 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:13:10.265292 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.265564  2034 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:10.266907 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.267200 30034 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:10.268289 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.269286 30036 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:10.253679 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.269217 30107 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:10.278605  2010 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:10.269508  2036 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.283885 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.284350  1924 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.285146  1618 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.296126 30151 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:10.301623  2011 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:10.313361  1929 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:10.314121  1929 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:10.313714  1924 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.323653 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:10.323443 30108 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.324806 30739 raft_consensus.cc:3060] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.325655  1929 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.328441 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.308593  2011 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.336503  1900 raft_consensus.cc:3055] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:10.336973  1900 raft_consensus.cc:740] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:10.318960 30109 raft_consensus.cc:2468] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 14.
I20260709 13:13:10.338935  2011 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:10.344523  1924 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.330772 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:10.350894 30105 raft_consensus.cc:2393] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 8: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:09.583068 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.353858  1900 consensus_queue.cc:260] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.356016 30108 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:10.359391 30002 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:10.359864  2036 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:10.362144 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.331943 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:10.332726  1743 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:10.304921  2008 raft_consensus.cc:3055] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:10.333642  1888 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.328639  1929 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:10.405970 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:10.410665  1618 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:10.413057 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.416731  2034 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:10.417486  2034 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:10.419051 30036 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:13:10.401355 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 182624us
I20260709 13:13:10.421234 30032 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:10.390703  2008 raft_consensus.cc:740] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:10.454583 30035 pending_rounds.cc:85] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Aborting all ops after (but not including) 4
I20260709 13:13:10.457561 30035 pending_rounds.cc:107] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:13:10.457957 30035 raft_consensus.cc:2889] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:10.462643 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.466550 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.467949 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:10.469496 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.471971 30740 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:13:10.472779  2045 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:10.490334 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.491211 30030 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:10.491832  1900 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.493522 30029 raft_consensus.cc:1240] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:10.503485 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.502082 30002 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:10.507509 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 60060.3us
I20260709 13:13:10.527284  2032 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.528396  2032 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.540877  2034 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.543109 30033 raft_consensus.cc:1275] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:10.544456 30704 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:10.546263 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:10.547489 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.547796 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.548760 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.551180  1882 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.551306  2008 consensus_queue.cc:260] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:10.559887 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 154141us
I20260709 13:13:10.571596 30739 raft_consensus.cc:2468] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:10.573927 30108 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:10.581670 30108 raft_consensus.cc:1275] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:10.588487 30113 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:13:10.589864 30113 pending_rounds.cc:85] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 8
I20260709 13:13:10.590392 30113 pending_rounds.cc:107] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:13:10.590818 30113 raft_consensus.cc:2889] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:10.592716 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.598305  2037 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:13:10.576519  1882 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.601326  1882 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:10.603542  1578 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.604313  1578 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:10.605180 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.606181  1618 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:10.609100  1578 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.612005  1943 consensus_queue.cc:1059] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:13:10.613636  1578 raft_consensus.cc:3055] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:10.614403  1578 raft_consensus.cc:740] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:10.616283  1578 consensus_queue.cc:260] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.617974 30001 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.618546  1578 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:10.619033 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:10.619302 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59019.5us
I20260709 13:13:10.620208 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.620230  1875 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:10.621434  2010 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:10.622145  2010 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:10.622900  2055 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.220s	user 0.002s	sys 0.000s
W20260709 13:13:10.624321  2054 log.cc:927] Time spent T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.227s	user 0.003s	sys 0.000s
W20260709 13:13:10.625577 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.626075 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 81987.8us
W20260709 13:13:10.627341 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.576337  2008 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:10.592352  2036 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:10.636453  1887 consensus_meta.cc:287] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.508s	user 0.019s	sys 0.000s
I20260709 13:13:10.643584  2002 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:13:10.644364 30077 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:10.644697  2032 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:10.645542  1882 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.646168  1882 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.646867 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:10.648407  1882 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:10.649010  1882 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:10.641911 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.677184 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:10.653417  2036 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:10.697783 30104 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:10.700490  1989 raft_consensus.cc:2804] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:10.701735  2002 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.705631  2011 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:10.706442 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.712456 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.717819 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 90291.8us
I20260709 13:13:10.714434  2010 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:10.716097 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 76494.6us
I20260709 13:13:10.726329  2019 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.727046  2019 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.729526  1618 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:10.730309  1618 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:10.731817  1618 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.733826  1888 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:10.734002  2036 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.734499  1888 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.710974  2002 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.736999  1888 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.737689  2021 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:10.738306  2021 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.738909  2002 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.739542  2002 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:10.740186  2002 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.740751  2021 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.740890  1609 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:10.741736  1609 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.744755 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:10.745581 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 71397.6us
I20260709 13:13:10.746052 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.749960 30184 raft_consensus.cc:2393] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:10.757612 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.763744 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:10.776209 30153 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:10.776633  2013 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:10.777189  1888 consensus_queue.cc:1048] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:10.759521  2019 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:10.778832  1888 raft_consensus.cc:2804] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:10.779520  1888 raft_consensus.cc:697] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
W20260709 13:13:10.783382 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.781034  1888 consensus_queue.cc:237] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.789860 30181 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:10.790293  1981 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:10.790755 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:10.792407 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:10.796566  1943 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.796372  2028 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:10.748703  1989 raft_consensus.cc:697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:10.797358  1943 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:10.810880  2002 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.745729  1609 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.806625 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:10.823782 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 179491us
W20260709 13:13:10.828995 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.829857 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:10.802549  2053 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.407s	user 0.003s	sys 0.000s
I20260709 13:13:10.828166 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.830538 30030 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:10.798372  2028 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:13:10.841985 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.831367 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.839653 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:10.860069  2050 log.cc:927] Time spent T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.396s	user 0.004s	sys 0.000s
I20260709 13:13:10.826610  1743 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.860117 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:10.857021 29931 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 149) took 12392 ms (client timeout 15000 ms). Trace:
I20260709 13:13:10.886142 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.886801  1988 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:10.884930 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.868299  1943 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:10.894440 30002 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.894876 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.888202 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.900098 30036 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:10.905234 30037 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:10.913806 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.913966  2036 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:10.800896  1989 consensus_queue.cc:237] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:10.920317  1875 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:10.909655 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 103147us
I20260709 13:13:10.900909  1900 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.944818 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.934262  2069 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.934541  2028 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:10.972848 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 103845us
I20260709 13:13:10.973937 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:10.974218 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.975991 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:10.977034 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 92262.3us
I20260709 13:13:10.984333 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:10.995244  2034 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:10.995712  2034 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:10.985091  2037 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.001134 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:11.004528  2036 raft_consensus.cc:1064] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
W20260709 13:13:11.005096  2036 raft_consensus.cc:1068] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: Unable to promote non-voter 8d2f11cccca04a7683da4080ab797bd7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:10.999939  2034 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.006256 30179 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
W20260709 13:13:11.009959 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.010841 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.011693  2037 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:11.000165 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.013589  1608 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:11.013808  1981 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:11.014348  1608 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:11.014873  2018 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.014537 29932 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:11.016312  2074 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:10.867898 29931 rpcz_store.cc:269] 0709 13:12:58.464139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.470608 (+  6469us) service_pool.cc:224] Handling call
0709 13:13:10.856719 (+12386111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:07.278992 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:07.281935 (+  2943us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:07.281984 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:13:07.281998 (+    14us) tablet.cc:662] Decoding operations
0709 13:13:07.283694 (+  1696us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:07.283762 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:07.283802 (+    40us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:13:07.285304 (+  1502us) tablet.cc:701] Row locks acquired
0709 13:13:07.285330 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:13:07.285539 (+   209us) write_op.cc:270] Start()
0709 13:13:07.285678 (+   139us) write_op.cc:276] Timestamp: P: 1783602787285475 usec, L: 0
0709 13:13:07.285701 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:07.393373 (+107672us) log.cc:844] Serialized 5579 byte log entry
0709 13:13:07.914597 (+521224us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60cee28 00007fcbe9b09581 00007fcbe9b08d58 00007fcbe9b0d9f1 00007fcbe9b0d9a9 00007fcbe9b0d939 00007fcbe9b0d901 00007fcbe9b0cb2d 000000000038f354 000000000038f199
0709 13:13:08.000792 (+ 86195us) op_driver.cc:464] REPLICATION: finished
0709 13:13:08.298146 (+297354us) write_op.cc:301] APPLY: starting
0709 13:13:08.299716 (+  1570us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:08.675862 (+376146us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:08.675900 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:09.171052 (+495152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:09.171361 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:13:09.171424 (+    63us) write_op.cc:312] APPLY: finished
0709 13:13:09.171854 (+   430us) log.cc:844] Serialized 129 byte log entry
0709 13:13:09.334382 (+162528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.334555 (+   173us) write_op.cc:454] Released schema lock
0709 13:13:09.334616 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:09.343352 (+  8736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.343385 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3741006,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":288049,"apply.run_cpu_time_us":78269,"apply.run_wall_time_us":1049096,"cfile_cache_hit":54,"cfile_cache_hit_bytes":56349,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":58377,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":8,"num_ops":14,"prepare.queue_time_us":498565,"prepare.run_cpu_time_us":17872,"prepare.run_wall_time_us":635847,"raft.queue_time_us":254796,"raft.run_cpu_time_us":10672,"raft.run_wall_time_us":261618,"replication_time_us":692996,"spinlock_wait_cycles":36657536,"thread_start_us":779586,"threads_started":5,"wal-append.queue_time_us":570539,"wal-append.run_cpu_time_us":67242,"wal-append.run_wall_time_us":2224558}]]}
W20260709 13:13:11.021528 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.028044  2073 log.cc:927] Time spent T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:11.028172 29932 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 9, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 9 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:10.966560  1900 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.014256 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:11.038200 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.018369  2034 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.046837  1578 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:11.052129  1578 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:11.052659  1578 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:11.055034 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.058033  2034 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:11.065893 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51697.8us
I20260709 13:13:10.978066  2069 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:11.068626 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 112999us
W20260709 13:13:11.074139 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.079926 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.050316 29932 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 7, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.092545 29932 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 11, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 11 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.067099  1989 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.099974 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:11.101812 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.100862  1981 consensus_queue.cc:1048] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:13:11.106020 30077 leader_election.cc:400] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:13:11.109791 30077 leader_election.cc:403] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:11.091351  2010 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:11.115131 29932 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
W20260709 13:13:11.118327 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 78954.2us
I20260709 13:13:11.118492  2006 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:13:11.118595 29932 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:11.120409 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.120358 29932 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.121340  2037 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:11.122200 29932 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.123624 30077 leader_election.cc:400] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:11.124120 29932 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 9, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
W20260709 13:13:11.140245 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45022.4us
I20260709 13:13:11.106609 30184 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:11.116678  2018 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 7. Current term is 8.
I20260709 13:13:11.165197 29932 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 10 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:11.178061 29932 catalog_manager.cc:5697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.180202 29932 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.182227 29932 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 8, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.189926 30035 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:11.186116 29932 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 7, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 7 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:11.209720 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.214455 29932 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 8, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:11.226233 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 102843us
W20260709 13:13:11.238348 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 89002.6us
I20260709 13:13:11.229146 29932 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.216637  2089 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:13:11.251818 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:11.252974  2081 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:13:11.252888  1618 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:11.255946 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.242300  1900 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:11.271205  2069 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:11.277683  2085 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:13:11.259917  1578 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.296588 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.297871  1743 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.298504  1578 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:11.304863  2010 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:13:11.315774  2069 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:11.375501 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 78993.5us
W20260709 13:13:11.375823 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 137899us
W20260709 13:13:11.400767 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67218.9us
I20260709 13:13:11.407447 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:11.426410  2091 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:13:11.435941 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.437032  2037 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.437794  2037 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:11.438400  2093 log.cc:927] Time spent T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:11.439658  2069 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:11.440165  2037 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.400188  1743 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:11.442582 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.443832 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.447767 30077 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:11.449797  2018 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:11.450603  2018 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.455152  1618 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:11.449086 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.460206 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.460659  1900 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.461035  2018 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.461222  1900 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.461753  2018 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:11.463436  1900 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:11.463436 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:11.465008 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 147145us
W20260709 13:13:11.424458 30150 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.826s (SENT)
I20260709 13:13:11.468573 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.480520  2036 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:11.482026 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57624.8us
I20260709 13:13:11.483286  1924 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.467789  2037 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.457144  1618 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:13:11.499179 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.533293  2069 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:11.542209 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 78893.1us
I20260709 13:13:11.545872 30179 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:13:11.549353 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.552453 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 109936us
I20260709 13:13:11.541344  2010 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.566120 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:11.573153 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.579737 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:11.588313 30032 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:11.599303 30032 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:11.596787 30077 leader_election.cc:400] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15.
I20260709 13:13:11.614817 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:11.616570 30150 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.880s (SENT)
I20260709 13:13:11.617177 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:11.637539 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 79346.6us
I20260709 13:13:11.638612 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.614892  2069 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.562749  2010 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.647883 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:11.648584 30150 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.981s (SENT)
W20260709 13:13:11.648962  2100 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:11.615394  1943 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:11.649616  2037 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:11.649818  1891 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:11.650328  1943 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:11.650529  2037 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:11.650764  1943 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:11.646165  2108 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.651861  1943 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.652475  2108 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.655084  2108 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.646332  2002 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.656226  2002 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.649101 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.660362 30112 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:13:11.657786 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 59886.8us
I20260709 13:13:11.653288  1943 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.665701 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:11.672169  2010 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.673645  1891 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:11.679075  2002 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:11.684949 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.695504  1578 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.700876 30739 raft_consensus.cc:1275] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:11.686949  1891 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:11.711400 30035 raft_consensus.cc:3060] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.688290  2108 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:11.718587 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.723248  1875 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.724939  1891 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:11.726061  1891 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:11.739737 30150 leader_election.cc:336] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 2.166s (SENT)
I20260709 13:13:11.740218 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:11.700706  1900 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:13:11.746110  1618 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:11.754071 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:11.754848 30030 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:11.710114  2018 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.696345  1578 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.760739 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:11.785306 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.739154  2037 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:11.801079 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 144032us
I20260709 13:13:11.785221  1900 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:11.804272 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 112307us
W20260709 13:13:11.815784 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 111715us
I20260709 13:13:11.793957  1888 consensus_queue.cc:1048] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:13:11.787001  2018 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:11.825335 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 106313us
I20260709 13:13:11.802026  2037 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.838331  1723 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:11.838953 29921 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34f51764a89048468a6faa21020812b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:11.841611 30179 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:11.843802  2108 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.881680 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:11.846814  1723 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.884138 30185 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:13:11.904925 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 100703us
I20260709 13:13:11.915637 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:11.916671 30180 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
W20260709 13:13:11.921277 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 113221us
W20260709 13:13:11.937765 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 59938.7us
I20260709 13:13:11.911427  1723 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:11.943277 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 70703.2us
I20260709 13:13:11.891003  2108 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.948648 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:11.949532 30031 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
W20260709 13:13:11.950523 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.950974 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.955060  2115 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.962450 30001 leader_election.cc:400] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11.
I20260709 13:13:11.957718  2129 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:11.964701  2129 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:11.910943  2106 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:13:11.967881  2069 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.969619  2129 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.956048 30035 raft_consensus.cc:1275] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:11.938597  1988 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:13:11.962996 30001 leader_election.cc:403] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:13:11.970626  2115 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:11.972519  2037 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.972962  2115 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:11.993832  1578 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:12.019737  2018 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:12.027442  2118 log.cc:927] Time spent T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
W20260709 13:13:12.028998 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 68620.3us
W20260709 13:13:12.033844 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.013646  2036 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581) with higher term. Message: Invalid argument: T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11.
I20260709 13:13:12.045528  2018 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.065918 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:12.091228 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:12.095091 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 250810us
I20260709 13:13:12.094849  2127 consensus_queue.cc:1048] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:13:12.098416  2117 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:12.099354  2108 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:12.077589  2106 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:13:12.091760  2018 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.099063  2117 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.103243  2117 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:12.107062 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:12.096089  1578 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:12.109707  2018 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:12.109793  1578 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:12.119179  2123 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
W20260709 13:13:12.142643 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51492.7us
I20260709 13:13:12.120147  1723 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:12.116233  1578 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.114675  2036 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:12.148653 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.153349 30030 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:12.096860  1618 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:13:12.146263 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 54635.5us
I20260709 13:13:12.164805 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.165814 30182 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:12.151659  2034 raft_consensus.cc:1064] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:13:12.162335 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:12.153647  2036 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:12.180936 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.179352  2036 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.208554 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:12.192130  2013 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:12.218832  2013 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.222313  2018 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:12.250819 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 173892us
I20260709 13:13:12.239976  2013 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.255152 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:12.255867 30036 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.262630 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:12.267508 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:12.277614 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.281366  2018 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:12.307979  1943 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:12.311642 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:12.320163 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:12.329680  2108 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:12.308892  1943 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:12.332887  2121 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.422s	user 0.000s	sys 0.003s
I20260709 13:13:12.333130  1943 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:12.270375  2034 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.339537 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.338013  2018 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:12.363536  2036 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:12.380681 30738 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:12.386008 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.392449 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.394753 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.396215 30036 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:12.397073 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.397800  2036 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:12.399055 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.399931  1578 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:12.405714  2010 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:12.403118  1578 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:12.420140 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.420852 30111 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:12.420317 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.421877 30108 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:12.424866 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:12.383685  2156 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:12.428257 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:12.434023  2140 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.227s	user 0.000s	sys 0.002s
I20260709 13:13:12.404152  1943 consensus_queue.cc:1048] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:12.444216  1723 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:12.399966  2013 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.452884 30739 raft_consensus.cc:2368] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:13:12.457981 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.458735 30107 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:12.465284 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.465915 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.466609 30179 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:12.468617 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.460937 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.478511 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:12.479418 30038 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.480957 30108 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:12.451596  2013 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:12.486502 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.474448 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.491218 30111 raft_consensus.cc:2410] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:13:12.498059 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.506385 30030 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:12.508164 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.509210 30108 raft_consensus.cc:2393] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:12.474943  2002 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:12.452255  2156 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.533501  1815 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:12.526055  2002 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:12.536231  2002 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:12.538103  2160 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:13:12.550253 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:12.550931 30183 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.559156 30112 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:12.561439 30038 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:12.569970 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.570685 30112 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:13:12.576431 30038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:12.578138  2156 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:12.578114 30038 raft_consensus.cc:606] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.583828 30183 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:12.571511 30104 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:12.570796 30151 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:12.609717 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 53059.8us
W20260709 13:13:12.615578 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44843.3us
I20260709 13:13:12.622004 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.622787 30104 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.620229  1943 raft_consensus.cc:2804] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:12.611167  2159 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:12.659705 30705 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:12.660722 30740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:12.661633 30740 raft_consensus.cc:606] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.662570 30112 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:12.664608 30004 leader_election.cc:400] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:13:12.665129 30004 leader_election.cc:403] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:12.665320  1981 raft_consensus.cc:2804] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:12.665923  1981 raft_consensus.cc:697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:12.666777  1981 consensus_queue.cc:237] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.656539  1943 raft_consensus.cc:697] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:12.684442 30104 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:12.685870 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.686676 30104 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:12.675906  1743 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.692420  1743 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.695655  1743 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:12.696731 30107 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:12.703002  1943 consensus_queue.cc:237] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:12.706308  2135 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:12.707083  2135 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:12.678419  2130 raft_consensus.cc:3060] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:13:12.727901 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 311232us
I20260709 13:13:12.747259 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:12.746773 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 87143.1us
I20260709 13:13:12.748889 30111 raft_consensus.cc:2393] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:12.760852 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:12.722036  2135 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:12.769578 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:12.771454 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 111674us
I20260709 13:13:12.773576 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.779212 30153 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:12.788518  2156 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:12.778386  2124 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:12.789958  2124 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:12.800239 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.801038 30186 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 15.
I20260709 13:13:12.804147  2004 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:12.811563 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:12.809474 30150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.772s (SENT) [suppressed 31 similar messages]
I20260709 13:13:12.792061  2124 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:12.836467 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.836737 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:12.837432 30739 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:12.848085 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.850667 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.853945 30111 raft_consensus.cc:2393] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:12.856338 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.863559 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.865898 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.866295 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.867789 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.866866 30180 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:12.872728 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.873641 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.879976 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.880262 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.886363 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.888124 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:12.890990 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.914136 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.890888 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:12.914876  2158 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:12.938380  2173 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:13:12.948895 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:12.949561 30111 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.928123  1900 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:12.954944 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.947471  1618 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:12.958274 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 67529.7us
I20260709 13:13:12.960619 30001 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:12.963568 30002 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.966292 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.966521 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.968340 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.968791 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.970172 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.970196 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.971045 30033 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:12.971042 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.960244  1618 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:12.974414 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.975594 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.975809 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.974822 30034 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:12.975016 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.975296 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.980487 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.982162 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.965773  1888 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:12.984149 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.986593 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:12.988713 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.990085 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.990947 30104 raft_consensus.cc:2410] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:12.991746 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.992812 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:12.965543  1743 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:12.993647  1743 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:12.994109  1743 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:12.998726 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 43857.9us
I20260709 13:13:12.999459 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.000144 30001 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:13.001137 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:13.002614 30112 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:13.003543 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:13.007513 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:12.978132  1618 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:13.009425  1815 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:13.014705 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.020537 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:13.023175 30150 leader_election.cc:304] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.033809 30104 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:13.034942 30112 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:13:13.035337 30112 pending_rounds.cc:85] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 6
I20260709 13:13:13.039480 30112 pending_rounds.cc:107] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:13:13.039805 30112 raft_consensus.cc:2889] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:13.034277  1943 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:13.030684  1723 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:13.041201  2161 raft_consensus.cc:2749] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.065968 30112 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:13:13.068903 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.073487  1723 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:13.074216  2130 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) with higher term. Message: Invalid argument: T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12.
I20260709 13:13:13.075022  2130 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:13.075366  2130 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:13.075733  2130 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:13.078833  2135 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.079360  2135 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.073011 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.082542  1943 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:13.082993 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.084278 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.085076  1723 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:13.085767  1723 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:13.088497 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.090740 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:13.092170 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 109292us
W20260709 13:13:13.095834  2174 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:13:13.106778 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.112185  1723 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:13.121886  2010 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:13.133168  2161 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:13:13.112370  1943 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:13.143177 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:13.157822 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:13.124471 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:13.115463  2135 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.190006  2010 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:13.190209 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 66309us
I20260709 13:13:13.192817  2184 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:13.193346  2184 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:13.192843  2010 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.193804  2184 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:13.194133  2010 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:13.170339 30180 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:13.207805 30111 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:13.208667 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:13.173542  1988 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:13.112892  1743 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.223691 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:13.233945 30109 raft_consensus.cc:3060] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:13.236171 30740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:13.237011 30740 raft_consensus.cc:606] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:13.242537 30178 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:13.219879  2108 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.256601 30036 raft_consensus.cc:2468] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:13.260083 30034 raft_consensus.cc:1240] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:13.261031 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:13.263770 30180 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:13.274634 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:13.277841 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:13.278314 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:13.285207 30184 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:13.227293  1988 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:13.278684 30178 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
I20260709 13:13:13.294592 30037 raft_consensus.cc:1275] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:13.298110 30180 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
W20260709 13:13:13.298316 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 102121us
I20260709 13:13:13.295411 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:13.299942 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:13.237766  2006 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:13:13.287496  2037 raft_consensus.cc:2764] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:13:13.318354 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:13.329500 30111 raft_consensus.cc:2393] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 7: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:13.292448  1988 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:13.339413 30037 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:13:13.345731 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 71859.2us
I20260709 13:13:13.284967  2183 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:13:13.284866  2108 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:13.386515 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 62265.1us
I20260709 13:13:13.390303  1618 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.391909 30033 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:13.394555  1618 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.396180  1618 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:13.396811  1618 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
W20260709 13:13:13.497777 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 150068us
I20260709 13:13:13.489128  1618 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.606066 30109 raft_consensus.cc:2468] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:13:13.597322  2130 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.008s
W20260709 13:13:13.593371  2140 log.cc:927] Time spent T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.185s	user 0.003s	sys 0.002s
W20260709 13:13:13.626041  2185 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.351s	user 0.005s	sys 0.000s
W20260709 13:13:13.687796 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 387933us
W20260709 13:13:13.686604 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 274395us
W20260709 13:13:13.688460  2174 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:13:13.701586  2170 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:13:13.691009  1743 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.652408  2130 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:13.717862  2184 consensus_meta.cc:287] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.524s	user 0.021s	sys 0.000s
W20260709 13:13:13.694114  2179 log.cc:927] Time spent T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:13:13.719648 30032 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:13.719605  2108 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.719008  2184 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.724555 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2527) took 1234 ms. Trace:
I20260709 13:13:13.724184  1988 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:13.741801  2108 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:13.692173  1723 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:13.783723 30038 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:13.807658 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46745.3us
I20260709 13:13:13.787772  2130 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.815018  1988 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.761838  2108 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.791096  1723 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.818079  2108 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.819413  1723 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:13.734655 30108 rpcz_store.cc:276] 0709 13:13:12.490413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.739094 (+248681us) service_pool.cc:224] Handling call
0709 13:13:12.739463 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:12.739895 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.739931 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.740676 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:13:12.840991 (+100315us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:13.434942 (+593951us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.723175 (+288233us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.724141 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.724260 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.724311 (+    51us) raft_consensus.cc:1685] finished
0709 13:13:13.724327 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.724485 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":512782,"prepare.queue_time_us":833905,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":79,"raft.queue_time_us":3007,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":263220,"threads_started":3,"wal-append.queue_time_us":107157}
I20260709 13:13:13.824077  2214 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:13.824841  2214 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:13.827363  2214 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:13.833637  2010 consensus_meta.cc:287] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.011s
I20260709 13:13:13.834142  2010 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:13.835783 30035 raft_consensus.cc:2368] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 15. Current term is 16.
W20260709 13:13:13.839825 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 79951.2us
I20260709 13:13:13.840612  2189 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:13.841236  2189 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:13.843215 30001 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:13.849740 30105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2535) took 1209 ms. Trace:
I20260709 13:13:13.865317 30110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2530) took 1284 ms. Trace:
I20260709 13:13:13.865957 30110 rpcz_store.cc:276] 0709 13:13:12.527691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.527838 (+   147us) service_pool.cc:224] Handling call
0709 13:13:12.593992 (+ 66154us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:12.594373 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.594411 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:12.624670 (+ 30259us) log.cc:844] Serialized 52 byte log entry
0709 13:13:12.712342 (+ 87672us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:13.288935 (+576593us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.600522 (+311587us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.810153 (+209631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.811582 (+  1429us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.812000 (+   418us) raft_consensus.cc:1685] finished
0709 13:13:13.812069 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.812340 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801838,"prepare.queue_time_us":1247278,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":129,"raft.queue_time_us":239687,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":21029,"spinlock_wait_cycles":1380608,"thread_start_us":333844,"threads_started":3,"wal-append.queue_time_us":131594}
I20260709 13:13:13.876061  2196 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:13.876662  2184 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:13.877106  2183 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:13.877759  2183 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:13.883579  2187 raft_consensus.cc:493] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:13.884537  2187 raft_consensus.cc:515] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:13.878787  2183 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:13.868844  2188 log.cc:927] Time spent T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.506s	user 0.000s	sys 0.004s
I20260709 13:13:13.854781 30105 rpcz_store.cc:276] 0709 13:13:12.640670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.640837 (+   167us) service_pool.cc:224] Handling call
0709 13:13:12.641460 (+   623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.643600 (+  2140us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:13.224937 (+581337us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b18003e1b80. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbebeaede1 00007fcbebebb5b1 00007fcbe2f60c0a 00007fcbec6a0219 00007fcbe2fe8a40 00007fcbe2fe34e4 00007fcbe2fe3455 00007fcbe9acb3c7 00007fcbe60dd9a7 00007fcbe60ed0bf 00007fcbe60ed038
0709 13:13:13.357959 (+133022us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.756080 (+398121us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.767023 (+ 10943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.803839 (+ 36816us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.804015 (+   176us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:13.804232 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.804314 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.849459 (+ 45145us) raft_consensus.cc:1685] finished
0709 13:13:13.849495 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.849664 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281342,"prepare.queue_time_us":600989,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":11042,"raft.queue_time_us":258948,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":2945,"spinlock_wait_cycles":2252672,"thread_start_us":421059,"threads_started":2,"wal-append.queue_time_us":393782}
I20260709 13:13:13.890774 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1886) took 1012 ms. Trace:
I20260709 13:13:13.893606 30112 rpcz_store.cc:276] 0709 13:13:12.879255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.066804 (+187549us) service_pool.cc:224] Handling call
0709 13:13:13.067065 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.067279 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:13.645982 (+578703us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.874673 (+228691us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.890407 (+ 15734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:13.890464 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:13.890515 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.890578 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.890716 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332878,"prepare.queue_time_us":584340,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":16508,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7354,"thread_start_us":469128,"threads_started":2}
I20260709 13:13:13.908226  2010 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:13.909672  1578 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:13.911013  1988 raft_consensus.cc:993] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:13.910463  1578 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:13.911715  1988 raft_consensus.cc:1081] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:13.918126 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1883) took 1062 ms. Trace:
I20260709 13:13:13.918627 30104 rpcz_store.cc:276] 0709 13:13:12.855329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.043212 (+187883us) service_pool.cc:224] Handling call
0709 13:13:13.043488 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.046385 (+  2897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.046405 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.046734 (+   329us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.202485 (+155751us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:13.427355 (+224870us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.833106 (+405751us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:13:13.848472 (+ 15366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.851130 (+  2658us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.917693 (+ 66563us) raft_consensus.cc:1685] finished
0709 13:13:13.917838 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.918028 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200654,"prepare.queue_time_us":421176,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":176080,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":22405,"spinlock_wait_cycles":7411456,"thread_start_us":342354,"threads_started":2,"wal-append.queue_time_us":202798}
I20260709 13:13:13.868460  2195 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:13:13.876781  2130 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:13:13.928457  2192 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.004s
I20260709 13:13:13.987036  1888 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:13.987913  1888 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.006891  2189 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.014523 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.015703  2213 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:13.956540 29931 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 14, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:14.020433  2187 leader_election.cc:290] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.023181  2037 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.043128  1578 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.065060  1888 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:14.078399 29931 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index -1 to 8, term changed from 8 to 10, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:14.081897 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:14.092373 29931 catalog_manager.cc:5697] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:14.100834  2218 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.080242  1815 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:13:14.084208  2213 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.130255  2197 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.090157  2037 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:14.142536 30077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.049s	sys 0.052s
W20260709 13:13:14.145057 30077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.050s	sys 0.052s
I20260709 13:13:14.132402  2197 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.119802  2218 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.163136  2213 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.175859 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.176414 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.176919 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.179991  2197 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:14.197297 30707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.015s	sys 0.047s
W20260709 13:13:14.197988 30707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.015s	sys 0.048s
I20260709 13:13:14.177981  1618 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:14.198273 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 608765us
I20260709 13:13:14.214748 30112 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:14.215240 30112 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:14.216934 29931 catalog_manager.cc:5697] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.218779 29931 catalog_manager.cc:5697] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.210094 30111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:14.227625 30111 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.228060 30111 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.231181 30106 raft_consensus.cc:1275] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:14.219574 30112 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.237357 30112 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.239566 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:14.213140  2135 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:14.257244 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:14.258104 30110 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:14.208158  1618 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.246665 29931 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.268355 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:14.240671  2213 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.271763 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:14.276185 30106 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:14.286456 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:14.248152  1888 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:13:14.244836  1609 consensus_queue.cc:1059] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:13:14.248603  1924 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:13:14.293579 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:14.276741  2037 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.255023  2156 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:14.255018  2135 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.296770 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:14.294729 30183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42209a176ad44af88b5b1710846183cb"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:13:14.300562 30183 raft_consensus.cc:606] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:14.308516 30111 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.322615 30112 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
W20260709 13:13:14.311115 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 101309us
I20260709 13:13:14.332155 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:14.295598  2218 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.332852 30738 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:14.283648  2213 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:14.332135 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82912.8us
I20260709 13:13:14.337040 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:14.341550 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:14.338059 30112 pending_rounds.cc:85] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:13:14.344724 30179 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 15.
I20260709 13:13:14.345830 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:14.332540  1888 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:14.347775 30111 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.348243 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:14.343132 30112 pending_rounds.cc:107] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:13:14.362196 30112 raft_consensus.cc:2889] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:14.377990 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:14.378757 30739 raft_consensus.cc:3055] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:14.379072 30739 raft_consensus.cc:740] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:14.389891 30037 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:13:14.391326 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:14.374547  2226 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:13:14.387732 30739 consensus_queue.cc:260] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.349692  1888 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:14.400647 30739 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.404453 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.414458 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.415665 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.420480 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.423646 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.374533  2183 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:13:14.432624 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:14.435510 30186 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:14.432690 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:14.436434 30037 raft_consensus.cc:606] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:14.436790 30037 raft_consensus.cc:614] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:14.463915 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:14.465852 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.466581 30180 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:14.469585 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.471475 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.476084 30739 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
W20260709 13:13:14.459012  2225 log.cc:927] Time spent T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 13:13:14.539489  2239 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:13:14.541174 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.478958 30079 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
W20260709 13:13:14.552163 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 60713.2us
W20260709 13:13:14.528268 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 48487.9us
I20260709 13:13:14.554728 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:14.555467 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 76620us
I20260709 13:13:14.477500  1618 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.572718 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.574719 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.577073 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.576979 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.577143 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1892) took 1295 ms. Trace:
I20260709 13:13:14.577991 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:14.638130 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 97928.8us
I20260709 13:13:14.640228 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:14.640981 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 60149us
I20260709 13:13:14.647131 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.651489 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:14.587497 30107 rpcz_store.cc:276] 0709 13:13:13.281281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.586860 (+305579us) service_pool.cc:224] Handling call
0709 13:13:13.615042 (+ 28182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.866998 (+251956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.867030 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.867580 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:13:14.205267 (+337687us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:14.211866 (+  6599us) log.cc:844] Serialized 14 byte log entry
0709 13:13:14.212082 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.212181 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.576916 (+364735us) raft_consensus.cc:1685] finished
0709 13:13:14.576937 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.577084 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31181,"prepare.queue_time_us":6349,"raft.queue_time_us":192514,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":5766,"spinlock_wait_cycles":7537024,"thread_start_us":557917,"threads_started":2,"wal-append.queue_time_us":405480}
I20260709 13:13:14.655224 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:14.658015 30029 raft_consensus.cc:2368] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 15. Current term is 16.
I20260709 13:13:14.577522  2108 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:14.674530 30738 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 16.
W20260709 13:13:14.682427 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 104525us
I20260709 13:13:14.682866  2238 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.683481  2190 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:14.683405  2238 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.685639  2190 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:14.656196  2233 log.cc:927] Time spent T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:13:14.588478  2197 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:14.555837  2171 consensus_queue.cc:1048] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
W20260709 13:13:14.706785 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64842.3us
I20260709 13:13:14.707722 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:14.708984 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:14.711320  2256 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:14.712387  2256 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:14.712793  2256 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.713158  2256 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:14.697896 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:13:14.690498 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 216501us
I20260709 13:13:14.698289 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:14.721688 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:14.670463  2078 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.725255 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:14.728400  2212 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.686228  2190 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.729022  2212 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.696483  2108 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:14.554188  1888 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.732112  1888 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:14.732260  2108 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.733565  2116 raft_consensus.cc:2764] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:13:14.734251  2210 log.cc:927] Time spent T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:13:14.734970  2010 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:14.737139  2242 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:13:14.731297  2190 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.731300  2212 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:14.745695  1924 consensus_queue.cc:1175] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98b3b699b87245df85d3aa84c13f5691" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 13:13:14.749432 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0285ca89cc9843cab1c6899c6f83dd16" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:14.750113  2183 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.750682  2183 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.753057  2183 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.755110  2078 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.759460  2238 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.718555  2197 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:14.768033 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.768959  2197 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.773334  2159 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.773986  2159 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.776583  2159 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:14.777597  2195 raft_consensus.cc:993] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:14.779042  2238 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.780481  2004 raft_consensus.cc:3055] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:14.781559  2183 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.816699  2183 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.821100  2183 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.671855  2156 consensus_queue.cc:1048] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:13:14.690346  2187 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.822048  2187 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.823400  1578 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:14.823846  1578 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:14.824435  2187 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.714978  2237 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:14.826242  2237 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.718901  1618 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.829864  1618 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.832439  1618 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:14.832769  2231 log.cc:927] Time spent T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.544s	user 0.003s	sys 0.012s
I20260709 13:13:14.833841  1900 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:14.829102  2237 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.834326  1900 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:14.835325  1900 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.836844  1900 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:14.824771  1578 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.839663  1578 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:14.792589 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 67456.3us
I20260709 13:13:14.842433 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:14.793490  2230 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:14.794946  2135 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.845263  1609 raft_consensus.cc:993] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:14.796860 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:14.797535 29931 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.813745  2004 raft_consensus.cc:740] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:14.847925  2004 consensus_queue.cc:260] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.849690  2004 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.814893  2195 raft_consensus.cc:1081] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:14.815716  2238 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.783998  2078 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.723865  2213 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:14.857462  2238 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:14.883494 29931 catalog_manager.cc:5697] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.885267 29931 catalog_manager.cc:5697] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 7 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.886983 29931 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.889197 29931 catalog_manager.cc:5697] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:14.905632 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.965886  2004 raft_consensus.cc:1081] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
W20260709 13:13:14.906365 30110 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.018s	sys 0.049s
I20260709 13:13:14.968513  2213 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:14.968904 29931 catalog_manager.cc:5697] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.970816  2215 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.971441  2197 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:14.974005  2135 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:14.974280 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 252688us
W20260709 13:13:14.977802 30110 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.020s	sys 0.057s
W20260709 13:13:14.983335 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.983821 29931 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.989704 30077 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:14.990152 29931 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 4 to 10, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 10 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:14.991201 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:14.974558 30186 consensus_meta.cc:287] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:13:14.992367 30186 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 16.
W20260709 13:13:14.985837 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 276031us
W20260709 13:13:14.986090 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 143806us
I20260709 13:13:14.987048  2230 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:14.986840  2213 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:14.987476  2197 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.985592  2158 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:14.993359 29931 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 6 to 9, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 9 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.004212 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:15.009919 29932 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 261) took 21136 ms (client timeout 15000 ms). Trace:
I20260709 13:13:15.011650  2116 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:15.004619  2158 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.012445  2116 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:14.992755  2218 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.015126  2197 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.002169  2223 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.017567 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.005450 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:14.986886  2215 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.007591 30004 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 
I20260709 13:13:15.020700  2215 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.020785 30035 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:15.021873 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.022446  2213 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.022665  2189 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:15.023185  2189 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:15.024163  2189 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.002271  1815 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.026921 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.026700  1815 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.027066  2116 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.027889  2159 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.028391  2159 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.028617 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.028856  1815 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.029542  2104 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.022171  1743 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:15.021786 30036 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:15.006533 29931 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 5 to 8, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 8 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.032728 29931 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 10, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 10 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:15.038414 29931 catalog_manager.cc:5697] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 9, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 9 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.043190 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:15.045004 30030 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:15.045733 30105 raft_consensus.cc:1240] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:15.010591 29932 rpcz_store.cc:269] 0709 13:12:53.873385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.881524 (+  8139us) service_pool.cc:224] Handling call
0709 13:13:15.009791 (+21128267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:11.588739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:11.636569 (+ 47830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:11.636633 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:13:11.636658 (+    25us) tablet.cc:662] Decoding operations
0709 13:13:11.685952 (+ 49294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:11.705370 (+ 19418us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:11.709805 (+  4435us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:13:11.738064 (+ 28259us) tablet.cc:701] Row locks acquired
0709 13:13:11.755676 (+ 17612us) write_op.cc:260] PREPARE: finished
0709 13:13:11.755835 (+   159us) write_op.cc:270] Start()
0709 13:13:11.755987 (+   152us) write_op.cc:276] Timestamp: P: 1783602791755780 usec, L: 0
0709 13:13:11.756033 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:13:11.756696 (+   663us) log.cc:844] Serialized 6357 byte log entry
0709 13:13:12.224228 (+467532us) op_driver.cc:464] REPLICATION: finished
0709 13:13:12.340477 (+116249us) write_op.cc:301] APPLY: starting
0709 13:13:12.354162 (+ 13685us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:12.374348 (+ 20186us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:12.374511 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:12.593437 (+218926us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:12.595918 (+  2481us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:13:12.595988 (+    70us) write_op.cc:312] APPLY: finished
0709 13:13:12.596425 (+   437us) log.cc:844] Serialized 148 byte log entry
0709 13:13:12.596626 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:12.596779 (+   153us) write_op.cc:454] Released schema lock
0709 13:13:12.596857 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:12.628424 (+ 31567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:12.629292 (+   868us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21684,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":76540,"apply.run_cpu_time_us":25501,"apply.run_wall_time_us":298039,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":166414,"prepare.run_cpu_time_us":28046,"prepare.run_wall_time_us":353745,"raft.queue_time_us":103265,"raft.run_cpu_time_us":13273,"raft.run_wall_time_us":33746,"replication_time_us":467985,"thread_start_us":401972,"threads_started":4,"wal-append.queue_time_us":185565,"wal-append.run_cpu_time_us":10397,"wal-append.run_wall_time_us":1662261}]]}
I20260709 13:13:15.053747  2159 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.054013  1888 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:15.015161  2158 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.001997 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:15.051255 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 411856us
W20260709 13:13:15.069219 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64767.2us
I20260709 13:13:15.070412 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:15.058866  1888 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.035157  1815 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:15.056910  2212 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:15.040911 29931 catalog_manager.cc:5697] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.051662  2156 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.077011 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.058871  1743 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:15.057799  2184 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:15.057251  2259 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.081869 30705 leader_election.cc:400] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 15. Current term is 16.
I20260709 13:13:15.085176 30705 leader_election.cc:400] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for earlier term 15. Current term is 16.
I20260709 13:13:15.083535  1815 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.092620  1815 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.030031  2104 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.095309  2104 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.073501  2256 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.101055  2256 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.063174  2004 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:13:15.103799  2259 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.080415  2223 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.109304  2184 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.109735 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.111596  2184 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.113372  2156 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.066419  2215 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:15.116783 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.078414  1888 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.124549 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.126502 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.128364  2108 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.086897  2197 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:15.131321 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.131649 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.131934 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.132876 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.133978 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.134277 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.138818  2218 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.139675  2135 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.140619 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.143136 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.145928 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:15.146656 30152 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.150775 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.106523  2259 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.155424  1988 raft_consensus.cc:993] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:15.156088  1988 raft_consensus.cc:1081] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:15.115579  2212 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.159399  2212 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.169543 30738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.115859  1743 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.174978  1743 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.180835 30737 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:15.182785  2213 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:15.198540 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 57384.8us
W20260709 13:13:15.213836 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 164882us
I20260709 13:13:15.223367 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.238853 30002 leader_election.cc:304] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.245162 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.246526 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:15.254611 30150 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.255088 30109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3facd19034dd44899de7471297d45bbc"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:15.255842 30109 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.256263 30109 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.247622 30185 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:15.256947 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.260849 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.189836  2156 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.263218 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.261925 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.282224 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.262414  2212 raft_consensus.cc:2749] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:15.262801  1900 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:15.299571 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 173158us
I20260709 13:13:15.301172 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.292714 30109 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.280696  2266 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.305944 30183 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:15.309845 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:15.304857 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 226846us
I20260709 13:13:15.321506 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42209a176ad44af88b5b1710846183cb"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:13:15.324230 30109 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:15.329217 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.329779 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.331897 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:15.334992 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.335733 30110 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:15.305533  2135 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.339226 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.340406 30184 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:15.351249 30705 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.352269 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:15.352624  2130 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.389353 30186 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.305336  1900 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.392580  1900 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.355242  2218 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.394235  2218 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.395757  1888 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.321475  2266 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.400583  2266 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.356938 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.357796  2212 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:15.401681 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44864.7us
I20260709 13:13:15.401930  2212 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.402639 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.361332  2258 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:15.403311 30105 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:15.403422 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.405592  1743 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:15.406056 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.361590 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:15.406373  1743 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:15.367993 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.368363 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.408238 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.408690 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.371229 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.409824 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:15.368726 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.374240 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.375025 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.382143 30739 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:15.411916 30739 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:15.373342 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:15.406723 30110 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:15.369318 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.418280 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:15.419065 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 67900.2us
I20260709 13:13:15.386307 30104 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.420416 30104 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.397046  2218 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.412899 30739 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:15.430438 30739 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.423708 30113 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Rejecting Update request from peer 8d2f11cccca04a7683da4080ab797bd7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:15.435019 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.424413 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.436472 30108 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:15.438592 30186 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:15.460469 30151 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:15.474206 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.475134 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.482941 30187 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:15.431871  2235 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.471355 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.403350  2212 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:13:15.494849 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.498072 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:15.463344  2218 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.494884 30739 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:15.486467 30104 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.511541 30105 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:15.484119  2266 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:15.499012  2006 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.543489  2130 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 8 to 10, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:15.520954  2238 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:13:15.545712  2238 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:15.546041  2238 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:15.546794  2238 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.547927  2238 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.550407 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.551622 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.552677 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.553745 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.554072 30112 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:15.554880 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.556589 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.556733 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.560141 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.562171 30107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:15.562820 30107 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.563202 30107 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.570089 30110 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:15.544898  1888 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:15.573763 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.589582 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.593183 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.590519 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.586297 30181 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 8 to 10, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:15.598495 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.519996  2218 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.600512 30187 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:15.601298 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:15.606240 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.612099 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.619966 30739 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 8 to 10, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:15.623389 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.636410 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.602604  2195 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.662372 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.661872 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.672300 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.673097 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.674278 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.687848 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.689646 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.690821 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.692154 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.693835 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.690739 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.698127 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:15.698843 30038 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.699386 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:15.702530 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.703884 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.701319  2213 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:15.710858 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.726827 30038 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:15.727701 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.731468 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.737157 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:15.704820  2213 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.737974 30187 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.715351  2230 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.711079  2215 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.745587 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.770560 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.771121 30104 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.745651  2213 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.750450  2189 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.775472 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:13:15.781556  2281 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:13:15.783177  1900 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:15.783667  1900 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.784080  1900 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:15.753710  2204 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.771507  2215 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:15.786873  2215 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.789212  2215 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.766338  2259 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.782480 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:15.792347 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.795086  2256 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:15.795527  2256 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.795904  2256 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.798519  1924 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.799295  2218 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.802863 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.803795  2269 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.750751  2135 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.806306 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:15.807116  2269 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:15.807682  2269 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.808331  2269 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.816434  2256 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.807451 30150 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:15.819382  2260 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:15.819769 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.821143  2265 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:15.821316 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.822727 30739 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:15.822803 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:15.828127 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 124316us
I20260709 13:13:15.829144 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.833132 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.834642 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:15.835780 30030 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.812825  1900 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.839582 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:15.840927 30187 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:15.846685 30037 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:15.848086  2010 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:13:15.846096 30105 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 8 to 10, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:15.819816  2260 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:15.836356  2259 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.850678 30107 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.837581  2135 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.856331 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.862857 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.866446 30107 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:15.855991  2260 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.878147 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:15.879639 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 148297us
I20260709 13:13:15.880558 30001 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:15.861048  2218 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:15.882736 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 164254us
I20260709 13:13:15.883358  2189 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.891145 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.849983  2213 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:15.869835  2104 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.878171  2156 consensus_queue.cc:1059] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:13:15.991763 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:15.990206 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 99159.6us
I20260709 13:13:15.993507 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.990391 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:15.995962 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.996369 30187 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:15.998348 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:15.999262 30183 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:16.001645 30181 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:16.010397 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:15.986112  2291 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:16.026893  2290 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:16.028811  2289 log.cc:927] Time spent T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:13:15.885282  2212 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:13:15.999413  2135 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.998746  2215 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.012413  2010 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:16.070886 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 70553.5us
I20260709 13:13:16.110287  2204 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:16.115355 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 119440us
I20260709 13:13:16.068585  2256 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.058383  2295 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:16.127472 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 117156us
I20260709 13:13:16.121583 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.142084 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:16.056586  2215 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.064914  2010 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:16.121771  2130 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:16.121668  2218 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:16.177516  2213 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:16.158193  2238 consensus_meta.cc:287] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.003s
I20260709 13:13:16.184783 30185 raft_consensus.cc:3055] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:16.156953  1900 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.189349 30185 raft_consensus.cc:740] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:16.165644  2183 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.173467  2130 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:16.196278 30185 consensus_queue.cc:260] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:16.288156 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 81192.5us
W20260709 13:13:16.296602  2298 log.cc:927] Time spent T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:13:16.304744  2010 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:16.308301  2269 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.200171  2213 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:16.310590  2215 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.210570  2260 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:16.311741 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 181913us
I20260709 13:13:16.194160  1743 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:13:16.313810 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:16.314998  2215 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:16.313062  2260 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.194362  2300 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.342304 30030 consensus_meta.cc:287] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.001s
I20260709 13:13:16.315618  2215 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:16.352911 30030 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:16.364516 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:16.369313 30180 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:16.370155 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:16.372715 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:16.375219  2215 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:16.380640 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:16.380962  2311 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.381632 30180 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:16.381563  2311 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.385021  2311 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.198474  2302 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.198s
I20260709 13:13:16.395520  2130 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.397657  2130 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:16.369554  2300 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.404640  2300 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.407728 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.396106  2311 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:16.424587 30105 consensus_meta.cc:287] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 13:13:16.427004 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.445581  2295 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:16.447260 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.448866  2295 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:16.454339 30077 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.468226 30077 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:16.471093 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 325129us
I20260709 13:13:16.473428 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:16.457602  2300 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:16.479025 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:16.479103 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.482597 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:16.486145  2183 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:16.493808  2309 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:16.456955  2311 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.497666  2311 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.482673  2010 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:16.498701  2269 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.477447  2295 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:16.481377  2305 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.504072  2305 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.507035  2305 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.479703  2310 raft_consensus.cc:2749] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:16.482774 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.523675 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:16.524901 30180 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:16.543463 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:16.544291 30186 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:16.549849  2312 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:16.553188 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:16.514387  2295 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:16.609200 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 434300us
W20260709 13:13:16.610363 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 83949.4us
I20260709 13:13:16.611243 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:16.612527 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.613569 30105 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:16.615257 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 95728.3us
I20260709 13:13:16.615985 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:16.624459 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.620846  2312 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:16.647409 30105 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:16.650759  2295 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:16.651650  2295 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.652272  2295 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:16.646759 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.655181  2215 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:16.655721  2215 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.656143  2215 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:16.647670  2312 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.667488  2312 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:16.657994 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.675992 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.678030 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.679756 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.679883 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.680271 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:16.681697  2311 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.678439  2310 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:16.684373  2310 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:16.684839  2310 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:16.693254 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:16.694219  2310 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.695952 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:16.696777  2310 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.701073 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:16.704110  2312 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.704967  2215 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.706121 30105 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:16.724100 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:16.728367 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:16.728626 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:16.729574 30036 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:16.733640 30034 raft_consensus.cc:1240] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:16.737308  2258 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:16.738056  2258 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:16.739075  2258 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.742259  2312 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.744109  2215 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.770992 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.781893  2259 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:16.782816  2259 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.783320  2259 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:16.788753 30077 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:16.788153  2290 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.790597  2270 raft_consensus.cc:2804] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:16.790294  2290 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.791327  2270 raft_consensus.cc:697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:16.792320  2270 consensus_queue.cc:237] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.793838  2290 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:16.818817 30185 raft_consensus.cc:3060] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:16.820524 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:16.821235 30108 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:16.831977 30151 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:16.837381 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:16.849115 30151 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:16.848380 30001 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:16.864876 30181 raft_consensus.cc:1240] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:16.839638  2158 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:16.848660  2104 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:16.852679  2301 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.919842 30181 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:16.922422 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:16.924960 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:16.931301 30184 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:16.922791 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:16.935375  2259 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:16.936713 30178 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:16.871009  2265 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:16.956007 30183 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
W20260709 13:13:16.967541 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 118738us
I20260709 13:13:16.977105 30179 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:16.978966 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.986318  2259 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:16.987879  2310 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:16.988847 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 141115us
I20260709 13:13:16.958577  2195 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:16.992563 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:16.995867 30104 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:16.995438 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:16.918233  2158 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.013352 30185 raft_consensus.cc:2468] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:16.948441  2301 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.025734 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2229) took 1115 ms. Trace:
I20260709 13:13:16.988852  2310 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:16.993548  2195 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.029448 30185 rpcz_store.cc:276] 0709 13:13:15.900189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.900319 (+   130us) service_pool.cc:224] Handling call
0709 13:13:16.184595 (+284276us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400363e20. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe604adc0 00007fcbe60d6e18 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:16.818410 (+633815us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b58006dc1d0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe602f0aa 00007fcbe60b1447 00007fcbe60c9fe7 00007fcbe60cb7de 00007fcbe60d727c 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c
0709 13:13:17.015639 (+197229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777109504}
I20260709 13:13:17.048483 30104 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
W20260709 13:13:17.029224  1609 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:13:17.051734 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 54031.6us
I20260709 13:13:17.060293  2301 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:17.063411 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 212474us
I20260709 13:13:17.026758  2010 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.032634  2135 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:17.075206 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 226933us
I20260709 13:13:17.040894  2195 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.007913  2295 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.077713 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:17.096508 30150 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:17.098291  2135 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:17.100283  2259 raft_consensus.cc:2804] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:17.099807  2135 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.106040  2310 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.115278 30106 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:17.116330 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:17.117213 30108 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:17.119575 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.125793 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:17.110617  2330 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:17.111814  2259 raft_consensus.cc:697] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:17.092725  2010 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.150983  2183 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:17.151486  2331 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:17.161053 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.165058  2158 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:17.166878  2290 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.167441  2290 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.168110  2328 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:17.168645  2328 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:17.170903  2328 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:17.171133  2327 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:17.172835  2302 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:17.173192  2302 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.174052  2302 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.177802 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.178529 30032 raft_consensus.cc:3060] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.188714 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:17.191705 30032 raft_consensus.cc:2468] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:17.193849 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:17.200438 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44574.9us
I20260709 13:13:17.201037  2010 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.203063  2010 consensus_queue.cc:1059] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:17.203962  2332 consensus_queue.cc:1059] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:17.204974  2332 raft_consensus.cc:3055] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:17.205318  1743 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:17.205747  1743 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.207530 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.208282 30033 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.209841 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.205332  2332 raft_consensus.cc:740] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.213747 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.214674 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.214506  2332 consensus_queue.cc:260] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.215876 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.216790 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.216938  2331 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:17.217643 30030 raft_consensus.cc:2368] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.219269  2331 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:17.219471 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.220242 30035 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:17.221520 30030 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:17.215991  2332 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.142561  1900 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:17.232872 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:17.234071 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:17.242175 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.243810 30077 leader_election.cc:400] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.244267 30077 leader_election.cc:403] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:13:17.225780  2259 consensus_queue.cc:237] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.246397 30033 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:17.250376  2269 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:17.256083 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.256749 30178 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:17.282505 30077 leader_election.cc:400] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.283481 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.206604  1743 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.285218 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.286345 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.290277 30077 leader_election.cc:400] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.295388 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.298357 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.310681 30178 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:17.246526  2334 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:17.305199 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:17.312201 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 148956us
I20260709 13:13:17.315228 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.293030  2311 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:17.325733 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:17.330670 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:17.336841 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:17.337577 30112 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:17.337781 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.338459 30181 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 8.
I20260709 13:13:17.350775 30029 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 8: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:17.333829 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.353703 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.317241  2329 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.356611  2329 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.357002  2329 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.358572 30001 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:17.327275  2204 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:17.361946  2204 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.364418  2204 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.365029  2204 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:17.365689  2212 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:17.366420  2189 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:17.321888  1743 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.367517  2331 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:17.368294  2290 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.369532  2195 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.387780  2295 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.387902  2159 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.388324  2302 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.389356 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.317369  2335 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:13:17.307185  2130 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:13:17.419643  2159 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.372694 30734 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:17.421972  2159 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:17.404733  2334 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:17.422818  2334 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.424990  2334 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.435114  2292 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.435740  2292 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:17.437845 30034 raft_consensus.cc:2368] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:17.439229  2195 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.440409 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:17.441097 30180 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.451673 30180 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:17.453450 30002 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:17.454653  2195 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:17.455240  2195 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.456215  2195 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:17.403478 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 57147.8us
I20260709 13:13:17.409554 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:17.394102 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:17.464581 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.465826 30031 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:17.474421 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:17.475353 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:17.478509 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:17.478983 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:17.479672 30107 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:17.405287  2212 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.408174  2331 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.486474 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:17.509301 30185 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 8.
I20260709 13:13:17.496454  2212 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.494501  1900 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:17.519461 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 160990us
I20260709 13:13:17.520437 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:17.524821 30032 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:17.525236 30032 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.506146  2331 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:17.507622  2135 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:17.552088 30077 leader_election.cc:400] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11.
I20260709 13:13:17.550325 30032 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.555441 30032 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.562516  2212 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.504163  2295 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:13:17.535002  2270 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:17.572417  2270 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:17.573385  2270 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.527381  1900 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.576013  1900 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.577759  2292 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.565269 30032 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:17.602923 30187 raft_consensus.cc:1240] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:17.604997  2343 consensus_queue.cc:1059] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:17.605850  2189 raft_consensus.cc:3055] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:17.606215  2189 raft_consensus.cc:740] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:17.607043  2189 consensus_queue.cc:260] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.608363  2329 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:17.570303  2337 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:13:17.614817  2130 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:13:17.647478 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 95950.4us
I20260709 13:13:17.650334 30037 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:17.661685 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:17.662689 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 141156us
I20260709 13:13:17.665740 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:17.674857 30001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.681579  2269 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:17.806948 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48120.5us
I20260709 13:13:17.882948 30031 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:17.917178  2212 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:17.921458 30110 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:17.738042  2269 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.925062 30107 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:13:17.912464  2344 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:13:17.935686 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:17.925448 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 190219us
I20260709 13:13:17.934293  2158 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:17.978510  2158 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:17.979688  2189 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.980947  2158 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:17.989692 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:17.990506 30113 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.994220 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:17.996249  2347 log.cc:927] Time spent T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:13:18.003000 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.002224  2329 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:18.018333  2269 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:17.993155  1900 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.022877 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:17.819617 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.039996  2291 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.040622  2291 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.022176  2331 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.064400 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:18.065526  2291 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:18.066002  2331 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:18.065868  2260 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:18.072863  2260 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.075976  2260 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:18.079041 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:18.083809  1900 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:18.089857 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:18.090689 30107 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:13:18.089241 30077 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.129:39437 timed out after 1.668s (SENT) [suppressed 7 similar messages]
I20260709 13:13:18.091833 30113 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:18.104156 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:18.104842 30184 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.107852 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:18.108601 30185 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 14.
I20260709 13:13:18.114528 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.124846 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:18.130200 30184 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:18.132469  2292 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:18.150496 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:18.156468 30107 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:18.157204 30185 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:18.132776  2270 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:18.161041  2270 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:18.162012  2270 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.173851 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.173971  2135 consensus_queue.cc:1059] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:18.174954  2135 consensus_queue.cc:1243] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:18.175555  2135 raft_consensus.cc:3055] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:18.176028  2135 raft_consensus.cc:740] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:18.178385 30031 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:18.183548 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:18.187502 30032 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:18.196026 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.196810 30032 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:18.197578 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:18.198180 30036 raft_consensus.cc:2376] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11. Re-sending same reply.
I20260709 13:13:18.186040  2189 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:18.200961 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.201664 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:18.202246 30185 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:18.203567 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:18.177060  2135 consensus_queue.cc:260] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.207506  2135 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:18.224169 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.227021 30184 raft_consensus.cc:1240] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:18.227943 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:18.229645 30179 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:13:18.233595 30076 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.230518 30031 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:18.237210  2335 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:18.240564  2335 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:18.241680 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 150) took 6285 ms. Trace:
I20260709 13:13:18.241582  2335 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.244247 30109 raft_consensus.cc:2410] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:13:18.242107 29931 rpcz_store.cc:276] 0709 13:13:11.956697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.956857 (+   160us) service_pool.cc:224] Handling call
0709 13:13:18.241591 (+6284734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:15.389765 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:15.390360 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:15.390395 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:13:15.390418 (+    23us) tablet.cc:662] Decoding operations
0709 13:13:15.391950 (+  1532us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:15.392011 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:15.392038 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:13:15.432155 (+ 40117us) tablet.cc:701] Row locks acquired
0709 13:13:15.432176 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:13:15.473703 (+ 41527us) write_op.cc:270] Start()
0709 13:13:15.488322 (+ 14619us) write_op.cc:276] Timestamp: P: 1783602795470267 usec, L: 0
0709 13:13:15.488364 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:13:15.524030 (+ 35666us) log.cc:844] Serialized 7616 byte log entry
0709 13:13:15.619380 (+ 95350us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe2fc90ac 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe5c02 00007fcbe5c6d20b
0709 13:13:16.081571 (+462191us) op_driver.cc:464] REPLICATION: finished
0709 13:13:16.383578 (+302007us) write_op.cc:301] APPLY: starting
0709 13:13:16.383682 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:16.630008 (+246326us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:16.630046 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:16.723180 (+ 93134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:16.723510 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:13:16.723558 (+    48us) write_op.cc:312] APPLY: finished
0709 13:13:16.811614 (+ 88056us) log.cc:844] Serialized 172 byte log entry
0709 13:13:16.811814 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:16.812003 (+   189us) write_op.cc:454] Released schema lock
0709 13:13:16.812057 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:16.812600 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:16.812646 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1425758,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":256940,"apply.run_cpu_time_us":30768,"apply.run_wall_time_us":429022,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83433,"num_ops":19,"prepare.queue_time_us":129517,"prepare.run_cpu_time_us":20063,"prepare.run_wall_time_us":338298,"raft.queue_time_us":289701,"raft.run_cpu_time_us":26151,"raft.run_wall_time_us":150687,"replication_time_us":588956,"spinlock_wait_cycles":19392256,"thread_start_us":568196,"threads_started":4,"wal-append.queue_time_us":244166,"wal-append.run_cpu_time_us":23944,"wal-append.run_wall_time_us":2042026}]]}
I20260709 13:13:18.247805 30187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:13:18.254771 30187 raft_consensus.cc:606] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.246930 29933 catalog_manager.cc:5697] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 9, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
W20260709 13:13:18.250792 29923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d2f11cccca04a7683da4080ab797bd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:18.257751 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:18.258267 30036 raft_consensus.cc:1275] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:18.232107 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:18.253998 30107 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:13:18.259675 30107 pending_rounds.cc:85] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:13:18.259943 30107 pending_rounds.cc:107] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:13:18.260190 30107 raft_consensus.cc:2889] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:18.258553 29933 catalog_manager.cc:5697] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.263945 29933 catalog_manager.cc:5697] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.258405 30029 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:18.268519 30001 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:18.263258 30179 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:18.266937 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.270015  2290 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:18.273105  2331 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:18.273267  2290 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:18.273797  2331 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:18.274328  2290 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.274729  2331 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.227098  2291 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:18.230261  2295 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:13:18.282258  2295 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:18.282648  2295 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:18.283478  2295 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.284884  2295 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.267700  2215 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:18.287426  2215 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.289512  2183 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:18.299780  2258 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:18.299696 30185 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 9.
I20260709 13:13:18.306239 30179 raft_consensus.cc:1275] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:18.311270 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:18.312165 30187 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:18.313938  1900 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:18.316377 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.317179 30036 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:18.301331  2260 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:18.319101  1900 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:18.319135  2260 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:18.321369  2260 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.266709 29933 catalog_manager.cc:5697] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 9, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 9 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.325857 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.325101 29933 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 9 to 12, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.328734 30737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:18.330152 30737 raft_consensus.cc:606] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.327762 29933 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.335453 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.337093 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.336251 29933 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 10 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:18.347854 30029 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
W20260709 13:13:18.350021 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.352072 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:18.356149  1578 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:18.369668  2259 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:18.302006  2212 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:13:18.340611  2354 consensus_queue.cc:1048] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:13:18.340553  2305 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:18.340852  2215 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:18.380093  1609 raft_consensus.cc:993] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:18.380739  1609 raft_consensus.cc:1081] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:18.381102  2259 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:18.382254  2259 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.353605 29933 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.347559  2306 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:18.400226 30112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:13:18.400947 30112 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.401472 30112 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.388942 29933 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 9, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.404029 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:18.415534 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.446489 30187 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 14: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:18.427680 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:18.436398 30112 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.448490 29933 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.414456  2189 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.458703 29933 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.457307  2310 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:18.462930  2310 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:18.462239 29933 catalog_manager.cc:5697] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.470747 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:18.471717 30035 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.474217 30112 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:18.475796 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82bd288ed43e47fbabdbcfbfaca06dfb"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:18.476451 30739 raft_consensus.cc:606] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.478870 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:18.479517 30187 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:18.479817 30187 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:18.417368  2270 consensus_queue.cc:1048] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:13:18.457665  2212 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:18.503373  2212 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:18.463428  2310 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.417143  2135 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:13:18.513855  2361 log.cc:927] Time spent T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:13:18.516666  2362 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:18.529856  1609 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.530478  1609 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.532912  1609 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:18.492895  2260 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.467335 29933 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.539865 29933 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.534196 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:18.536346 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:18.544660 29933 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.469836  2189 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.558528 29933 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.570330 29933 catalog_manager.cc:5697] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.570784 30032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:18.571979 30032 raft_consensus.cc:606] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.572320 30032 raft_consensus.cc:614] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:18.571710 29933 catalog_manager.cc:5697] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 5 to 10, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.564921 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.482178 30187 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.575033 29933 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.579408 30179 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:18.580379 29933 catalog_manager.cc:5697] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 9, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 9 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.582525 29933 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.595863 30035 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:18.597663 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:18.588003 29933 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 10 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.610610 29933 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 6 to 9, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:18.608259  2334 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:18.504937  2212 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.607299  2270 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:13:18.654676 30035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:18.629535  2295 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:18.657464 30035 raft_consensus.cc:606] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:18.663582 30035 raft_consensus.cc:614] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:18.629518  2259 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.648934  2334 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:18.668730  2295 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.670329  2259 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:18.953472  2365 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
W20260709 13:13:19.218710 30184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.029s	sys 0.034s
I20260709 13:13:19.256067  2189 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:19.258083 29923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d2f11cccca04a7683da4080ab797bd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:19.356487 29923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 98453.3us
W20260709 13:13:19.357751  2369 log.cc:927] Time spent T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:13:19.264817  2310 consensus_meta.cc:287] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.007s
I20260709 13:13:18.708544  2353 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:19.266501  2338 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.950481  2334 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:18.899667  2260 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:19.294119 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 579688us
I20260709 13:13:19.301482 30187 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.315490  1578 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:19.423533  1578 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.317610 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:19.427126 30180 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:19.319025  2159 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.326938 30184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.029s	sys 0.034s
I20260709 13:13:19.445914  1578 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:19.398391  2353 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:19.382349  2310 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.490206  2259 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:19.405957  2338 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.448907  2159 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.502450 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1975) took 1103 ms. Trace:
I20260709 13:13:19.504846 30108 rpcz_store.cc:276] 0709 13:13:18.399335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.399447 (+   112us) service_pool.cc:224] Handling call
0709 13:13:18.418544 (+ 19097us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faeeee 0000000000375939 00007fcbeb0221e0 00007fcbeb0eb0c4 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:13:18.418695 (+   151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.442003 (+ 23308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.442050 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.458014 (+ 15964us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.708521 (+250507us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:18.708566 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.708645 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.498405 (+789760us) raft_consensus.cc:1685] finished
0709 13:13:19.498435 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.502361 (+  3926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22839,"raft.queue_time_us":23669,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5424,"spinlock_wait_cycles":2346112,"thread_start_us":162785,"threads_started":1,"wal-append.queue_time_us":799463}
I20260709 13:13:19.512279 30187 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:19.539494 30187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33122 (request call id 2255) took 1065 ms. Trace:
I20260709 13:13:19.514386  2311 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.516129  2312 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:19.528048 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 212012us
I20260709 13:13:19.529258  2295 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.529841  2310 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.532579 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:19.524577  2335 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.522398 30032 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:19.551806 30107 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:19.560155 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:19.544384 30187 rpcz_store.cc:276] 0709 13:13:18.474456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.474672 (+   216us) service_pool.cc:224] Handling call
0709 13:13:19.300730 (+826058us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b580075b9d0. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe602f0aa 00007fcbe60b1447 00007fcbe60c9fe7 00007fcbe60cb7de 00007fcbe60d727c 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c
0709 13:13:19.539433 (+238703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743895424}
I20260709 13:13:19.553438  2295 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.565104  2295 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.516245  2353 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.577551  2353 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:19.578934  2295 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.553581  2159 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:19.582221 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:19.583155 30183 raft_consensus.cc:2393] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 14: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:19.567801 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:19.574208 30179 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.553601  2291 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:19.586207 30187 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:19.584736 30108 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:19.600963 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:19.602242 30181 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:19.550702  2311 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.561271  2310 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.552089  2312 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.600611  2159 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:19.616410  2378 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.609225 30002 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:19.620137 30108 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:13:19.582967  2343 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:19.627355 30108 pending_rounds.cc:85] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 7
I20260709 13:13:19.627697 30108 pending_rounds.cc:107] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:13:19.627961 30108 raft_consensus.cc:2889] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.629294 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:19.557052  2335 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.630878 30033 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:19.632269 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:19.633181 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:19.636394 30108 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:19.633344  2159 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:19.635324 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:19.634735  2189 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:19.641996  2370 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.368s	user 0.005s	sys 0.000s
I20260709 13:13:19.633749  2343 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:19.661805 30179 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:19.662949 30029 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:19.621106  2291 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.638186  2338 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.686415 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:19.686637 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:19.622639  2310 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.703426 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:19.704979 30034 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:19.658809  2189 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.644876  2378 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.710337  2189 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:19.806221  2370 log.cc:927] Time spent T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:19.897187 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 325439us
W20260709 13:13:19.898370 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 343748us
I20260709 13:13:19.687915  2385 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:19.920444 30184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2256) took 1392 ms. Trace:
W20260709 13:13:19.931833 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 240596us
I20260709 13:13:19.959824  2396 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:19.960597  2396 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.909261  2381 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.962334  2291 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.962872  2396 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.962997  2291 raft_consensus.cc:493] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:19.963590  2396 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.922164  2377 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:19.964128  2396 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:19.964618  2377 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:19.939013 30184 rpcz_store.cc:276] 0709 13:13:18.511351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.511517 (+   166us) service_pool.cc:224] Handling call
0709 13:13:18.511848 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.512235 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.512265 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.555786 (+ 43521us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b2c00111558. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe49cca11 00007fcbe49dc372 00007fcbe610ea01 00007fcbe60d343a 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2
0709 13:13:18.556230 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.660110 (+103880us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:19.434679 (+774569us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.434976 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.435077 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:19.630505 (+195428us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b24000ee9b8. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2e6c9c4 00007fcbe2e6aacb 00007fcbe3025dc9 00007fcbe3025a55 00007fcbe302509d 00007fcbe5c5710e 00007fcbe5c6e88c 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221
0709 13:13:19.721166 (+ 90661us) raft_consensus.cc:1685] finished
0709 13:13:19.721190 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:19.903490 (+182300us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":785422,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":464,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":3749,"spinlock_wait_cycles":188617344,"thread_start_us":877595,"threads_started":2,"wal-append.queue_time_us":717823}
I20260709 13:13:19.974309 30029 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:20.025579 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54802us
W20260709 13:13:20.039873 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 106719us
I20260709 13:13:20.041911 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:19.934569  2124 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:19.962369  2312 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:19.974954  2282 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
W20260709 13:13:20.078991 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 155014us
I20260709 13:13:20.059878  2343 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:19.963685  2291 raft_consensus.cc:515] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.059391  2334 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.962838  2381 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.073163  2238 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.086386  2391 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:19.973891  2385 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.095700  2388 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.092249  2312 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.101298  2311 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.119534  2379 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.122293  2377 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.127370  2343 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:20.132562  2310 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.088476  2282 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.084657  2124 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.133033  2354 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:20.141211  2391 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.173606  2388 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.187788  2396 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.173182  2312 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.224349  2312 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.139348  2238 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.227269  2238 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.134433  2334 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.218633  2354 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.230433  2334 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.231840  2381 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.232622  2354 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.236249  2124 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.181466  2379 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.239300  2282 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.239836  2407 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.207003  2399 raft_consensus.cc:493] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:20.240450  2407 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.185830  2343 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.243235  2407 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.203480  2159 leader_election.cc:290] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.245030  2414 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:20.245707  2414 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.248162  2414 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.248394  2335 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.264285  2388 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.264590 30032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54300 (request call id 2242) took 1612 ms. Trace:
I20260709 13:13:20.194667  2411 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:20.265192 30032 rpcz_store.cc:276] 0709 13:13:18.652099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.652390 (+   291us) service_pool.cc:224] Handling call
0709 13:13:18.652673 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.552159 (+899486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.264126 (+711967us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b540020c1d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:20.264440 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999692032}
I20260709 13:13:20.266201  2411 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.266728  2411 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:20.269492 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 49297.8us
W20260709 13:13:20.198946  2403 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:20.240505  2399 raft_consensus.cc:515] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.243345  2343 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.322382 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:20.194857  2310 raft_consensus.cc:493] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
W20260709 13:13:20.326109 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 299235us
W20260709 13:13:20.208037  2353 consensus_meta.cc:287] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.630s	user 0.019s	sys 0.000s
I20260709 13:13:20.216812  2306 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.200349  2291 leader_election.cc:290] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.210464  2404 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.290201  2215 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:20.303666 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 203027us
I20260709 13:13:20.206768  2398 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.208739  2378 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.339852 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:20.332868 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 365456us
I20260709 13:13:20.239300  2379 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.332820  2259 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.362038 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.363083 30032 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:20.360809 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.353317 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:20.359776 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.368892 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.369140 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.370584 30031 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:20.379805 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.331089  2310 raft_consensus.cc:515] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.388159 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.490751 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.491441 30740 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:20.481470  2417 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.481725  2378 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.341918  2404 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.482952  2391 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.484748  2399 leader_election.cc:290] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.358155  2259 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.485713  2354 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:20.345711  2398 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.342737  2215 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.490514  2159 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.489068  2189 consensus_meta.cc:287] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
I20260709 13:13:20.489147 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.492460  2291 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.376346  2385 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.333940  2306 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.350687  2423 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:20.502756 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.503407 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.504810 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.484740  2411 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.514678  2259 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.533569  2404 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.509814  2378 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.536535  2378 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.523504  2291 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.538775  2310 leader_election.cc:290] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.531553  2159 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.540138  2291 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.525871  2423 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.541749  2159 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.543208  2423 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.545348  2411 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.506699  2417 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:20.526829  2373 log.cc:927] Time spent T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 1.009s	user 0.002s	sys 0.008s
I20260709 13:13:20.549484 30178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33122 (request call id 2258) took 1970 ms. Trace:
I20260709 13:13:20.506443  2415 raft_consensus.cc:493] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.550647 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.550854  2415 raft_consensus.cc:515] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.549999 30178 rpcz_store.cc:276] 0709 13:13:18.579078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.579779 (+   701us) service_pool.cc:224] Handling call
0709 13:13:18.580101 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.590515 (+ 10414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.590563 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.591164 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.863192 (+272028us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:18.863264 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.863403 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.526175 (+1662772us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:13:20.549043 (+ 22868us) raft_consensus.cc:1685] finished
0709 13:13:20.549070 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.549383 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1381,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":3023232,"thread_start_us":231955,"threads_started":1,"wal-append.queue_time_us":869878}
I20260709 13:13:20.528290  2215 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.527287 30185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33134 (request call id 2729) took 2140 ms. Trace:
I20260709 13:13:20.555545  2306 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.556743  2417 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:20.555514 30185 rpcz_store.cc:276] 0709 13:13:18.386685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.386839 (+   154us) service_pool.cc:224] Handling call
0709 13:13:18.387211 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.387634 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.387665 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.388161 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:13:18.659597 (+271436us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:18.659660 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:18.659758 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.521349 (+1861591us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b24000ee9b8. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2e6c9c4 00007fcbe2e6aacb 00007fcbe3025dc9 00007fcbe3025a55 00007fcbe3024fb0 00007fcbe5c9b488 00007fcbe5c9bbe8 00007fcbe5c73398 00007fcbe5c6e76a 00007fcbe5c6dbb6
0709 13:13:20.526898 (+  5549us) raft_consensus.cc:1685] finished
0709 13:13:20.526923 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.527194 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":950,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":49911680,"thread_start_us":264767,"threads_started":1,"wal-append.queue_time_us":436504}
I20260709 13:13:20.517692  2420 raft_consensus.cc:993] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:20.547721  2398 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.553577  2415 leader_election.cc:290] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.505246  2379 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.554111  2189 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.565680  2379 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.572000  2379 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.575567  2420 raft_consensus.cc:1081] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:20.568962  2189 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.596195  2259 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.600006  2259 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:20.635078 29923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d2f11cccca04a7683da4080ab797bd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:20.529342 30037 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 14.
I20260709 13:13:20.644100 30035 raft_consensus.cc:2368] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:20.657887 30107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50320 (request call id 1985) took 1088 ms. Trace:
I20260709 13:13:20.658614 30107 rpcz_store.cc:276] 0709 13:13:19.568931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.569065 (+   134us) service_pool.cc:224] Handling call
0709 13:13:19.569352 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.631958 (+ 62606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.632019 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.632076 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:19.632121 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.656929 (+1024808us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b5400396f54. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:20.657022 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.657540 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143400832}
W20260709 13:13:20.653308 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 1.04133e+06us
I20260709 13:13:20.663805 30035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54300 (request call id 2245) took 1035 ms. Trace:
I20260709 13:13:20.663998 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:20.664367 30035 rpcz_store.cc:276] 0709 13:13:19.628535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.628656 (+   121us) service_pool.cc:224] Handling call
0709 13:13:20.663437 (+1034781us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540010e0d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:20.663706 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322887040}
I20260709 13:13:20.665248 30036 raft_consensus.cc:606] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:20.666235 30036 raft_consensus.cc:614] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:20.677574 30179 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:13:20.678269 30179 pending_rounds.cc:85] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Aborting all ops after (but not including) 6
I20260709 13:13:20.678563 30179 pending_rounds.cc:107] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:13:20.678884 30179 raft_consensus.cc:2889] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.682471 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.684705 30186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50696 (request call id 967) took 1118 ms. Trace:
I20260709 13:13:20.685020 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.682952 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.689345 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.689678 30104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36342 (request call id 1210) took 1149 ms. Trace:
I20260709 13:13:20.690400 30104 rpcz_store.cc:276] 0709 13:13:19.540121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.542760 (+  2639us) service_pool.cc:224] Handling call
0709 13:13:20.030680 (+487920us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800060398. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:13:20.030999 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.183185 (+152186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.183237 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:20.183300 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:20.183347 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.688961 (+505614us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540022e554. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:20.689059 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.689417 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353517696}
I20260709 13:13:20.694070 30112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50304 (request call id 2636) took 1074 ms. Trace:
I20260709 13:13:20.694815 30112 rpcz_store.cc:276] 0709 13:13:19.619976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.620108 (+   132us) service_pool.cc:224] Handling call
0709 13:13:19.620499 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.711175 (+ 90676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.711203 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.711239 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:19.711267 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.693330 (+982063us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b54000465d4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d3e01 00007fcbe60d283e 00007fcbeb097419 00007fcbe460ebd4 00007fcbe460eb62 00007fcbe460ea91 00007fcbe460ea0c 00007fcbe460dcc2 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:20.693451 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.693796 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208149248}
I20260709 13:13:20.697860  1609 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.698287 30108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50304 (request call id 2638) took 1065 ms. Trace:
I20260709 13:13:20.699229 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.698824  1609 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.698757 30108 rpcz_store.cc:276] 0709 13:13:19.632797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.632940 (+   143us) service_pool.cc:224] Handling call
0709 13:13:20.697779 (+1064839us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5400131fd4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603c571 00007fcbe60d72fa 00007fcbeb098b17 00007fcbe46136d4 00007fcbe4613662 00007fcbe4613591 00007fcbe461350c 00007fcbe46127c2 00007fcbe440e48c 00007fcbe440d8c6 00007fcbe440d26f
0709 13:13:20.698043 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4062976}
I20260709 13:13:20.700459 30185 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 14.
I20260709 13:13:20.703187  1609 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.706171  1609 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.707415  1609 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.708082 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.712870  1900 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.713548  1900 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.716333  1900 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.716961  1900 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.717594  1900 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.685271 30186 rpcz_store.cc:276] 0709 13:13:19.565680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.569737 (+  4057us) service_pool.cc:224] Handling call
0709 13:13:20.683079 (+1113342us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800003f98. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faea22 00007fcbebec7c09 00007fcbeb021ee0 00007fcbeb0eb0ab 00007fcbeb0eb131 00007fcbeb0acfc0 00007fcbeb097929 00007fcbeb0973d2 00007fcbe460ebd4
0709 13:13:20.683453 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.683942 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.683971 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:20.684073 (+   102us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:20.684104 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.684165 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.684386 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4503424}
I20260709 13:13:20.720129  1900 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.712893 30151 leader_election.cc:304] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:13:20.698769 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.725737 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.727099 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.727595 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.731283  2158 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.732131  2158 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.732909 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.736546  2189 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.737490  2189 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.738210  2158 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.740288  2158 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:20.741047  2189 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.742992 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.743712 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.745013 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.746129 30187 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:20.756202 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.755266 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.759688  2291 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.760102  2383 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.760637  2291 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.760905  2383 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.761726 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:20.762701 30108 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:20.761922 30035 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:20.763533  2383 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.763682 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:20.767140 30032 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:20.767256  2310 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:20.767925 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.768406  2385 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:20.770035 30038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.791404 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:20.773325 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:20.792156 30034 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:20.792744 30035 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.794416 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.782327  1609 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.763616  2291 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.799505  2404 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:20.800348  2404 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:20.802626  2376 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 1.144s	user 0.015s	sys 0.023s
I20260709 13:13:20.805447 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:20.807403  2404 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.810168  2400 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:20.811183  2400 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:20.812837 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.812292  2415 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:20.813753 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.819849 30187 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:20.821352 30179 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:20.822903 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.824960 30035 raft_consensus.cc:2468] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 15.
I20260709 13:13:20.825947  2400 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:20.793179 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:20.854737 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 74883.3us
I20260709 13:13:20.856979 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:20.867223 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.870309 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.870656 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.864136 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:20.914597 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.919143 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:20.921865  2312 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:20.922493  2312 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:20.922964  2312 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:20.924868 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50537.4us
I20260709 13:13:20.910676 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.925840 30151 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:20.913206 30104 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.927897 30104 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:20.921192 30077 leader_election.cc:400] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:20.928789 30077 leader_election.cc:403] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:20.931330 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.933508 30187 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:20.934589  2270 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:20.935050  2270 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:20.935410  2270 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:20.937072 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:20.938153 30185 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:20.937938 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.939268 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.940011 30181 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:20.945536  2389 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:20.946450  2389 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.937934 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.950376 30178 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:20.952119  2404 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.953481 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.957880 30705 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:20.959940 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.963676  2379 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.964134 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.964447  2379 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:20.967161  2379 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:20.969822  2419 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.971259 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.971742 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:20.972844 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:20.973326  2378 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:20.974313 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.975031  2419 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.975462  2419 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:20.975905  2419 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:20.976251 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50548.8us
I20260709 13:13:20.982528  2387 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:20.982779 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:20.984988 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.989758 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:20.986366 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.985417 30151 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:20.995244 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.986812 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.993554 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.997545 30186 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:20.992653 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.000407 30151 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:21.001613  2411 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:21.002013  2411 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.996011  2387 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.986219 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.011495 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:20.980662  2389 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.004434  2411 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:21.006044  2387 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:21.015663 30187 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:21.019537 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814415efcb8c4963a2b88aafeeaa75bb" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.026674 30104 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.029367  2295 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.031273 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 59670.2us
I20260709 13:13:21.031533  2295 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.035674 30104 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.036943 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:21.037636 30737 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:21.037982 30737 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:21.038893 30737 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.040633 30737 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:21.050228  2295 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.027747  2387 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.053067 30737 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:21.057775 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.059564  2295 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:21.061520  2295 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.064365  2295 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.067862 30079 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:21.069463  2295 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:21.070454  2295 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:21.071648  2426 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:21.072467  2426 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.073573 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.074272 30178 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:21.075258  2426 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.071632  2295 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.083002 30151 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:21.085330 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.087659  2383 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.088390  2383 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.091503  2383 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.109926 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:21.111744 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 90001us
I20260709 13:13:21.028692  2312 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.119853 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.120617 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.121889 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.123740 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.125068  2383 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:21.131237  2383 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.131767 30032 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:21.127574 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.133904  2426 raft_consensus.cc:2804] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:21.134542  2426 raft_consensus.cc:697] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:21.099393  2270 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.135536  2426 consensus_queue.cc:237] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.137532  2270 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.140239  2312 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.140681  2383 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.150754 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:21.151810  2423 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:21.152215  2423 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.152551  2423 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:21.165791  2371 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:21.166556  2371 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.168924  2371 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.168978  2404 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13.
I20260709 13:13:21.171069 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.181743 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.188055 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.191323 30031 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:21.192915 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:21.219125 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:21.220827 30034 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:21.217118 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.228531 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:21.229596  2427 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:21.229873  2312 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:21.230027  2427 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:21.230525  2427 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:21.235239  2215 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:21.235952  2215 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.230548  2312 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.240006  2312 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.241598  2387 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.256575  2215 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.262295  2426 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:21.263020  2426 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.265360  2426 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.275285 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:21.279743  2411 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.282431  2411 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:21.297567 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:21.299947 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:21.300034  2419 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.303719 30737 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:21.306689  2423 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.310760  2215 consensus_queue.cc:1059] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:21.312148  2387 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.330365 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.335705  2387 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:21.337096  2415 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:21.337970  2415 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.340399  2415 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.341554 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:21.308920  2438 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:21.346158 30032 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:21.356011 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:21.367671 30153 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:21.377350  2124 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:21.377553 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.380262 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.370988  2415 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:21.348030  2295 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:21.377187  2411 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:21.388345 30104 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:21.396268  2295 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:21.360877  2189 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:13:21.308910  2427 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.418848 30108 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:13:21.419334 30108 pending_rounds.cc:85] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 5
I20260709 13:13:21.421121 30108 pending_rounds.cc:107] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:13:21.421371 30108 raft_consensus.cc:2889] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.425606 30740 raft_consensus.cc:1240] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:21.433804 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.438154  2394 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:21.438962  2394 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.424258  2295 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.445698 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.449491 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:21.450551 30108 raft_consensus.cc:2393] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 13: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:21.445182  2394 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.462319 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.419078  2415 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.462178  2423 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:21.471850 30105 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 7.
I20260709 13:13:21.477713 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.478392  2404 raft_consensus.cc:3055] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:21.478834  2404 raft_consensus.cc:740] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:21.485909 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.488065 30179 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:21.490311 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.491731 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.496244  2295 consensus_queue.cc:1059] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:13:21.499151 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.500101 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7398efc3342427c8ca63da3a989684d" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.501753  2295 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:21.502699  2295 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:21.504045  2295 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.505646 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.507078 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.508419 30105 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:21.479849  2404 consensus_queue.cc:260] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:21.509246 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.510170 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.507001  2295 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:21.614919  2440 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:13:21.622220 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:21.620476 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.622277  2419 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:21.642649  2439 log.cc:927] Time spent T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:13:21.644255 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 189374us
I20260709 13:13:21.645704  2394 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:21.652263  2389 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:21.654960  2415 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:21.659494 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:21.661057 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:21.682139 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.683630 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.689656  2389 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:21.691293  2389 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:21.692003  2389 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:21.693707 30002 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:21.694881 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:21.695071 30113 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:21.651407  2427 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:21.648882  2404 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.720978 30032 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:21.651353 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.731621 30105 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:21.735908 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:21.738751 30187 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 15: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:21.740774 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.756916  2387 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:21.762269 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.764159 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:21.765321 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.780072 30108 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:21.769583 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.730938  2379 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:21.768222 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:21.779330 30109 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:21.791252  2379 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.824891 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.829743 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:21.830557 30187 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:21.835101 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.804754  2378 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:21.843801 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 112095us
I20260709 13:13:21.845350 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:21.820271  2379 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:21.852286 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.852994 30185 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:21.867946  2189 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:21.868474  2189 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:21.868856  2189 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:21.872958 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:21.873937 30178 raft_consensus.cc:2368] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:13:21.884708 30108 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
W20260709 13:13:21.886945  2367 log.cc:927] Time spent T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:13:21.887212 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:21.900173 30187 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:21.913853 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:21.917876  2378 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:21.918536  2378 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.918938  2378 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.923070 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.928035 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.929986 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.933833 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.935753 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:21.937983  2394 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:21.942637  2389 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:21.944859  2423 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:21.943890 30001 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.947665  2423 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:21.949003  2443 log.cc:927] Time spent T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:13:21.952001 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:21.955112 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.962190 30187 raft_consensus.cc:1240] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:21.962785  2423 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:21.927228 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.967723 30112 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 15.
I20260709 13:13:21.963828  2389 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:21.972002 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:21.979084 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.974988  2389 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:21.980688  2389 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:21.983242 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.984225  2404 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:21.985649 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.986404  2404 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:21.988132 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.991271  2404 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:21.992902 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:21.993887  2404 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:21.993918 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 145414us
I20260709 13:13:21.995795 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:22.010062 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 82898.6us
W20260709 13:13:22.018463 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46598.5us
I20260709 13:13:22.002944  2404 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:22.019836 30001 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.022449 30704 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:22.012094  2394 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:22.012569  2423 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:22.043138 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:22.030833  2404 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:22.038018 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:22.055223  2454 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:22.012300  2189 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.058995 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:22.040952  2346 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:22.038010  2394 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:22.065553  2394 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:22.060015 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44001.6us
I20260709 13:13:22.069900 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.072630 30077 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.074417  2215 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:22.083878 29931 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 14 to 16, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 16 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:22.085512  2414 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:22.086133  2379 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.086258  2414 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.048426 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:22.092577 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.089900 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.112915 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.113344 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:22.113685 30181 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:22.114166 30033 raft_consensus.cc:2368] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:13:22.057859  2404 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:22.116400 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:22.087015 29931 catalog_manager.cc:5697] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 12, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 12 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.118377 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.119505 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.125972 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.062963  2295 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:22.076999  2215 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:13:22.132117 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.131726 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.129611 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.130600 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.135025  2295 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.138648 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.138986  2295 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:22.144550 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.146188  2352 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:22.119576  2414 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:22.116540  2346 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:22.127421  2415 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:22.186776 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 114222us
I20260709 13:13:22.190174 30077 leader_election.cc:400] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:13:22.190711 30077 leader_election.cc:403] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:13:22.186851 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 118983us
I20260709 13:13:22.208695 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:22.220256 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
W20260709 13:13:22.230947 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 211409us
I20260709 13:13:22.220530  2415 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:22.244094  2415 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.244552  2415 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:22.187984  2378 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.252041  2378 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.252864 30001 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.253906  2378 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:22.254534  2378 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:22.255748  2378 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.257638  2394 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.211508  2389 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.259938  2394 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.261493  2389 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.262696 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.264894  2389 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:22.265369  2389 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:22.265684 30031 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:22.265847  2389 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:22.241698  2346 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:22.243552  2189 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.218813  2215 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297) with higher term. Message: Invalid argument: T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:13:22.276439  2295 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.284415 30029 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:22.294919  2389 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.297468  2389 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:22.298556 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 89978us
I20260709 13:13:22.228217  2379 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.307478  2411 consensus_queue.cc:1059] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:22.308647  2411 raft_consensus.cc:3055] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:22.309070  2411 raft_consensus.cc:740] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:22.309993  2411 consensus_queue.cc:260] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.311724  2411 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:22.317468 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.326639 30029 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:22.332280 30077 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.339160  2124 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:22.339306  2159 consensus_queue.cc:1059] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:22.339927  2124 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:22.349596  2124 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.350768 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.352473 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.352566 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.354089 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.369000 30179 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:22.372301  2465 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:22.383883 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.386261 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:22.389593 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.304459  2446 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:13:22.394068 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.396021 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.397586 30108 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 15: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:22.397923 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.398581 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.400966 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.402756 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.403887 30105 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:22.412648 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.412711 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.415957 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.416868 30108 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:22.415828 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.416932 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:22.417860 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.426589 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.441489 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:22.441277 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 57047.8us
I20260709 13:13:22.454689 30112 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:22.456416 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:22.441111  2295 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.461992 30111 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:13:22.444443 29923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d2f11cccca04a7683da4080ab797bd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:22.479828 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:22.486425 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:22.487303 30112 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 15: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:22.491684 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.493016 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.585791 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:22.592217 30110 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
W20260709 13:13:22.607275 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 214785us
I20260709 13:13:22.505477  2446 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:22.609575 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 127348us
I20260709 13:13:22.615634 30112 raft_consensus.cc:1240] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:22.620904 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:22.623194 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.623776 30079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.623649 30112 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:22.628099 30112 raft_consensus.cc:3055] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:22.628538 30112 raft_consensus.cc:740] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:22.621423 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 117186us
I20260709 13:13:22.629653 30112 consensus_queue.cc:260] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.634244 30112 raft_consensus.cc:3060] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:22.611775  2379 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:22.650811 30077 leader_election.cc:304] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.621423  2446 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:22.664041 30112 raft_consensus.cc:1275] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:13:22.664554 30112 pending_rounds.cc:85] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 8
I20260709 13:13:22.664783 30112 pending_rounds.cc:107] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:13:22.665035 30112 raft_consensus.cc:2889] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:22.677816  2483 raft_consensus.cc:2749] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:22.698686 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 63289.8us
W20260709 13:13:22.701607 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50893.1us
I20260709 13:13:22.704388 30077 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.705523 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42209a176ad44af88b5b1710846183cb" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:22.650313  2379 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:22.703168  2378 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:22.711982  2379 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:22.712101  2378 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:22.713325  2446 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:22.714241 30031 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:22.714583  2378 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:22.724073 30179 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:22.723662 30032 raft_consensus.cc:1240] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:22.730298 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:22.732038 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.736035 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:22.738669  2446 consensus_queue.cc:1059] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:13:22.740000 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 83328.8us
I20260709 13:13:22.723662  2483 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:22.743911 30077 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:22.748908  2415 consensus_meta.cc:287] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
W20260709 13:13:22.793377 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 47855.4us
I20260709 13:13:22.743368  2490 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:22.795158 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 58003.1us
W20260709 13:13:22.798003 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 56629.5us
I20260709 13:13:22.798789 30077 leader_election.cc:304] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.743290  2414 consensus_queue.cc:1059] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:13:22.814548  2295 raft_consensus.cc:2749] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:22.791226  2483 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:22.767158  2415 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:22.840648  2411 consensus_meta.cc:287] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: Time spent flushing consensus metadata: real 0.528s	user 0.015s	sys 0.000s
I20260709 13:13:22.840943 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.842535 30077 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:13:22.864451  2404 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.001s
I20260709 13:13:22.881579 30107 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:22.855192  2490 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:22.889819 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:22.890975 30732 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 15: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
W20260709 13:13:22.883855 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 86744.8us
W20260709 13:13:22.893206 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.872444  2483 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:22.884279  2404 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.900401 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:22.902995  2404 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:22.908058  2426 raft_consensus.cc:3055] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:22.908625  2426 raft_consensus.cc:740] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:22.909785  2426 consensus_queue.cc:260] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:22.915694  2426 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:22.917623 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 75211.6us
I20260709 13:13:22.920518 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:22.926218 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 122389us
I20260709 13:13:22.919662 30112 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:22.935498  2489 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:22.935236  2483 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:22.947293 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.937776  2124 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:13:22.951114 30077 leader_election.cc:400] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Vote denied by peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437) with higher term. Message: Invalid argument: T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12.
I20260709 13:13:22.952024 30077 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.959038 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.975085 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:22.976045 30183 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 15: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:22.946019  2489 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:22.949779  2404 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:22.986447 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:22.965029  2415 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:23.026335 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 60190.2us
W20260709 13:13:23.103408 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 118006us
I20260709 13:13:22.955740  2490 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:13:22.981657  2493 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.111544 30077 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:23.110903  2215 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:23.104854 30150 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.62.130:38581 timed out after 1.918s (SENT) [suppressed 9 similar messages]
I20260709 13:13:23.118108 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.104586  2483 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.119635  1578 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:23.120347  1578 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.123962  2415 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:23.181126 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 68665.5us
I20260709 13:13:23.182121  2472 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.120343  2390 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:23.183633  2390 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:23.184830  2390 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.208217  2390 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.186121  2501 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.182164 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64108.3us
I20260709 13:13:23.211779  2501 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:23.212245 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.214027 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.214943  2501 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:23.215530 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.216675  2493 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:23.217370  2493 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.217788  1578 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:23.218302  2493 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:23.223316 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:23.226470 30153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.268035 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:23.268740 30186 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:23.273823 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.273743  2426 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:23.290885  2426 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:23.298630 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 182199us
I20260709 13:13:23.302507 30106 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:13:23.283865  2457 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:23.304383 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.293352  2426 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:23.307349 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.309832 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.308219 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.309494 30002 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:23.314046 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.318389  2457 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:23.319006  2457 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.319906  2457 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:23.323012  2484 log.cc:927] Time spent T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.663s	user 0.007s	sys 0.004s
I20260709 13:13:23.336333 30112 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:23.342406  2387 raft_consensus.cc:493] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:23.343086  2387 raft_consensus.cc:515] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:23.346014 30151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.027s
W20260709 13:13:23.346403 30151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.010s	sys 0.027s
W20260709 13:13:23.346692 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 607707us
I20260709 13:13:23.349924 30151 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:13:23.351436 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 49612us
I20260709 13:13:23.351353 30002 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.355262  2159 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.358637  2489 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:23.361809 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.366839 30151 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.368943 30037 raft_consensus.cc:1240] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:23.373905 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.374667 30108 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:23.378844 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.385651 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:23.395458 30031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:23.418411 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:23.419479 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:23.426916 30035 raft_consensus.cc:2393] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:23.427683 30029 raft_consensus.cc:2393] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:23.346159  2387 leader_election.cc:290] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:23.433490 30033 raft_consensus.cc:1240] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer ef9ab4d665234a799376bf42ef5d058c for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:23.435747 29931 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 13 to 14, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 14 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:23.436998 30036 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:23.438071 29931 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 8 to 10, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:23.439644 29931 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 11, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 11 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:23.413851  2506 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.426687  2459 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:23.433007  2489 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:23.453718 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 93359.4us
I20260709 13:13:23.456733 30036 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:23.462601 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.468407 30108 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:23.467772 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.471325 30110 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f51764a89048468a6faa21020812b0 in current term 15: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:23.454600  2459 raft_consensus.cc:493] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.470220 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.472918 30110 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:23.476564 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.475318 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.477190 30106 raft_consensus.cc:2376] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12. Re-sending same reply.
I20260709 13:13:23.497181  2469 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:23.498749 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.476837  2459 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:23.509693  2159 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.510720 30107 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:23.515483 30705 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.523434  2462 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:23.537317 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.542680 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:23.543134 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.543466 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.543799 30106 raft_consensus.cc:2393] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 34f51764a89048468a6faa21020812b0 in this term.
I20260709 13:13:23.544133 30108 raft_consensus.cc:2393] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:23.546995 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a61c48865d1417593366ed1611c2836" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.542744 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.550989 30110 raft_consensus.cc:2393] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:23.552202 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.553350 30112 raft_consensus.cc:2393] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 15: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:23.558032 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.576094 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.578455 30036 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:23.582854  2387 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.583542  2387 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.587710 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:23.590122 30029 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:23.592341 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 71761.7us
I20260709 13:13:23.597283 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa63b06fc4f446c8b2e800abeaaeabce" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.599390 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:23.600420  2457 consensus_queue.cc:1059] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:23.600967 30032 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:23.602027  2457 raft_consensus.cc:3055] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:23.602481  2457 raft_consensus.cc:740] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.603530 30037 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:13:23.605501 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.603581  2457 consensus_queue.cc:260] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.607163  2457 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.610986 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:23.611934 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:23.613904 30033 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:23.613574 29931 catalog_manager.cc:5697] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:23.615350 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:23.616465  2159 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.616891  2159 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.617233  2159 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.626195 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.639281 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:23.641443 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:23.644034 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 50821.6us
I20260709 13:13:23.612849  2387 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:23.649731 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.648630  2470 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:13:23.661047  2505 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.663131 30001 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.664149  2394 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.664673 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.665580  2379 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.667126 30001 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.668231  2457 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.675729  2159 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:23.680238 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 156397us
I20260709 13:13:23.681196 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.685806 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.699934 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.702294 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.704808 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.708004 30001 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:23.557257  2459 raft_consensus.cc:515] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:23.717294  2469 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:23.711539  2508 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:23.709488  2378 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:23.709614  2389 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:23.702437  2506 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.719595  2189 consensus_queue.cc:1059] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:23.707325  2390 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.706949  2477 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.727443 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.707769  2483 consensus_queue.cc:1059] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:13:23.713662  2458 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:23.721964  2378 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.746820 30734 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:23.729923  2189 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:23.698724  2387 consensus_queue.cc:1048] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:13:23.708081  2404 consensus_queue.cc:1059] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:13:23.746948 30150 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:23.752660 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.760933  2378 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.753688  2458 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.765731  2458 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.757742  2472 consensus_queue.cc:1059] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:13:23.749287  2189 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.774145  2189 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.775537  2189 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.749464  2489 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:23.787215 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.788277 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 73522.9us
I20260709 13:13:23.756704  2387 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:23.811821 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64966us
I20260709 13:13:23.844857 30150 leader_election.cc:304] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.845821  2477 raft_consensus.cc:2749] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:23.846379 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.847242  2477 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.847702 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.848984 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.849836  2426 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.856952 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.878899  2159 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:23.811250  2454 consensus_queue.cc:1059] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:13:23.860477  2469 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:23.887640  2454 raft_consensus.cc:3055] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:23.888164  2454 raft_consensus.cc:740] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:23.897171 30150 leader_election.cc:304] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.899490 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:23.900364 30036 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.913801 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:23.922673  1578 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:23.931537  2513 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.932209  2513 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:23.898281  2469 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:23.969956 30036 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:23.923408  2495 raft_consensus.cc:2749] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.975178  2472 raft_consensus.cc:3055] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:23.980134  2472 raft_consensus.cc:740] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
W20260709 13:13:23.979264 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 123075us
I20260709 13:13:23.990243  2520 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.990693 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.990887  2520 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:23.991434  2524 consensus_queue.cc:1059] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:23.992336  2404 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:23.993249  2524 raft_consensus.cc:3055] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:23.992977  2404 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.993690  2524 raft_consensus.cc:740] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:23.994609  2524 consensus_queue.cc:260] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:23.995539  2404 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:23.995982  2524 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:24.014941 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.015792 30036 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
I20260709 13:13:24.017143 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:23.889249  2454 consensus_queue.cc:260] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:23.973522  2483 consensus_queue.cc:1243] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Peer 34f51764a89048468a6faa21020812b0 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:24.039590 30186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.045816 30186 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 15.
I20260709 13:13:23.935101  2513 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.048686 30183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:24.053288 30032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.057056 30183 raft_consensus.cc:3060] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:24.012004  2459 leader_election.cc:290] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.059914 30032 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 15.
W20260709 13:13:24.062191 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 148483us
W20260709 13:13:24.039975 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 84999.1us
I20260709 13:13:24.071848 30151 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:23.981125  2472 consensus_queue.cc:260] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.064268  2454 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:24.092264 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:24.097030 30734 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
I20260709 13:13:24.098810 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:24.104332 29933 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 262) took 11764 ms (client timeout 15000 ms). Trace:
I20260709 13:13:24.114841 30079 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:24.113075 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:24.123004 30183 raft_consensus.cc:2468] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:24.092844  2495 raft_consensus.cc:2804] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:24.113823  2472 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.151949 30113 raft_consensus.cc:3055] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:24.152671 30113 raft_consensus.cc:740] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:24.171403 30113 consensus_queue.cc:260] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.172775 30113 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.177569  2525 raft_consensus.cc:3055] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:24.178126  2525 raft_consensus.cc:740] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:24.179167  2525 consensus_queue.cc:260] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.180495  2525 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.191895 30113 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:13:24.192366 30113 pending_rounds.cc:85] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 8
I20260709 13:13:24.192615 30113 pending_rounds.cc:107] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:13:24.192878 30113 raft_consensus.cc:2889] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:24.199496  2527 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
W20260709 13:13:24.201656  2518 log.cc:927] Time spent T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:13:24.092484  2520 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:24.126556  2387 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:24.123829  2483 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:24.204278  2529 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.204663  2495 raft_consensus.cc:697] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:24.218657  2495 consensus_queue.cc:237] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.206004  2483 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.220752  2483 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:24.209800 30077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.224171 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 134205us
I20260709 13:13:24.231417 30112 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:24.233385  1578 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:24.125092  2437 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:24.210546  2159 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.251876  2159 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.253954  2159 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.254478  2426 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:24.254689 30705 leader_election.cc:304] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
W20260709 13:13:24.250259  2295 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:13:24.262337  2520 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.262974  2520 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.265035  2520 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:24.266541 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.271168 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.276955 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.278033 30036 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 8.
I20260709 13:13:24.283454 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:24.288345  2480 raft_consensus.cc:2804] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:24.292832  2480 raft_consensus.cc:697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:24.293556  2517 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:24.293926  2480 consensus_queue.cc:237] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.305222  2530 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.305929  2530 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.309324  2390 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:24.309507  2477 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:24.309912  2390 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.310339  2390 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:24.318305  2189 consensus_meta.cc:287] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 13:13:24.318989 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.249287  2437 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.320020  2437 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.309759  2530 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.248693  2506 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 13:13:24.104943 29933 rpcz_store.cc:269] 0709 13:13:12.281333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.281626 (+   293us) service_pool.cc:224] Handling call
0709 13:13:24.039245 (+11757619us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:19.726840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:20.138577 (+411737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:20.138623 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:13:20.138650 (+    27us) tablet.cc:662] Decoding operations
0709 13:13:20.543252 (+404602us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:20.543384 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:20.543429 (+    45us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:13:20.559076 (+ 15647us) tablet.cc:701] Row locks acquired
0709 13:13:20.559108 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:13:20.559321 (+   213us) write_op.cc:270] Start()
0709 13:13:20.559501 (+   180us) write_op.cc:276] Timestamp: P: 1783602800559251 usec, L: 0
0709 13:13:20.559535 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:13:20.588093 (+ 28558us) log.cc:844] Serialized 9069 byte log entry
0709 13:13:20.608258 (+ 20165us) op_driver.cc:464] REPLICATION: finished
0709 13:13:20.609947 (+  1689us) write_op.cc:301] APPLY: starting
0709 13:13:20.610024 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:20.963278 (+353254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:20.963466 (+   188us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:21.645468 (+682002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:21.670299 (+ 24831us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:13:21.670392 (+    93us) write_op.cc:312] APPLY: finished
0709 13:13:21.676235 (+  5843us) log.cc:844] Serialized 204 byte log entry
0709 13:13:21.824821 (+148586us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:21.825671 (+   850us) write_op.cc:454] Released schema lock
0709 13:13:21.825786 (+   115us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:21.833730 (+  7944us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe5c6e86e 00007fcbe5c6dbb6 00007fcbe5c6d7d8 00007fcbe5c77221 00007fcbe5c771d9 00007fcbe5c77169
0709 13:13:21.975213 (+141483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:21.977113 (+  1900us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4958,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1370,"apply.run_cpu_time_us":66904,"apply.run_wall_time_us":1289322,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":416476,"prepare.run_cpu_time_us":35036,"prepare.run_wall_time_us":895004,"raft.queue_time_us":1151,"raft.run_cpu_time_us":1697,"raft.run_wall_time_us":1697,"replication_time_us":48522,"spinlock_wait_cycles":3901184,"thread_start_us":359665,"threads_started":5,"wal-append.queue_time_us":142972,"wal-append.run_cpu_time_us":9667,"wal-append.run_wall_time_us":2055781}]]}
W20260709 13:13:24.344581 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 245842us
I20260709 13:13:24.346105 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.357961  2529 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:24.359380  2483 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.360433  2524 raft_consensus.cc:493] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:24.361100  2524 raft_consensus.cc:515] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.363565  2524 leader_election.cc:290] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.357604  2390 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.378914 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:24.381866 30181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:24.384232 30003 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.390532 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.392329  2529 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:24.393653 30178 raft_consensus.cc:1240] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:24.374938 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:24.399381 30185 raft_consensus.cc:1240] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:13:24.399942 30186 raft_consensus.cc:1240] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 LEADER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:24.400416 30184 raft_consensus.cc:2410] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:24.406064 30180 raft_consensus.cc:2410] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:24.409116 30112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c6f7e90c624b64bdbb67860d561418" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:24.410272 30112 raft_consensus.cc:2410] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:13:24.411418 30187 raft_consensus.cc:1240] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:24.411691 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.414050 30106 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 16: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:24.414750 30004 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.443709 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.446954 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.447700 30179 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
I20260709 13:13:24.406858  2520 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:24.455644 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:24.456351 30034 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.455852 30187 raft_consensus.cc:1240] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Rejecting Update request from peer 98b3b699b87245df85d3aa84c13f5691 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:24.490437 30106 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:24.493130 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.498477 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.498744 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.499392 30105 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 7.
I20260709 13:13:24.413816  2437 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.498086 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.494722 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.507257 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.507884 30109 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:24.508011 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.503841 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:24.516215 30105 raft_consensus.cc:3060] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.528438 30111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.529846 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df6751216d4ac584919e5640b25bc4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.531694 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.487813  2529 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:24.506728  2295 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:24.535976 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:24.536715 30078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.473660  2520 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.552764 30105 raft_consensus.cc:2468] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:24.533118  2387 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.557250 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 64747.8us
I20260709 13:13:24.536747  2404 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:24.541997  2517 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:13:24.560513  2521 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:24.541165  2529 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.559927  2483 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:24.585261 30077 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.589690 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:24.590610 30734 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 16: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:24.612298  2390 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.612665 30034 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 16.
I20260709 13:13:24.564141  2387 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:24.609776 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 65512.2us
I20260709 13:13:24.610302  2521 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:24.631891  2387 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.638929  2529 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:24.656893 29923 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8d2f11cccca04a7683da4080ab797bd7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:24.658228  2387 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:24.658864  2387 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.658882  2390 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:24.660873  2390 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.661995 30186 raft_consensus.cc:1240] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:24.662241  2532 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:24.662724  2532 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.663328  2390 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.663870  2390 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.664306  2390 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.665949  2387 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:24.666249 30183 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:24.668697 30180 raft_consensus.cc:1240] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:24.676517 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.678634 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.679988 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.677270 30035 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:24.686087 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.686419 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:24.687039 30034 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:24.687625 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.665076  2532 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.706924 30034 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:24.713478 30182 raft_consensus.cc:1240] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:24.717597  2520 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.718952 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.719535  2437 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.721565 30105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:24.722419 30105 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 16: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:24.728000 30179 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:24.725345 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:24.731778  2536 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:24.731848 30151 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:24.732403  2536 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.732826  2536 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:24.734711  2549 log.cc:927] Time spent T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:13:24.736413  2535 raft_consensus.cc:2804] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:24.736970  2535 raft_consensus.cc:697] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:24.743563  2536 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.760948 30179 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:24.762888 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.772873 30150 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.774979 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:24.774983 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.776007 30109 raft_consensus.cc:3060] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:24.779115 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:24.779735 30178 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.780269 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.777926  2446 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:24.783737 30107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.780851 30182 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:24.786896 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.760617  2454 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:13:24.793738 30107 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:24.797442 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.797077  2535 consensus_queue.cc:237] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:24.812958 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.799120  2469 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:24.815135 30077 leader_election.cc:304] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.816599 30077 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.817828 30150 leader_election.cc:304] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.823596 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:24.824162 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:24.824776 30035 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.826704 30150 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:24.830300 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 205398us
I20260709 13:13:24.819887  2520 raft_consensus.cc:2749] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:24.823346  2521 raft_consensus.cc:2749] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:24.826715  2387 raft_consensus.cc:2749] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:24.844866  2469 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:24.839640  2536 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.864420 30035 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:24.834290  2390 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:24.874668 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:24.878386 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.880192  2189 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:13:24.892349 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:24.892886 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.895704 30178 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 16.
I20260709 13:13:24.897281 30109 raft_consensus.cc:2468] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:24.900250  2469 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:24.908114  2528 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:24.910245 30150 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.912946  2528 raft_consensus.cc:2749] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:24.914232 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:24.917130  2488 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:24.918380  2528 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:24.918304  2488 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.920481  2488 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:24.922704 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:24.924042 30077 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.916661 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:24.925859  2456 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:24.926216 30104 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:13:24.926506  2521 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:24.926690 30104 pending_rounds.cc:85] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Aborting all ops after (but not including) 9
I20260709 13:13:24.927066 30104 pending_rounds.cc:107] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:13:24.927338 30104 raft_consensus.cc:2889] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.928515 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:24.929137 30113 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.931113 30179 raft_consensus.cc:1275] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:24.931258  2456 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:24.938817 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:24.953781  2456 consensus_queue.cc:1048] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:24.957075 30034 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:13:24.957435 30077 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:24.958230 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:24.958982 30029 raft_consensus.cc:2393] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 16: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:24.959666  2521 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:24.960201  2521 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:24.960407 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 151) took 6500 ms. Trace:
I20260709 13:13:24.961191  2521 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:24.985426 30151 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:24.960839 29931 rpcz_store.cc:276] 0709 13:13:18.460475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.460648 (+   173us) service_pool.cc:224] Handling call
0709 13:13:18.818815 (+358167us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5400040790. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faeb71 00007fcbe2faf0b2 00007fcbebf28a89 00007fcbebec0da6 00007fcbebe92088 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc
0709 13:13:19.303192 (+484377us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b5400040790. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2faee9c 00007fcbe2faf0f6 00007fcbebf28a89 00007fcbebec0da6 00007fcbebe92088 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc
0709 13:13:24.960311 (+5657119us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:23.832447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:23.833305 (+   858us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:23.833371 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:13:23.833428 (+    57us) tablet.cc:662] Decoding operations
0709 13:13:23.834434 (+  1006us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:23.834551 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:23.834589 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:13:23.835330 (+   741us) tablet.cc:701] Row locks acquired
0709 13:13:23.835384 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:13:23.835594 (+   210us) write_op.cc:270] Start()
0709 13:13:23.835768 (+   174us) write_op.cc:276] Timestamp: P: 1783602803835515 usec, L: 0
0709 13:13:23.835792 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:13:23.836981 (+  1189us) log.cc:844] Serialized 2578 byte log entry
0709 13:13:24.554610 (+717629us) op_driver.cc:464] REPLICATION: finished
0709 13:13:24.713562 (+158952us) write_op.cc:301] APPLY: starting
0709 13:13:24.713666 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:24.717359 (+  3693us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:24.726195 (+  8836us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:24.861610 (+135415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:24.869560 (+  7950us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:13:24.874245 (+  4685us) write_op.cc:312] APPLY: finished
0709 13:13:24.875875 (+  1630us) log.cc:844] Serialized 65 byte log entry
0709 13:13:24.877457 (+  1582us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.880801 (+  3344us) write_op.cc:454] Released schema lock
0709 13:13:24.889278 (+  8477us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:24.889706 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.889733 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1448393,"reported_tablets":12,"spinlock_wait_cycles":65339008,"child_traces":[["op",{"apply.queue_time_us":155978,"apply.run_cpu_time_us":10888,"apply.run_wall_time_us":176118,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":201222,"prepare.run_cpu_time_us":23867,"prepare.run_wall_time_us":210653,"raft.queue_time_us":241327,"raft.run_cpu_time_us":12017,"raft.run_wall_time_us":149647,"replication_time_us":698398,"thread_start_us":442647,"threads_started":4,"wal-append.queue_time_us":236844}]]}
I20260709 13:13:24.986752 30150 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:25.090070 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 104751us
I20260709 13:13:25.078373 30113 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
W20260709 13:13:25.098281 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 111622us
I20260709 13:13:25.100646  2532 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:25.094161  2530 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:25.102244  2530 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:25.103188  2530 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.115906 30108 raft_consensus.cc:1275] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:13:25.109859  2563 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.128031  2528 consensus_queue.cc:1048] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:25.157240 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:25.165845 29932 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 6 to 7, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 7 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.185333 29932 catalog_manager.cc:5697] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 10 to 11, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 11 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.190203 29932 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 9 to 10, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.194036 29932 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 12 to 13, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 13 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.186022 30705 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:25.197896  2427 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:25.178831  2394 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:13:25.177182  2562 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:13:25.201071 29932 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 6 to 9, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 9 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.208302 29932 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.214190 29932 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 9 to 10, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 10 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.246197 29932 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 12 to 15, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 15 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.248684 29932 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.263518 29932 catalog_manager.cc:5697] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.292798 29932 catalog_manager.cc:5697] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 8 to 10, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 10 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:25.339468 30034 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:25.378659 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:25.368831  2387 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:13:25.444749  2506 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:25.472491  2571 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:25.479377  2506 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.486320  2506 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.498368 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:25.499100 30182 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:25.512836 30108 raft_consensus.cc:1275] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:25.522879 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:25.523156  2575 log.cc:927] Time spent T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.108s	user 0.004s	sys 0.000s
I20260709 13:13:25.524128 30108 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:25.526758  2524 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.527402  2524 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.531569  2524 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.536044 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:25.536863 30182 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:25.539574 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.544395  2524 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.545255  2524 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.545756  2524 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.545569  2529 consensus_queue.cc:1048] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:25.546573 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.549634  2517 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:25.550197  2517 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.550657  2517 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.575559 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0" is_pre_election: true
I20260709 13:13:25.576426 30035 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:25.579224  2378 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.589812  2378 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.592368  2378 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.600831 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:25.602085 30187 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:25.612550  2517 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.631158 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:25.631973 30113 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 10.
I20260709 13:13:25.635797 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.666265  2517 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.654508  2394 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:25.669778  2394 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.670185  2394 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.669965 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:25.674124 30187 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.691097 30113 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:25.655032  2189 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:25.701912 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 56380us
I20260709 13:13:25.687935  2524 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.695405  2563 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:13:25.703668  2189 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.711402 30184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:25.712075 30184 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
I20260709 13:13:25.714458 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.708359  2189 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.719815  2394 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.722150  2394 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.735361 30187 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:25.735946 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:25.738343 30109 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.747215  2524 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.747527  2189 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:25.748025  2189 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.748447  2189 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.748848 30036 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:25.752969 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:25.753697 30178 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.762451 29931 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.764441 29931 catalog_manager.cc:5697] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.769296 30034 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:25.774389 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:25.775280 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:25.779589 30029 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.779677 30182 raft_consensus.cc:3060] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.774655 30002 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.782671 30104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:25.783418 30104 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.785108  2477 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:25.792901  2378 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.793495  2378 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.795692  2378 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.785847  2543 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:25.785964 30187 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:25.796567  2543 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:25.797752  2543 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.786934 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
W20260709 13:13:25.788710 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 52986.1us
I20260709 13:13:25.801597 30113 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 15.
I20260709 13:13:25.802517 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:25.791097  2520 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:25.803157 30187 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:25.804785 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.807456  2454 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.810338 30109 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:25.810614  2454 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.811070  2454 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.804076  2520 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:13:25.826582 30182 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:25.827502  2189 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.828168 30077 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.830214  2524 raft_consensus.cc:2804] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:25.830838 30029 raft_consensus.cc:2468] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:25.830999  2524 raft_consensus.cc:697] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:25.834610 30739 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:25.810396 30178 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:25.843593 30002 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.848632 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:25.849336 30108 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 12.
I20260709 13:13:25.851107 30104 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 11.
I20260709 13:13:25.844540  2394 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:25.863509 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:25.867952 30178 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.882804  2454 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.896070 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:25.907043 30182 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.846755  2520 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:13:25.915766 30178 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 16.
I20260709 13:13:25.885341  2454 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.928773 30182 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:25.891464  2394 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:25.866178  2189 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:25.936033 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.937095 30002 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:25.943996 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:25.944684 30108 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.947865 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 263) took 7914 ms. Trace:
I20260709 13:13:25.948287 29932 rpcz_store.cc:276] 0709 13:13:18.033531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.033701 (+   170us) service_pool.cc:224] Handling call
0709 13:13:25.947802 (+7914101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:25.604739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:25.605264 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:25.605294 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:13:25.605312 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:25.606320 (+  1008us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:25.606492 (+   172us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:25.606522 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:13:25.607726 (+  1204us) tablet.cc:701] Row locks acquired
0709 13:13:25.607749 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:13:25.607923 (+   174us) write_op.cc:270] Start()
0709 13:13:25.608039 (+   116us) write_op.cc:276] Timestamp: P: 1783602805607873 usec, L: 0
0709 13:13:25.608061 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:13:25.608736 (+   675us) log.cc:844] Serialized 4422 byte log entry
0709 13:13:25.700281 (+ 91545us) op_driver.cc:464] REPLICATION: finished
0709 13:13:25.737645 (+ 37364us) write_op.cc:301] APPLY: starting
0709 13:13:25.737776 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:25.744220 (+  6444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:25.744344 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:25.750908 (+  6564us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:25.751174 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:13:25.751224 (+    50us) write_op.cc:312] APPLY: finished
0709 13:13:25.751581 (+   357us) log.cc:844] Serialized 105 byte log entry
0709 13:13:25.751747 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:25.751894 (+   147us) write_op.cc:454] Released schema lock
0709 13:13:25.751971 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:25.752436 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:25.752464 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160586,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":37002,"apply.run_cpu_time_us":14386,"apply.run_wall_time_us":14766,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"num_ops":11,"prepare.queue_time_us":173586,"prepare.run_cpu_time_us":4299,"prepare.run_wall_time_us":4299,"replication_time_us":92040,"thread_start_us":178588,"threads_started":2}]]}
I20260709 13:13:25.939862  2585 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:25.967618 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155d3e6034f842759244a283f46a67b9"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:25.968240 30739 raft_consensus.cc:606] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:25.969198 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:25.969905 30109 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.941112  2543 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:25.973773  2543 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:25.974807  2543 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.977159  2585 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:25.978219  2585 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.983534  2394 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.917781  2524 consensus_queue.cc:237] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:25.996632  2550 raft_consensus.cc:993] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:25.997215  2550 raft_consensus.cc:1081] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:25.999724 30110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155d3e6034f842759244a283f46a67b9"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:26.006394 30110 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.007542 30110 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:26.022507 30108 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 16.
I20260709 13:13:26.026167 30109 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 13.
I20260709 13:13:26.051352 30034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:26.052014 30034 raft_consensus.cc:606] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:26.117964 30740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:26.118629 30740 raft_consensus.cc:606] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:26.145167 30178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a"
dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:47040
I20260709 13:13:26.145879 30178 raft_consensus.cc:606] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:26.150058 30110 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.151299 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:26.151978 30036 raft_consensus.cc:606] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:26.152333 30036 raft_consensus.cc:614] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:26.153285 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:26.153967 30740 raft_consensus.cc:3055] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:26.154323 30740 raft_consensus.cc:740] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:26.156412 30740 consensus_queue.cc:260] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.157205 30734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:26.158378 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:26.190778 30734 raft_consensus.cc:606] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Received request to transfer leadership to TS 34f51764a89048468a6faa21020812b0
I20260709 13:13:26.190928 30178 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:26.192713 30740 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:26.209506 30110 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:26.210882 30108 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:26.217825  2596 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:26.220640 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:26.222520 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:26.242865 30740 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:26.249035 30079 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:26.250110  2524 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:26.250648  2524 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:26.251500  2524 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.266801 30178 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:26.327970  2546 raft_consensus.cc:993] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 34f51764a89048468a6faa21020812b0 to start an election
I20260709 13:13:26.328504  2546 raft_consensus.cc:1081] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Signalling peer 34f51764a89048468a6faa21020812b0 to start an election
W20260709 13:13:26.356995 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48452.6us
I20260709 13:13:26.364897 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4"
dest_uuid: "34f51764a89048468a6faa21020812b0"
 from {username='slave'} at 127.0.0.1:44710
I20260709 13:13:26.365557 30036 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.365965 30036 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.372889  2583 raft_consensus.cc:993] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:26.373761  2583 raft_consensus.cc:1081] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:26.386282 30110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:26.386943 30110 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.387326 30110 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.382668 30036 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.394650 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:26.395267 30178 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.397697 30180 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:26.400503 30036 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Requested vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:26.405622 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:26.406318 30740 raft_consensus.cc:3055] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:26.406639 30740 raft_consensus.cc:740] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:26.407408 30740 consensus_queue.cc:260] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.408490 30740 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.418071 30108 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:26.419561 30178 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:26.431269  2189 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:26.435449  2454 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:26.431625 30002 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:26.444890  2189 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.445658  2189 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Becoming Leader. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:26.446768  2512 raft_consensus.cc:993] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:26.447299  2512 raft_consensus.cc:1081] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:26.446943  2189 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.462973 30109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:26.463696 30109 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.464273 30109 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.467095 30110 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:26.479455 30740 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f51764a89048468a6faa21020812b0 in term 14.
I20260709 13:13:26.469316 30110 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:26.495658 30108 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:26.503361 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:26.504542 30034 raft_consensus.cc:3055] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:26.504927 30034 raft_consensus.cc:740] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:26.507407 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:26.508095 30179 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.511639 30178 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:26.520480 30104 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:26.521206 30035 raft_consensus.cc:1275] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:26.505757 30034 consensus_queue.cc:260] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:26.520201  2457 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:13:26.519344 30109 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.537002 30034 raft_consensus.cc:3060] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:26.546123 29936 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 262) took 24455 ms (client timeout 15000 ms). Trace:
W20260709 13:13:26.546597 29936 rpcz_store.cc:269] 0709 13:13:02.090791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.090971 (+   180us) service_pool.cc:224] Handling call
0709 13:13:02.435042 (+344071us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:26.545878 (+24110836us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60,"reported_tablets":49,"spinlock_wait_cycles":374948608}
I20260709 13:13:26.548346 30109 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:26.553783 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:26.563625 30179 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:26.559815  2602 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:13:26.592957 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:26.593645 30036 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.591879 30077 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:26.599706 30740 raft_consensus.cc:3055] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:26.600265 30740 raft_consensus.cc:740] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:26.602375 30034 raft_consensus.cc:2468] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:26.601022 30740 consensus_queue.cc:260] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.558868  2454 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:13:26.610903 30740 raft_consensus.cc:3060] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.614516 30179 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:26.624599  2583 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:13:26.635980 30740 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:26.604791  2520 raft_consensus.cc:2804] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:26.641664 30079 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:26.596925  2521 consensus_queue.cc:1048] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:13:26.672137 30036 raft_consensus.cc:2468] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:26.652153  2520 raft_consensus.cc:697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:26.697726  2520 consensus_queue.cc:237] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:26.677508  2524 raft_consensus.cc:2804] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:26.719611  2604 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:13:26.732949 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 75781.4us
I20260709 13:13:26.758354 30187 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:26.729576  2524 raft_consensus.cc:697] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:26.790819  2524 consensus_queue.cc:237] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:26.934602 30740 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:26.959379 30180 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:26.959064  2602 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:26.968010 29931 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:27.095935 30178 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:27.138809 30734 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:27.155211  2602 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:27.190124 30178 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:13:27.253595 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 64397.9us
W20260709 13:13:27.265149 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 49810.8us
W20260709 13:13:27.266960  2618 log.cc:927] Time spent T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:13:27.273124 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 94257.2us
I20260709 13:13:27.277714  2517 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:27.272676  2617 log.cc:927] Time spent T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:13:27.266409  2378 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:13:27.272728 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 89181.4us
W20260709 13:13:27.348464 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 76883.3us
W20260709 13:13:27.359258 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 84936.6us
I20260709 13:13:27.360549  2159 raft_consensus.cc:993] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:27.361220  2159 raft_consensus.cc:1081] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:27.223495 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.405745  2602 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:27.414510  2635 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:13:27.437793 30029 raft_consensus.cc:1275] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:13:27.446417 29934 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 246) took 13998 ms (client timeout 15000 ms). Trace:
I20260709 13:13:27.446975  2524 consensus_queue.cc:1048] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:27.457628 30187 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:27.458755 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50320
I20260709 13:13:27.459336 30104 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.460561 30104 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:27.446969 29934 rpcz_store.cc:269] 0709 13:13:13.447774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.623351 (+175577us) service_pool.cc:224] Handling call
0709 13:13:27.446216 (+13822865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338851,"reported_tablets":50,"spinlock_wait_cycles":31104}
I20260709 13:13:27.545585 30104 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:27.539383  2189 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
W20260709 13:13:27.562755 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 47254.7us
I20260709 13:13:27.588322 30104 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:27.589902 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:27.590690 30180 raft_consensus.cc:3055] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:27.591089 30180 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:27.598693 30180 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:27.612843 30029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729e969847cf4fbcb29c2681ec03a97a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:27.613554 30029 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:27.623929 30734 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:27.629328 30029 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
I20260709 13:13:27.631469 30077 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:27.633708 30029 raft_consensus.cc:1275] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:27.636905  2524 raft_consensus.cc:2804] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:27.681090  2643 log.cc:927] Time spent T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:13:27.650279  2524 raft_consensus.cc:697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:27.697690  2524 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:27.631652  2586 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:13:27.705534  2602 consensus_queue.cc:1048] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:27.785272 29931 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34648 (request call id 154) took 1635 ms. Trace:
I20260709 13:13:27.785702 29931 rpcz_store.cc:276] 0709 13:13:26.149783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.149930 (+   147us) service_pool.cc:224] Handling call
0709 13:13:26.153162 (+  3232us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b540014d054. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:13:27.785175 (+1632013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:27.084727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:27.092268 (+  7541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:27.092313 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:13:27.092330 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:27.092649 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:27.092698 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:27.092726 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:27.092902 (+   176us) tablet.cc:701] Row locks acquired
0709 13:13:27.092921 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:27.093057 (+   136us) write_op.cc:270] Start()
0709 13:13:27.093174 (+   117us) write_op.cc:276] Timestamp: P: 1783602807093008 usec, L: 0
0709 13:13:27.093207 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:13:27.093891 (+   684us) log.cc:844] Serialized 599 byte log entry
0709 13:13:27.450120 (+356229us) op_driver.cc:464] REPLICATION: finished
0709 13:13:27.608670 (+158550us) write_op.cc:301] APPLY: starting
0709 13:13:27.612050 (+  3380us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:27.695521 (+ 83471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:27.695621 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:27.696584 (+   963us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:27.696768 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:13:27.696811 (+    43us) write_op.cc:312] APPLY: finished
0709 13:13:27.697002 (+   191us) log.cc:844] Serialized 25 byte log entry
0709 13:13:27.697161 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:27.697242 (+    81us) write_op.cc:454] Released schema lock
0709 13:13:27.697288 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:27.730098 (+ 32810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:27.730380 (+   282us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13116,"reported_tablets":1,"spinlock_wait_cycles":4062080,"child_traces":[["op",{"apply.queue_time_us":120866,"apply.run_cpu_time_us":4114,"apply.run_wall_time_us":133270,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":106473,"prepare.run_cpu_time_us":21516,"prepare.run_wall_time_us":66927,"raft.queue_time_us":151093,"raft.run_cpu_time_us":4295,"raft.run_wall_time_us":63540,"replication_time_us":356744,"thread_start_us":258945,"threads_started":4,"wal-append.queue_time_us":81887}]]}
W20260709 13:13:27.807917  2655 log.cc:927] Time spent T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:13:27.855782  2642 log.cc:927] Time spent T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260709 13:13:27.863956 30180 raft_consensus.cc:3060] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:27.893922 30180 raft_consensus.cc:2468] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
I20260709 13:13:27.957149 29931 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 11 to 12, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 12 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:27.958891 29931 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 13 to 14, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 14 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:27.960412 29931 catalog_manager.cc:5697] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 8 to 9, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 9 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:28.036604 29930 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59080 (request call id 245) took 33382 ms (client timeout 15000 ms). Trace:
W20260709 13:13:28.037143 29930 rpcz_store.cc:269] 0709 13:12:54.653666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.673595 (+ 19929us) service_pool.cc:224] Handling call
0709 13:13:28.036379 (+33362784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2820,"reported_tablets":44}
I20260709 13:13:28.144208 30035 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:28.146498  2521 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:28.151913 29933 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.173112 29933 catalog_manager.cc:5697] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 13 to 15, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 15 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.174854 29933 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 11 to 13, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 13 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.176317 29933 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 10 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 11 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.178278 29933 catalog_manager.cc:5697] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.200536 29933 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.203613 29933 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.219985 30180 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:28.222941  2586 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:28.355175 29932 catalog_manager.cc:5697] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.374107 29932 catalog_manager.cc:5697] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.380566 29932 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.416951 29932 catalog_manager.cc:5697] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 10 to 13, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 13 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.491605 29932 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59070 (request call id 264) took 2158 ms. Trace:
I20260709 13:13:28.497753 30037 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:28.500994 29934 catalog_manager.cc:5697] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 9 to 10, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 10 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.495122 29933 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59056 (request call id 263) took 3481 ms. Trace:
I20260709 13:13:28.502813 29933 rpcz_store.cc:276] 0709 13:13:25.061514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.061672 (+   158us) service_pool.cc:224] Handling call
0709 13:13:28.495062 (+3433390us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:28.282012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:28.282566 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:28.282603 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:28.282620 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:28.284293 (+  1673us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:28.284376 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:28.284412 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:28.285055 (+   643us) tablet.cc:701] Row locks acquired
0709 13:13:28.285075 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:13:28.285225 (+   150us) write_op.cc:270] Start()
0709 13:13:28.285364 (+   139us) write_op.cc:276] Timestamp: P: 1783602808285179 usec, L: 0
0709 13:13:28.285387 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:28.286048 (+   661us) log.cc:844] Serialized 2870 byte log entry
0709 13:13:28.288961 (+  2913us) op_driver.cc:464] REPLICATION: finished
0709 13:13:28.289485 (+   524us) write_op.cc:301] APPLY: starting
0709 13:13:28.289567 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:28.299633 (+ 10066us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:28.299733 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:28.327542 (+ 27809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:28.327772 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:13:28.327829 (+    57us) write_op.cc:312] APPLY: finished
0709 13:13:28.328123 (+   294us) log.cc:844] Serialized 73 byte log entry
0709 13:13:28.328317 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.328461 (+   144us) write_op.cc:454] Released schema lock
0709 13:13:28.328509 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:28.328915 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.328945 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22159,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":10646,"apply.run_wall_time_us":39390,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29218,"num_ops":7,"prepare.queue_time_us":1225,"prepare.run_cpu_time_us":3808,"prepare.run_wall_time_us":8334,"replication_time_us":3400}]]}
I20260709 13:13:28.495569 29932 rpcz_store.cc:276] 0709 13:13:26.332737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.332880 (+   143us) service_pool.cc:224] Handling call
0709 13:13:28.466081 (+2133201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.466120 (+    39us) write_op.cc:454] Released schema lock
0709 13:13:28.491511 (+ 25391us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:28.425963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:28.426540 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:28.426579 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:13:28.426593 (+    14us) tablet.cc:662] Decoding operations
0709 13:13:28.427205 (+   612us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:28.427257 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:28.427290 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:13:28.427669 (+   379us) tablet.cc:701] Row locks acquired
0709 13:13:28.427683 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:13:28.427844 (+   161us) write_op.cc:270] Start()
0709 13:13:28.427954 (+   110us) write_op.cc:276] Timestamp: P: 1783602808427800 usec, L: 0
0709 13:13:28.427970 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:13:28.428599 (+   629us) log.cc:844] Serialized 1706 byte log entry
0709 13:13:28.448804 (+ 20205us) op_driver.cc:464] REPLICATION: finished
0709 13:13:28.449296 (+   492us) write_op.cc:301] APPLY: starting
0709 13:13:28.449368 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:28.451835 (+  2467us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:28.451933 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:28.454900 (+  2967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:28.455088 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:13:28.455141 (+    53us) write_op.cc:312] APPLY: finished
0709 13:13:28.455395 (+   254us) log.cc:844] Serialized 49 byte log entry
0709 13:13:28.455551 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.455651 (+   100us) write_op.cc:454] Released schema lock
0709 13:13:28.455695 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":42673,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":6448,"apply.run_wall_time_us":6709,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2896,"prepare.run_wall_time_us":2896,"replication_time_us":20666}]]}
I20260709 13:13:28.518807 29934 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 13 to 16, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 16 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.527861 29934 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.540226 30180 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:28.543689 30739 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:13:28.547276  2457 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:28.534662 29934 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.553828 29934 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 7 to 11, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 34f51764a89048468a6faa21020812b0 (127.28.62.129). New cstate: current_term: 11 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } }
I20260709 13:13:28.556538  2506 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:28.597863  2506 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.605830 30740 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.615499 29932 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 14 to 15, leader changed from ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 15 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.622953 30180 raft_consensus.cc:2955] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.644814 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.645808 29931 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 10 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.658474 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7a9a88da98d43b8a556cba3e2768e28 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:28.715010 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet b7a9a88da98d43b8a556cba3e2768e28 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50288
I20260709 13:13:28.753818  2665 tablet_replica.cc:333] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:28.760257  2665 raft_consensus.cc:2243] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.767354  2665 raft_consensus.cc:2272] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.772617  2665 ts_tablet_manager.cc:1916] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:28.801976 30109 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:28.836786 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:28.837481 30037 raft_consensus.cc:606] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:28.854190 30739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:28.854897 30739 raft_consensus.cc:606] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:28.859367 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:28.860000 30037 raft_consensus.cc:606] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:28.862921 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:28.863520 30037 raft_consensus.cc:606] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:28.865077  2665 ts_tablet_manager.cc:1929] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 13:13:28.865723  2665 log.cc:1199] T b7a9a88da98d43b8a556cba3e2768e28 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/b7a9a88da98d43b8a556cba3e2768e28
I20260709 13:13:28.868827 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "34f51764a89048468a6faa21020812b0"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36690
I20260709 13:13:28.869491 30037 raft_consensus.cc:606] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:28.870896 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:28.873824 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:28.882225 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet b7a9a88da98d43b8a556cba3e2768e28 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:13:28.908129 30739 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:28.910053  2612 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.919869 30187 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:28.924551  2602 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.927942  2586 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.937028 30740 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:28.969276 29932 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 4 to 12, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 16 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:29.017810 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 87968.3us
I20260709 13:13:29.018996 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3facd19034dd44899de7471297d45bbc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:13:29.052448 30182 raft_consensus.cc:2955] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:29.076929 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 47967.9us
I20260709 13:13:29.103340 30028 tablet_service.cc:1558] Processing DeleteTablet for tablet 3facd19034dd44899de7471297d45bbc with delete_type TABLET_DATA_TOMBSTONED (TS 34f51764a89048468a6faa21020812b0 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54298
I20260709 13:13:29.110666  2457 raft_consensus.cc:993] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.111377  2672 raft_consensus.cc:1081] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.112826  2633 raft_consensus.cc:993] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.113574  2633 raft_consensus.cc:1081] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.114130  2673 raft_consensus.cc:993] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.114713  2673 raft_consensus.cc:1081] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.121335 30106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:29.122032 30106 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.122449 30106 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.127187  2675 tablet_replica.cc:333] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:29.128511  2675 raft_consensus.cc:2243] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:29.129329  2675 raft_consensus.cc:2272] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:29.141988  2459 raft_consensus.cc:993] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.147328  2459 raft_consensus.cc:1081] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.149436 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:29.150130 30104 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.150569 30104 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.133299 30113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:29.158149 30113 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.158613 30113 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.165529  2675 ts_tablet_manager.cc:1916] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:29.167719 30106 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.168766 30109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:29.172667 30109 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.173022 30109 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.171286 30104 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:29.176326 30104 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:29.171818 30113 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.177634 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:29.178335 30740 raft_consensus.cc:3055] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:29.178684 30740 raft_consensus.cc:740] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:29.179569 30740 consensus_queue.cc:260] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:29.180312 30109 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.183701 30740 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.187315 30113 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:29.188827 30106 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:29.189685 30109 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:29.194983 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:29.195602 30182 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.202831 30182 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 16.
I20260709 13:13:29.209374 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:29.210026 30030 raft_consensus.cc:3060] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.210484 30740 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:29.211477 30187 raft_consensus.cc:1240] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Rejecting Update request from peer 34f51764a89048468a6faa21020812b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:29.212047 30079 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:29.212927  2612 raft_consensus.cc:2804] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:29.212984 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 71868.4us
I20260709 13:13:29.213588  2612 raft_consensus.cc:697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:29.214533  2612 consensus_queue.cc:237] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:29.219099 30030 raft_consensus.cc:2468] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:29.222443  2673 consensus_queue.cc:1059] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:29.223604  2672 raft_consensus.cc:3055] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:29.224007  2672 raft_consensus.cc:740] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:29.224850  2672 consensus_queue.cc:260] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.225545 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:29.226738 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:29.227371 30180 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.228080 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:29.230698 30033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddff3913cdf4e70a580878770e0b745" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:29.231359 30033 raft_consensus.cc:3055] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:29.231662 30033 raft_consensus.cc:740] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:29.232343  2672 raft_consensus.cc:3060] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.232410 30033 consensus_queue.cc:260] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.238080 30033 raft_consensus.cc:3060] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.226233 30187 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.245875 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:29.246675 30037 raft_consensus.cc:3055] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:29.247066 30037 raft_consensus.cc:740] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:29.248008 30037 consensus_queue.cc:260] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.250999 30077 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:29.265908  2668 raft_consensus.cc:2804] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:29.266489  2668 raft_consensus.cc:697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 16 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:29.249361 30037 raft_consensus.cc:3060] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.267452  2668 consensus_queue.cc:237] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:29.271981 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 44257.1us
I20260709 13:13:29.260149 30180 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:29.283224  2583 raft_consensus.cc:993] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.283737  2583 raft_consensus.cc:1081] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:29.264528 30187 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:29.299480 30104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:13:29.300287 30104 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.300751 30104 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.300918 30077 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:29.306325 30077 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:29.306589 30033 raft_consensus.cc:2468] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:29.307819 30037 raft_consensus.cc:2468] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:29.311108  2602 raft_consensus.cc:2804] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:29.311735  2602 raft_consensus.cc:697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:29.312681  2602 consensus_queue.cc:237] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.307206  2586 raft_consensus.cc:2804] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:29.321319 30104 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.332316  2675 ts_tablet_manager.cc:1929] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:13:29.338734  2675 log.cc:1199] T 3facd19034dd44899de7471297d45bbc P 34f51764a89048468a6faa21020812b0: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/wals/3facd19034dd44899de7471297d45bbc
I20260709 13:13:29.348178 29921 catalog_manager.cc:5028] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): tablet 3facd19034dd44899de7471297d45bbc (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
W20260709 13:13:29.350651 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 44482.6us
I20260709 13:13:29.359303 30104 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 17 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:29.363222 29932 catalog_manager.cc:5697] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 11 to 12, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 12 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.392155 30030 raft_consensus.cc:2468] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 16.
I20260709 13:13:29.410223  2586 raft_consensus.cc:697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:29.412151  2586 consensus_queue.cc:237] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.437783 30030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:29.438578 30030 raft_consensus.cc:3055] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:29.438908 30030 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34f51764a89048468a6faa21020812b0, State: Running, Role: LEADER
I20260709 13:13:29.439695 30030 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.441231 30030 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.459132 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:29.459887 30187 raft_consensus.cc:3060] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.466078 30030 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 17.
I20260709 13:13:29.469110 30077 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:29.480880  2680 raft_consensus.cc:2804] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:29.481521  2680 raft_consensus.cc:697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:29.482646  2680 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:29.479518 30187 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 17.
I20260709 13:13:29.495378 29932 catalog_manager.cc:5697] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 15 to 16, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 16 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.497270 29932 catalog_manager.cc:5697] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 12 to 13, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 13 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.499094 29932 catalog_manager.cc:5697] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 8 to 9, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 9 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.558766 29932 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 16 to 17, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 17 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.635407 30030 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:29.639891  2681 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:29.775923 30180 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:29.778434  2586 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:29.793141 30740 raft_consensus.cc:1275] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:29.794938  2680 consensus_queue.cc:1048] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:29.833025 30030 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:29.836264  2680 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:29.893885 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:29.967870 30180 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:29.991178 30037 raft_consensus.cc:1275] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:30.008056 30037 raft_consensus.cc:1275] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:30.005537  2679 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:13:30.016894 30180 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:30.016721 30182 raft_consensus.cc:1275] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:13:30.004906  2688 log.cc:927] Time spent T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:13:30.049863 30153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 47482us
W20260709 13:13:30.053337 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 48424.9us
W20260709 13:13:30.059263 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 54845us
W20260709 13:13:30.063733 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 61004.3us
I20260709 13:13:30.049021  2696 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:13:30.106989 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 73314us
W20260709 13:13:30.109762 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 80834.1us
I20260709 13:13:30.054605  2602 consensus_queue.cc:1048] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:13:30.117883 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 52127.6us
W20260709 13:13:30.159046  2677 log.cc:927] Time spent T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:30.120225  2680 consensus_queue.cc:1048] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:13:30.207947  2709 consensus_queue.cc:1048] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:30.263496 30109 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:30.277828 30034 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:13:30.293735 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66010.5us
I20260709 13:13:30.365199  2702 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:30.497125 30079 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 729e969847cf4fbcb29c2681ec03a97a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.541504 30178 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:30.544775 30034 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:30.572352  2680 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:30.587007  2602 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:13:30.661275  2704 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:30.681929 30185 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:30.689706 29932 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 15 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.690133 30034 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:30.695899 30187 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:30.776391 30109 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:30.783675  2532 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:13:30.875097 30033 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:30.890717  2708 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:30.896212  2697 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:30.910302 30110 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:13:30.995116 30153 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfbfe72ddc624143b4f12cb68c249a4e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.019225 30033 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
W20260709 13:13:31.065485 30004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 62977.4us
W20260709 13:13:31.072858 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 160988us
W20260709 13:13:31.109153 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 102628us
W20260709 13:13:31.186692 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 57510.8us
I20260709 13:13:31.189070 30034 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.169634 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.221076 30187 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:31.198041 30109 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:31.234930  2701 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:31.289826  2743 ts_tablet_manager.cc:933] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:31.375062  2692 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:31.385656 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 106969us
I20260709 13:13:31.385610 29934 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 8, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:31.465651  2746 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:13:31.515764  2748 ts_tablet_manager.cc:933] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:31.529522 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 55368.1us
I20260709 13:13:31.529682  2743 tablet_copy_client.cc:323] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:13:31.569072  2748 tablet_copy_client.cc:323] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.131:36297
I20260709 13:13:31.581195  2695 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.596412 30180 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
W20260709 13:13:31.615064 30004 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 056561f84fe249b496e33c1560ab5a76. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.618826 30197 tablet_copy_service.cc:140] P ef9ab4d665234a799376bf42ef5d058c: Received BeginTabletCopySession request for tablet cfbfe72ddc624143b4f12cb68c249a4e from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:50696)
I20260709 13:13:31.619617 30197 tablet_copy_service.cc:161] P ef9ab4d665234a799376bf42ef5d058c: Beginning new tablet copy session on tablet cfbfe72ddc624143b4f12cb68c249a4e from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:50696: session id = 8d2f11cccca04a7683da4080ab797bd7-cfbfe72ddc624143b4f12cb68c249a4e
I20260709 13:13:31.624374 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 729e969847cf4fbcb29c2681ec03a97a from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:13:31.625156 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 729e969847cf4fbcb29c2681ec03a97a from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-729e969847cf4fbcb29c2681ec03a97a
I20260709 13:13:31.630839 30113 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.649224 30123 tablet_copy_source_session.cc:215] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:31.659087 30197 tablet_copy_source_session.cc:215] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:31.675408  2748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbfe72ddc624143b4f12cb68c249a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.673920 30108 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:31.687706  2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729e969847cf4fbcb29c2681ec03a97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.720360 29933 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index -1 to 7, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.746517 30180 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:31.748296 30035 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:13:31.749483 30079 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585): Couldn't send request to peer 8d2f11cccca04a7683da4080ab797bd7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ce29391518248688fe4f7fd0e2eee7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.753368  2696 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:31.755060  2602 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:31.761720  2748 tablet_copy_client.cc:806] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:31.762524  2748 tablet_copy_client.cc:670] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:31.773782  2748 tablet_copy_client.cc:538] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:31.808454  2696 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.811122 30035 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.848119  2759 ts_tablet_manager.cc:933] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437)
I20260709 13:13:31.854722 30182 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.859424 29932 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 reported cstate change: config changed from index -1 to 11, NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) added. New cstate: current_term: 17 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } }
I20260709 13:13:31.865417  2748 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:13:31.891396  2759 tablet_copy_client.cc:323] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.129:39437
I20260709 13:13:31.892652  2743 tablet_copy_client.cc:806] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:31.893373  2743 tablet_copy_client.cc:670] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:31.894236 30048 tablet_copy_service.cc:140] P 34f51764a89048468a6faa21020812b0: Received BeginTabletCopySession request for tablet 056561f84fe249b496e33c1560ab5a76 from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:44710)
I20260709 13:13:31.894884 30048 tablet_copy_service.cc:161] P 34f51764a89048468a6faa21020812b0: Beginning new tablet copy session on tablet 056561f84fe249b496e33c1560ab5a76 from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:44710: session id = 8d2f11cccca04a7683da4080ab797bd7-056561f84fe249b496e33c1560ab5a76
I20260709 13:13:31.924055  2743 tablet_copy_client.cc:538] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:31.921197 30048 tablet_copy_source_session.cc:215] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:13:31.933992  2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056561f84fe249b496e33c1560ab5a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.972913  2759 tablet_copy_client.cc:806] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:31.973570  2759 tablet_copy_client.cc:670] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:31.993487  2759 tablet_copy_client.cc:538] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:32.003521  2743 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:13:32.008659 30737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b"
dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
mode: GRACEFUL
new_leader_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:43916
I20260709 13:13:32.009449 30737 raft_consensus.cc:606] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Received request to transfer leadership to TS 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:32.011160 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:32.012997 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.007117  2759 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:13:32.103228  2748 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:32.126505  2748 tablet_bootstrap.cc:492] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:13:32.134163  2748 ts_tablet_manager.cc:1403] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.271s	user 0.042s	sys 0.006s
I20260709 13:13:32.144662  2748 raft_consensus.cc:359] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.149567  2748 raft_consensus.cc:740] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:13:32.153991  2748 consensus_queue.cc:260] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.182827  2759 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:32.194011  2759 tablet_bootstrap.cc:492] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:13:32.194895  2759 ts_tablet_manager.cc:1403] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.188s	user 0.031s	sys 0.008s
I20260709 13:13:32.179129  2748 ts_tablet_manager.cc:1434] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:13:32.198105  2759 raft_consensus.cc:359] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.202363  2759 raft_consensus.cc:740] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:13:32.203467  2759 consensus_queue.cc:260] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.206472  2759 ts_tablet_manager.cc:1434] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:32.210983 30197 tablet_copy_service.cc:342] P ef9ab4d665234a799376bf42ef5d058c: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-cfbfe72ddc624143b4f12cb68c249a4e received from {username='slave'} at 127.0.0.1:50696
I20260709 13:13:32.211661 30197 tablet_copy_service.cc:434] P ef9ab4d665234a799376bf42ef5d058c: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-cfbfe72ddc624143b4f12cb68c249a4e on tablet cfbfe72ddc624143b4f12cb68c249a4e with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:32.215380 30048 tablet_copy_service.cc:342] P 34f51764a89048468a6faa21020812b0: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-056561f84fe249b496e33c1560ab5a76 received from {username='slave'} at 127.0.0.1:44710
I20260709 13:13:32.215878 30048 tablet_copy_service.cc:434] P 34f51764a89048468a6faa21020812b0: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-056561f84fe249b496e33c1560ab5a76 on tablet 056561f84fe249b496e33c1560ab5a76 with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:32.263336  2743 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:32.264315  2743 tablet_bootstrap.cc:492] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:13:32.265092  2743 ts_tablet_manager.cc:1403] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.262s	user 0.042s	sys 0.005s
I20260709 13:13:32.268707  2743 raft_consensus.cc:359] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.270044  2743 raft_consensus.cc:740] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:13:32.270862  2743 consensus_queue.cc:260] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:32.285940  2743 ts_tablet_manager.cc:1434] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:13:32.294693 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-729e969847cf4fbcb29c2681ec03a97a received from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:32.295238 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-729e969847cf4fbcb29c2681ec03a97a on tablet 729e969847cf4fbcb29c2681ec03a97a with peer 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:32.301944  2759 ts_tablet_manager.cc:933] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Initiating tablet copy from peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:32.314121  2759 tablet_copy_client.cc:323] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.62.130:38581
I20260709 13:13:32.323511 30737 raft_consensus.cc:1217] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:13:32.329196 30123 tablet_copy_service.cc:140] P 98b3b699b87245df85d3aa84c13f5691: Received BeginTabletCopySession request for tablet 9ce29391518248688fe4f7fd0e2eee7a from peer 8d2f11cccca04a7683da4080ab797bd7 ({username='slave'} at 127.0.0.1:36342)
I20260709 13:13:32.329911 30123 tablet_copy_service.cc:161] P 98b3b699b87245df85d3aa84c13f5691: Beginning new tablet copy session on tablet 9ce29391518248688fe4f7fd0e2eee7a from peer 8d2f11cccca04a7683da4080ab797bd7 at {username='slave'} at 127.0.0.1:36342: session id = 8d2f11cccca04a7683da4080ab797bd7-9ce29391518248688fe4f7fd0e2eee7a
I20260709 13:13:32.347185 30123 tablet_copy_source_session.cc:215] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:13:32.459645 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 77742.1us
I20260709 13:13:32.472595  2759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce29391518248688fe4f7fd0e2eee7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.546540 30737 raft_consensus.cc:1217] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:13:32.622511 30737 raft_consensus.cc:1217] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:13:32.625351  2759 tablet_copy_client.cc:806] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 0 data blocks...
I20260709 13:13:32.626116  2759 tablet_copy_client.cc:670] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Starting download of 1 WAL segments...
I20260709 13:13:32.650552  2715 raft_consensus.cc:993] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: : Instructing follower 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:32.651284  2751 raft_consensus.cc:1081] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Signalling peer 98b3b699b87245df85d3aa84c13f5691 to start an election
I20260709 13:13:32.656709 30108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b"
dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
 from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:32.657385 30108 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.657735 30108 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:32.664072  2759 tablet_copy_client.cc:538] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:13:32.671602 30108 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:32.675334  2759 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap starting.
I20260709 13:13:32.684726 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "34f51764a89048468a6faa21020812b0"
I20260709 13:13:32.685169 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:32.685961 30740 raft_consensus.cc:3055] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:32.686304 30740 raft_consensus.cc:740] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:32.687150 30740 consensus_queue.cc:260] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:32.688380 30740 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:32.685513 30035 raft_consensus.cc:3060] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:32.739434 30035 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:32.742048 30108 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:32.746100 30740 raft_consensus.cc:2468] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:32.750293 30077 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691; no voters: 
I20260709 13:13:32.751253  2602 raft_consensus.cc:2804] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:32.751806  2602 raft_consensus.cc:697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:32.752807  2602 consensus_queue.cc:237] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:32.802942 29933 catalog_manager.cc:5697] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 11 to 12, leader changed from 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 12 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.938094  2767 raft_consensus.cc:1064] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:13:32.963478  2708 raft_consensus.cc:1064] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:13:32.967064  2708 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:32.983693  2767 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:33.016395 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:33.027666  2759 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:13:33.041642  2775 raft_consensus.cc:1064] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:13:33.045006  2775 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:33.061834 30740 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEARNER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:33.063850 30187 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:33.065564  2772 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:33.066303 30108 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer 34f51764a89048468a6faa21020812b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:33.066597  2773 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:33.069283  2766 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:13:33.097986 30034 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:33.099437 30737 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEARNER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:33.102092 30106 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:33.105495  2714 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:33.108352  2674 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:33.119969  2708 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:13:33.178658 30182 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:33.179189 30030 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:33.188450 30737 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:33.206490  2786 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:13:33.227623  2741 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.228868  2602 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:33.233686  2586 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:13:33.261861 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 59179.3us
I20260709 13:13:33.252542 30740 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.298390  2759 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:33.303135  2708 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.313197  2759 tablet_bootstrap.cc:492] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Bootstrap complete.
I20260709 13:13:33.314131  2759 ts_tablet_manager.cc:1403] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Time spent bootstrapping tablet: real 0.639s	user 0.055s	sys 0.009s
I20260709 13:13:33.338016 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:13:33.342064  2759 raft_consensus.cc:359] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:33.343232  2759 raft_consensus.cc:740] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Initialized, Role: LEARNER
I20260709 13:13:33.349695 30106 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.352169 30079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:36585, user_credentials={real_user=slave}} blocked reactor thread for 82850.9us
W20260709 13:13:33.360598 30151 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:13:33.344066  2759 consensus_queue.cc:260] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:33.371397 30737 raft_consensus.cc:1275] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:33.391374 29932 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 7 to 8, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "34f51764a89048468a6faa21020812b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.419409  2759 ts_tablet_manager.cc:1434] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
W20260709 13:13:33.427162 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 66248.9us
I20260709 13:13:33.419409  2786 consensus_queue.cc:1048] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:13:33.436084 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 54941.7us
I20260709 13:13:33.453871 30106 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.467504 30123 tablet_copy_service.cc:342] P 98b3b699b87245df85d3aa84c13f5691: Request end of tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9ce29391518248688fe4f7fd0e2eee7a received from {username='slave'} at 127.0.0.1:36342
I20260709 13:13:33.468055 30123 tablet_copy_service.cc:434] P 98b3b699b87245df85d3aa84c13f5691: ending tablet copy session 8d2f11cccca04a7683da4080ab797bd7-9ce29391518248688fe4f7fd0e2eee7a on tablet 9ce29391518248688fe4f7fd0e2eee7a with peer 8d2f11cccca04a7683da4080ab797bd7
W20260709 13:13:33.491003  2783 log.cc:927] Time spent T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:13:33.512905  2790 log.cc:927] Time spent T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
W20260709 13:13:33.518980 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.520872 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.522020  2791 log.cc:927] Time spent T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:13:33.511685 29933 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 8 to 9, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.526463 30180 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.539783 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.546730 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 170608us
I20260709 13:13:33.556077 30739 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.566610 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.570269 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 48691.4us
W20260709 13:13:33.572309 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.574999 30734 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.573653  2602 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.584153 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.590147 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.599882 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.602810 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.626154 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.634299 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.637748 30151 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.624792 30187 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.666776 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.667886 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.668551 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.665232 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.703421 30739 raft_consensus.cc:1217] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:13:33.718580 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.733959 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 52629.6us
W20260709 13:13:33.746549 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.719194 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.748744 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.749579 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.755688 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.756049 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.778892 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.782860 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.786788 29931 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:33.821110 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.821877 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.822451 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.852414 30106 consensus_queue.cc:237] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:33.854858 30002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 101494us
W20260709 13:13:33.864645 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.876024 30001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 118379us
I20260709 13:13:33.916865 30740 raft_consensus.cc:1275] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:13:33.918366 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.918819  2602 consensus_queue.cc:1048] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:33.922672 29921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 94947.8us
W20260709 13:13:33.924638 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.951862 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.951236 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.952823 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:33.970877 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.983605  2793 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:33.989634 30740 raft_consensus.cc:2955] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.004601 30187 consensus_queue.cc:237] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:34.006850 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): ChangeConfig:REMOVE_PEER RPC failed for tablet 056561f84fe249b496e33c1560ab5a76: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:34.058615 29920 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 729e969847cf4fbcb29c2681ec03a97a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:34.060513 30106 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:34.073851 30737 raft_consensus.cc:1275] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:34.076205  2770 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:13:34.086104  2774 consensus_queue.cc:1048] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:34.088483 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:34.136641  2674 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.159102 30737 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.202232  2602 raft_consensus.cc:1064] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: attempting to promote NON_VOTER 8d2f11cccca04a7683da4080ab797bd7 to VOTER
I20260709 13:13:34.206370 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfbfe72ddc624143b4f12cb68c249a4e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:34.219811  2767 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.224527  2767 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.226706  2767 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.230376  2767 raft_consensus.cc:493] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.231112 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:34.233358 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.236701 28922 tablet_replica.cc:333] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.237632 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14e2286ffc64880b1518c6743938daa" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.241582 28922 raft_consensus.cc:2243] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.242364 28922 raft_consensus.cc:2272] T b7398efc3342427c8ca63da3a989684d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.205152  2602 consensus_queue.cc:237] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.231072  2767 raft_consensus.cc:515] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.269979  2767 leader_election.cc:290] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.271829 28922 tablet_replica.cc:333] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.272956 28922 raft_consensus.cc:2243] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.274196 28922 raft_consensus.cc:2272] T 9ddff3913cdf4e70a580878770e0b745 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.273780 29931 catalog_manager.cc:5697] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 12 to 13, VOTER ef9ab4d665234a799376bf42ef5d058c (127.28.62.131) evicted. New cstate: current_term: 15 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.284534 30001 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.288074  2803 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:34.298745 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.303277 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7dd6e303964f99bd9728c2f53891af" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.325706 30004 leader_election.cc:304] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.312606 28922 tablet_replica.cc:333] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.333046 30170 tablet_service.cc:1558] Processing DeleteTablet for tablet 729e969847cf4fbcb29c2681ec03a97a with delete_type TABLET_DATA_TOMBSTONED (TS ef9ab4d665234a799376bf42ef5d058c not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:33114
I20260709 13:13:34.333899 28922 raft_consensus.cc:2243] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.339772  2803 raft_consensus.cc:2749] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:34.355791 28922 raft_consensus.cc:2272] T 42209a176ad44af88b5b1710846183cb P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.359002  2814 raft_consensus.cc:493] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.360198 28922 tablet_replica.cc:333] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.370615 28922 raft_consensus.cc:2243] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.371721 28922 pending_rounds.cc:70] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Trying to abort 1 pending ops.
I20260709 13:13:34.359733  2814 raft_consensus.cc:515] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.376922  2814 leader_election.cc:290] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.379223 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.379657 29931 catalog_manager.cc:5697] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 9 to 10, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.392349  2816 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.392982  2816 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.395126  2819 tablet_replica.cc:333] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:34.395301  2816 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.396421  2819 raft_consensus.cc:2243] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.398778 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.378748 28922 pending_rounds.cc:77] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0: Aborting op as it isn't in flight: id { term: 11 index: 9 } timestamp: 7305637121904611328 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "cfbfe72ddc624143b4f12cb68c249a4e" old_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } } new_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } attrs { replace: true } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } } }
I20260709 13:13:34.400427 28922 raft_consensus.cc:2917] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Aborting config change with OpId 11.9: Aborted: Op aborted
I20260709 13:13:34.400930 28922 raft_consensus.cc:2889] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:13:34.401312 28922 raft_consensus.cc:2272] T cfbfe72ddc624143b4f12cb68c249a4e P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.402812 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db55e372a60b4a1a9c52676be275cf56" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.404630 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3976f5c231948d6bd8a5345ec54d5d5" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.397374  2819 raft_consensus.cc:2272] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.403847  2816 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.415040  2816 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.419551 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.424006  2816 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.426999 30110 raft_consensus.cc:2955] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 34f51764a89048468a6faa21020812b0 (127.28.62.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.429524 28922 tablet_replica.cc:333] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.432168 28922 raft_consensus.cc:2243] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.436228 30739 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEARNER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:34.436559 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16b5c6cb31b4fa0bba89be17ed2c0c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.433144 28922 raft_consensus.cc:2272] T 0285ca89cc9843cab1c6899c6f83dd16 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.439164 30001 leader_election.cc:304] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.442373 30001 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.444005 30187 raft_consensus.cc:1275] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:34.441233 30002 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.441830  2767 raft_consensus.cc:2749] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:34.452257  2803 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.446269  2814 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.457350  2814 raft_consensus.cc:493] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.457957  2814 raft_consensus.cc:515] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.460071  2814 leader_election.cc:290] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.444319  2792 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:13:34.478902  2786 consensus_queue.cc:1048] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:34.480528 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.483783  2772 raft_consensus.cc:493] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.484422  2803 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.484537  2772 raft_consensus.cc:515] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.485100  2803 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.486958  2772 leader_election.cc:290] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.490120 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.483968  2767 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.491627 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.492544  2767 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.494825  2816 raft_consensus.cc:493] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.495599  2767 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.495771  2816 raft_consensus.cc:515] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.498404  2816 leader_election.cc:290] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.487129  2803 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:34.503345  2818 log.cc:927] Time spent T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:34.513520 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.509310 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef9600254f4d48368aff10ed883134fd" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.517588 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.518891 28922 tablet_replica.cc:333] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.519305  2814 raft_consensus.cc:493] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.519935  2814 raft_consensus.cc:515] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.520932 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39df33df3e0d43b5a35e334a03324f92" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.522452 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f8dc2d031b14a58b3ed72d7a06855e1" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.522655  2814 leader_election.cc:290] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.523495 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b108c73739d43d89aafdc212aae9d1b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.524355 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c855bd93d50418aa0aec7a1a3c2e228" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.519913 28922 raft_consensus.cc:2243] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.547353 28922 raft_consensus.cc:2272] T d14e2286ffc64880b1518c6743938daa P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.554893 30001 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.562534 28922 tablet_replica.cc:333] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.564556  2767 raft_consensus.cc:493] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.565137  2767 raft_consensus.cc:515] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.556283  2816 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.566162  2816 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.567270  2767 leader_election.cc:290] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.568192  2816 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.571739 30002 leader_election.cc:304] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.574393 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.577934 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.579373 28922 raft_consensus.cc:2243] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.583352  2767 raft_consensus.cc:2749] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:34.584169  2741 raft_consensus.cc:2706] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Received pre-election callback for term 13 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:13:34.594331 28922 raft_consensus.cc:2272] T 9b108c73739d43d89aafdc212aae9d1b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.594537 30002 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.596401 30002 leader_election.cc:304] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.597787  2814 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:34.597803  2741 raft_consensus.cc:2749] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:34.599027  2819 ts_tablet_manager.cc:1916] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:34.600878 30002 leader_election.cc:304] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.604904 28922 tablet_replica.cc:333] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.609489  2741 raft_consensus.cc:2749] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:34.610942 28922 raft_consensus.cc:2243] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.611773 28922 raft_consensus.cc:2272] T 814415efcb8c4963a2b88aafeeaa75bb P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.614517  2741 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.615391  2741 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.618036 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.619099  2741 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.624848 28922 tablet_replica.cc:333] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.626088 28922 raft_consensus.cc:2243] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:34.647621 28922 raft_consensus.cc:2272] T f3d5b014e8a54181ad5978055b4514b4 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.647850  2767 raft_consensus.cc:493] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.648182  2772 raft_consensus.cc:493] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.648644  2767 raft_consensus.cc:515] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.648823  2772 raft_consensus.cc:515] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.653957 28922 tablet_replica.cc:333] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.651635  2767 leader_election.cc:290] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.656100  2803 raft_consensus.cc:493] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.656620  2803 raft_consensus.cc:515] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.657717  2767 raft_consensus.cc:493] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.658421  2767 raft_consensus.cc:515] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.662623  2767 leader_election.cc:290] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.663493  2772 leader_election.cc:290] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.647984  2766 raft_consensus.cc:493] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.674368  2766 raft_consensus.cc:515] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.676829  2766 leader_election.cc:290] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.677029 28922 raft_consensus.cc:2243] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.679361 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.679764 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.680089  2766 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.681058  2766 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.684705 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.684788 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.685453 28922 raft_consensus.cc:2272] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.685469  2767 raft_consensus.cc:493] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.687175  2767 raft_consensus.cc:515] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.664940  2741 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.693051  2741 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.695447  2741 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.667583  2803 leader_election.cc:290] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.669574  2814 raft_consensus.cc:493] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.664381 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.696501  2814 raft_consensus.cc:515] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.687628  2766 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.689181 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e06bbfa07cb545c8b65a4a6f1dae9516" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.689278  2775 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.698868  2814 leader_election.cc:290] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.699263  2766 raft_consensus.cc:493] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8d2f11cccca04a7683da4080ab797bd7)
I20260709 13:13:34.699909  2766 raft_consensus.cc:515] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.702725  2766 leader_election.cc:290] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.711313 28922 tablet_replica.cc:333] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.716905 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b7d91eea54fb4990789f41041df86" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.718271 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.719601 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99bf410d55b470d8191aa69458330db" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.757781 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.759227 28922 raft_consensus.cc:2243] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.759938 28922 raft_consensus.cc:2272] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.760699  2772 raft_consensus.cc:493] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.761221  2772 raft_consensus.cc:515] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.761420 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.763314  2772 leader_election.cc:290] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.767305 28922 tablet_replica.cc:333] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.768381 30739 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.775354  2767 leader_election.cc:290] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.777034 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0bc2d269504461f9c5ae0cdf5385b9b" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.784662 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6065fdc6916b4a589b781d16204e51c6" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.790251 28922 raft_consensus.cc:2243] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.795535 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813e1f3ea7f7411c9c6061753e927dfe" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.797202 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.801688  2772 raft_consensus.cc:493] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.802392  2772 raft_consensus.cc:515] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:34.804966  2772 leader_election.cc:290] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:34.805760 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.807201 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.807631 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc08410209249758a644676ff99841d" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.807708 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9e5e8f77524a8e8e19542c915fb343" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.808461 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d91f22e2654dd1ae5451605e7a3b23" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.810195 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15751030df864f9c84e3d822bc8b63e3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.810981 28922 raft_consensus.cc:2272] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.810473 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92792ac48d644c99ac833ab354f052c3" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.812489 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f2e33addec48d89bb483d29ce55ad4" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.814374 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.815099 30002 leader_election.cc:304] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.816954  2816 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:34.818183  2816 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:34.820458  2816 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.831466 28922 tablet_replica.cc:333] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.834124 28922 raft_consensus.cc:2243] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.834184 30002 leader_election.cc:304] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.835547 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:34.836086  2767 raft_consensus.cc:2749] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:34.835037 28922 pending_rounds.cc:70] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Trying to abort 1 pending ops.
I20260709 13:13:34.836705  2741 raft_consensus.cc:2749] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.836860 28922 pending_rounds.cc:77] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0: Aborting op as it isn't in flight: id { term: 15 index: 12 } timestamp: 7305637122224287744 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "729e969847cf4fbcb29c2681ec03a97a" old_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } } } new_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } } }
I20260709 13:13:34.845460  2772 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:34.846799 29933 catalog_manager.cc:5697] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.847815  2772 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: NON_VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: true } }
I20260709 13:13:34.838289 28922 raft_consensus.cc:2917] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Aborting config change with OpId 15.12: Aborted: Op aborted
I20260709 13:13:34.838081 30002 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.849686 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb153e5e2ed243b6a7741de46f707450" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.851059 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.873611  2816 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.812834  2819 ts_tablet_manager.cc:1929] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:13:34.877476  2819 log.cc:1199] T 729e969847cf4fbcb29c2681ec03a97a P ef9ab4d665234a799376bf42ef5d058c: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/wals/729e969847cf4fbcb29c2681ec03a97a
I20260709 13:13:34.870657 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.872138 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:34.881107 29921 catalog_manager.cc:5028] TS ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): tablet 729e969847cf4fbcb29c2681ec03a97a (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
I20260709 13:13:34.882099 30001 leader_election.cc:304] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.882978  2816 raft_consensus.cc:2749] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:34.884239 30001 leader_election.cc:304] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.877580  2772 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:34.868394 28922 raft_consensus.cc:2889] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:13:34.886197 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6920367ae7ee4f54a639b9db0e071e84" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.886549 30001 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.886205 28922 raft_consensus.cc:2272] T 729e969847cf4fbcb29c2681ec03a97a P 34f51764a89048468a6faa21020812b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.876672 30185 raft_consensus.cc:2955] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:34.885143  2816 raft_consensus.cc:2749] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:34.887356  2772 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.890496 28922 tablet_replica.cc:333] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.891528 28922 raft_consensus.cc:2243] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:34.891403 30001 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.892381  2816 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:34.893179 28922 raft_consensus.cc:2272] T 1df0056e71a84e3aa2756ee599e24a66 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.895853 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a672a61589048279810adba842422a0" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.896025 30001 leader_election.cc:304] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.897564 30001 leader_election.cc:304] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.898291  2816 raft_consensus.cc:2749] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:34.898991  2816 raft_consensus.cc:2749] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:34.900228 30001 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.901091 28922 tablet_replica.cc:333] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0: stopping tablet replica
W20260709 13:13:34.905308 30001 raft_consensus.cc:2686] T 15751030df864f9c84e3d822bc8b63e3 P 34f51764a89048468a6faa21020812b0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:13:34.906330 30001 leader_election.cc:304] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
W20260709 13:13:34.907042 30001 raft_consensus.cc:2686] T 92792ac48d644c99ac833ab354f052c3 P 34f51764a89048468a6faa21020812b0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:13:34.905369 28922 raft_consensus.cc:2243] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:34.909181 28922 raft_consensus.cc:2272] T d11240e2763045ecaa6122102420302e P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:34.911664 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:34.913709 30001 leader_election.cc:304] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.915030  2816 raft_consensus.cc:2749] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:34.917266 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d12004749df410ea5dcce097780c358" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.923559 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.924873 28922 tablet_replica.cc:333] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.925892 28922 raft_consensus.cc:2243] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.928049 28922 raft_consensus.cc:2272] T e3976f5c231948d6bd8a5345ec54d5d5 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.932922 30001 leader_election.cc:304] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:34.933820  2816 raft_consensus.cc:2749] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:34.932099 28922 tablet_replica.cc:333] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.939123 28922 raft_consensus.cc:2243] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:34.940488 28922 raft_consensus.cc:2272] T 056561f84fe249b496e33c1560ab5a76 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.945945 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "34f51764a89048468a6faa21020812b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:34.959586 28922 tablet_replica.cc:333] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.961597 30002 leader_election.cc:304] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.964345  2816 raft_consensus.cc:2749] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.966066 30002 leader_election.cc:304] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.967355 30002 leader_election.cc:304] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.968915  2772 raft_consensus.cc:2749] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.969787  2772 raft_consensus.cc:2749] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:34.970889 28922 raft_consensus.cc:2243] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:34.971757 28922 raft_consensus.cc:2272] T 6d7dd6e303964f99bd9728c2f53891af P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:34.971792 30002 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.973610  2816 raft_consensus.cc:2749] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.977336 30002 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f51764a89048468a6faa21020812b0; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:34.980655  2816 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:34.989849 28922 tablet_replica.cc:333] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:34.990783 28922 raft_consensus.cc:2243] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:34.991859 28922 raft_consensus.cc:2272] T 722cf622ecb54a338f6b0c13e1ce9bed P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.019120 28922 tablet_replica.cc:333] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.020040 28922 raft_consensus.cc:2243] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.020613 28922 raft_consensus.cc:2272] T d99bf410d55b470d8191aa69458330db P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.025974 28922 tablet_replica.cc:333] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
W20260709 13:13:35.031739 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:13:35.026819 28922 raft_consensus.cc:2243] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.037623 28922 raft_consensus.cc:2272] T f86541372f8c463da3fe465d9c571876 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.043707 28922 tablet_replica.cc:333] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.044595 28922 raft_consensus.cc:2243] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.056658 28922 raft_consensus.cc:2272] T 9d12004749df410ea5dcce097780c358 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.060333 28922 tablet_replica.cc:333] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.061300 28922 raft_consensus.cc:2243] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.062023 28922 raft_consensus.cc:2272] T db55e372a60b4a1a9c52676be275cf56 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.083330 28922 tablet_replica.cc:333] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.084273 28922 raft_consensus.cc:2243] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.085417 28922 raft_consensus.cc:2272] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.105954 28922 tablet_replica.cc:333] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.107050 28922 raft_consensus.cc:2243] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.118628 28922 raft_consensus.cc:2272] T 2a3a1d04afff45a7a0def29171749edf P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.177742 28922 tablet_replica.cc:333] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.178735 28922 raft_consensus.cc:2243] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.179490 28922 raft_consensus.cc:2272] T 76d91f22e2654dd1ae5451605e7a3b23 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.201625 28922 tablet_replica.cc:333] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.202522 28922 raft_consensus.cc:2243] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.258936 28922 raft_consensus.cc:2272] T fd9e5e8f77524a8e8e19542c915fb343 P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.277760 28922 tablet_replica.cc:333] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.283725 28922 raft_consensus.cc:2243] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.286121 28922 raft_consensus.cc:2272] T ef9600254f4d48368aff10ed883134fd P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.289587 28922 tablet_replica.cc:333] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.290496 28922 raft_consensus.cc:2243] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.291386 28922 raft_consensus.cc:2272] T 9ce29391518248688fe4f7fd0e2eee7a P 34f51764a89048468a6faa21020812b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.352923 28922 tablet_replica.cc:333] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.354728 28922 raft_consensus.cc:2243] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.362320 28922 raft_consensus.cc:2272] T 396297d3a2474246b40507f61f59858c P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.370796 28922 tablet_replica.cc:333] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.371616 28922 raft_consensus.cc:2243] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.372808 28922 raft_consensus.cc:2272] T 838f13bafde24742a950e2e4d62e21e9 P 34f51764a89048468a6faa21020812b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.388417 28922 tablet_replica.cc:333] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.389329 28922 raft_consensus.cc:2243] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.390115 28922 raft_consensus.cc:2272] T 0c855bd93d50418aa0aec7a1a3c2e228 P 34f51764a89048468a6faa21020812b0 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.393023 28922 tablet_replica.cc:333] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.394055 28922 raft_consensus.cc:2243] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.394754 28922 raft_consensus.cc:2272] T 6920367ae7ee4f54a639b9db0e071e84 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.404395 28922 tablet_replica.cc:333] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.405355 28922 raft_consensus.cc:2243] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.406081 28922 raft_consensus.cc:2272] T cb153e5e2ed243b6a7741de46f707450 P 34f51764a89048468a6faa21020812b0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.409160 28922 tablet_replica.cc:333] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.410040 28922 raft_consensus.cc:2243] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.411116 28922 raft_consensus.cc:2272] T b7a9a88da98d43b8a556cba3e2768e28 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.414069 28922 tablet_replica.cc:333] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.414891 28922 raft_consensus.cc:2243] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.415693 28922 raft_consensus.cc:2272] T bbc08410209249758a644676ff99841d P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.419085 28922 tablet_replica.cc:333] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.420004 28922 raft_consensus.cc:2243] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.420717 28922 raft_consensus.cc:2272] T e0f2e33addec48d89bb483d29ce55ad4 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.423759 28922 tablet_replica.cc:333] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.424692 28922 raft_consensus.cc:2243] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.425318 28922 raft_consensus.cc:2272] T e06bbfa07cb545c8b65a4a6f1dae9516 P 34f51764a89048468a6faa21020812b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.428418 28922 tablet_replica.cc:333] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.429243 28922 raft_consensus.cc:2243] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.429989 28922 raft_consensus.cc:2272] T 813e1f3ea7f7411c9c6061753e927dfe P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.432900 28922 tablet_replica.cc:333] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.439363 28922 raft_consensus.cc:2243] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.440524 28922 raft_consensus.cc:2272] T 01f7556bbcd34819a44043784cacf8b2 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.443449 28922 tablet_replica.cc:333] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.444366 28922 raft_consensus.cc:2243] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.445688 28922 raft_consensus.cc:2272] T 0d31c2ecc47149adb9b7dd839def365c P 34f51764a89048468a6faa21020812b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.466197 28922 tablet_replica.cc:333] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.467111 28922 raft_consensus.cc:2243] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.467825 28922 raft_consensus.cc:2272] T 88e3e05564894b51b12ceb093978f695 P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.471088 28922 tablet_replica.cc:333] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.471928 28922 raft_consensus.cc:2243] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.473008 28922 raft_consensus.cc:2272] T 3ff2caa8c9ec4f85b73c3be44168d116 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.475903 28922 tablet_replica.cc:333] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.476673 28922 raft_consensus.cc:2243] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.489815 28922 raft_consensus.cc:2272] T dadd68eba45b4971b4072c8ef0de88d5 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.493352 28922 tablet_replica.cc:333] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.494212 28922 raft_consensus.cc:2243] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.495411 28922 raft_consensus.cc:2272] T 4c91803ea87d43adb17baf51a5093b3c P 34f51764a89048468a6faa21020812b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.498665 28922 tablet_replica.cc:333] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.501669 28922 raft_consensus.cc:2243] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.502394 28922 raft_consensus.cc:2272] T 2c1b7d91eea54fb4990789f41041df86 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.510321 28922 tablet_replica.cc:333] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.511186 28922 raft_consensus.cc:2243] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.512048 28922 raft_consensus.cc:2272] T 7a672a61589048279810adba842422a0 P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.514858 28922 tablet_replica.cc:333] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
W20260709 13:13:35.515400 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.515610 28922 raft_consensus.cc:2243] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.516558 28922 raft_consensus.cc:2272] T 6065fdc6916b4a589b781d16204e51c6 P 34f51764a89048468a6faa21020812b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.535684 28922 tablet_replica.cc:333] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.536463 28922 raft_consensus.cc:2243] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.537245 28922 raft_consensus.cc:2272] T c0bc2d269504461f9c5ae0cdf5385b9b P 34f51764a89048468a6faa21020812b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.541182 28922 tablet_replica.cc:333] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0: stopping tablet replica
I20260709 13:13:35.542025 28922 raft_consensus.cc:2243] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.542802 28922 raft_consensus.cc:2272] T 39df33df3e0d43b5a35e334a03324f92 P 34f51764a89048468a6faa21020812b0 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:35.773967 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.799145 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.800508 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.800983  2829 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:35.801682  2829 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:35.804484  2829 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:35.818634 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.819958  2829 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:35.820706  2829 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:35.826997 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:35.836493  2829 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:35.838136 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:35.841864 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:35.845933 30705 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:35.846987  2796 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:35.850065 30705 leader_election.cc:336] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:35.850589 30705 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:35.861364  2796 raft_consensus.cc:2749] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:35.939177 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.942157 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.945079 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.951053 30705 leader_election.cc:336] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:35.952093 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.954877 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:35.955042 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.971014  2714 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:35.971598  2714 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:35.974639 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:35.991724  2714 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:35.994325 30151 leader_election.cc:336] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.021136 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.021672 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.024013  2602 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.024682  2602 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.026744  2602 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:36.028504 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.033290 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.034981 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:36.035526 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.035678 30739 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:36.038331 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.039098  2714 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.039541  2714 raft_consensus.cc:493] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.039928  2714 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:36.061913 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.064508 30077 leader_election.cc:336] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.065460  2832 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.066071  2832 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.068470  2832 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.065071 30077 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.075670  2831 raft_consensus.cc:2749] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:36.077979 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.097112 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.073601  2714 raft_consensus.cc:515] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:36.074847 30151 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.098215 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.100308  2714 leader_election.cc:290] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:36.103309 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.105517 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d5b014e8a54181ad5978055b4514b4" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:36.106221 30740 raft_consensus.cc:3060] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:36.110574 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.105574 30151 leader_election.cc:336] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.122673  2832 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.123373  2832 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.125806  2832 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.128603 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:36.130026  2832 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:36.125427 30740 raft_consensus.cc:2468] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 15.
I20260709 13:13:36.131996 30153 leader_election.cc:304] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.132936  2832 raft_consensus.cc:2804] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:36.133665  2832 raft_consensus.cc:697] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 15 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:36.134621  2832 consensus_queue.cc:237] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:36.137423 30151 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.143636 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.149256 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:36.150563  2714 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:36.151961 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.153998 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.177066 29934 catalog_manager.cc:5697] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 14 to 15, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 15 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.191105  2831 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.191797  2831 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:36.206167 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.209525  2831 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:36.210049 30077 leader_election.cc:336] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.210534 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:36.211134 30740 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:36.211323 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:36.212078 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.214794 30077 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.216068  2831 raft_consensus.cc:2749] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:36.218053  2714 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.218684  2714 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.222362 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.222892 30109 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:13:36.233969 30151 leader_election.cc:336] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.234066  2714 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:36.241058 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.246644 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:36.247437 30740 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
W20260709 13:13:36.248329 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.249286 30153 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.251031  2714 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:36.251540  2714 raft_consensus.cc:493] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.251947  2714 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.268352  2714 raft_consensus.cc:515] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:36.278537 30151 leader_election.cc:336] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.280347  2602 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.280941  2602 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.282068 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.282646 30109 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.283010  2602 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.287622 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.288416 30180 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 14.
I20260709 13:13:36.291251 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.292057  2602 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.292428  2602 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.292758  2602 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:36.294307 30077 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.295490  2831 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.296032  2831 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.298295  2831 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.299268  2770 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.303450  2821 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.313678  2770 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.313997  2821 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.316148  2770 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.316257  2821 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.313736 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "056561f84fe249b496e33c1560ab5a76" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:36.317464 30740 raft_consensus.cc:3060] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.319591 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.319989 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.320288 30113 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:36.299363  2602 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.324604  2602 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.295512 30109 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:36.303368 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.338197 30180 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:36.340569 30740 raft_consensus.cc:2468] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
W20260709 13:13:36.327369 30077 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.312580  2714 leader_election.cc:290] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:36.325132 30151 leader_election.cc:336] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.350910 30077 leader_election.cc:336] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.351222 30150 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.351423 30077 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.352196  2602 raft_consensus.cc:2749] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:36.352833  2714 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:36.353245  2714 raft_consensus.cc:493] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.353643  2714 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.355571  2602 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.356392  2602 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.352262 30077 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.358196 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.359146  2821 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:36.359552  2821 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.359964  2821 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.360416  2602 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:36.365924 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.366976 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df0056e71a84e3aa2756ee599e24a66" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:36.367656 30180 raft_consensus.cc:3060] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.372995  2714 raft_consensus.cc:515] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.375841 30153 leader_election.cc:304] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.379659  2770 raft_consensus.cc:2804] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:36.380295  2770 raft_consensus.cc:697] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:36.383149  2770 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.384016  2714 leader_election.cc:290] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:36.389036 30077 leader_election.cc:336] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.390884  2714 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.391714  2714 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.398597 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.398594 30180 raft_consensus.cc:2468] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 15.
W20260709 13:13:36.406286 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.413514 30151 leader_election.cc:336] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.416595  2714 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.424887  2821 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.431453 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.442276 30151 leader_election.cc:336] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.457561 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 75339.4us
I20260709 13:13:36.458864 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.475279  2602 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.475819  2602 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.477658 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.477802  2602 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.479573  2602 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.480132  2602 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.482180  2602 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.478996  2821 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.486245 30077 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.496861 29934 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 10 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.505890  2834 raft_consensus.cc:2804] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:36.506655 30077 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.508085  2831 raft_consensus.cc:2749] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:36.509719 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86541372f8c463da3fe465d9c571876" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.510416 30113 raft_consensus.cc:3060] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.509740 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.522322 30106 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:36.531998  2832 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.532704  2832 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.535019  2832 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.535633 30113 raft_consensus.cc:2468] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
W20260709 13:13:36.540966 30151 leader_election.cc:336] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.550414 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.551210 30106 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:36.552717  2832 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.553417  2832 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.555815  2832 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:36.559309 30077 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.559952 30077 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.560470 30077 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.560840 30151 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.574322 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.588368 30150 leader_election.cc:304] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.595613  2844 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:36.595815  2770 raft_consensus.cc:2804] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:36.596271  2844 raft_consensus.cc:493] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.596840  2844 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.596853  2770 raft_consensus.cc:697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:36.598662  2770 consensus_queue.cc:237] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.596868  2834 raft_consensus.cc:697] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:36.600317  2834 consensus_queue.cc:237] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.599364 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.605095  2833 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:36.605813  2833 raft_consensus.cc:493] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.606415  2833 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:36.615983  2844 raft_consensus.cc:515] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.628171  2833 raft_consensus.cc:515] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.629206  2844 leader_election.cc:290] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:36.630002 30151 leader_election.cc:336] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.588368 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:36.631877 30178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:36.632599 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 44290.5us
I20260709 13:13:36.632826 30178 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:36.633800 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d11240e2763045ecaa6122102420302e" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:36.634397 30180 raft_consensus.cc:3060] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.634694  2845 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.635265  2845 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.637639  2845 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.641286  2714 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.642068  2714 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.644296  2714 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:36.645246 30077 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.651163 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.651765 30180 raft_consensus.cc:2468] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
W20260709 13:13:36.633165 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:36.676694 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.677351 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.689543 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.690261 30187 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:36.690303 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.691017 30113 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
W20260709 13:13:36.699626 28922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30059)
I20260709 13:13:36.701767 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722cf622ecb54a338f6b0c13e1ce9bed" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.702515 30113 raft_consensus.cc:3060] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:36.705811 30151 leader_election.cc:336] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.726250 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.727502  2834 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:36.727897  2834 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.728264  2834 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:36.728713  2830 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.729380  2830 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.730227 30077 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.731328  2845 raft_consensus.cc:2804] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:36.731900  2845 raft_consensus.cc:697] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:36.732273 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.732977 30106 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:36.732836  2845 consensus_queue.cc:237] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.735795  2830 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.736023  2602 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.736665  2602 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.740438 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 52580.9us
I20260709 13:13:36.743327  2714 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.745332  2714 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.751536  2714 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.751789  2602 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.753975 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.754691 30180 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:36.755882 30113 raft_consensus.cc:2468] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:36.697959  2833 leader_election.cc:290] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.762180 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.763043  2844 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:36.763393 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.763499  2844 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.764077  2844 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:36.764211  2832 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:36.766142 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.766142 30705 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.764976  2832 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.775002  2829 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:36.775368  2832 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:36.775517  2829 raft_consensus.cc:493] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.776134  2829 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.767894 29934 catalog_manager.cc:5697] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 14 to 15, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 15 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.787806  2833 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.787052 29932 catalog_manager.cc:5697] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 11 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.765262  2770 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.773753 30077 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.788874  2770 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.789075  2844 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.790470 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.791158  2602 raft_consensus.cc:2749] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:36.792065  2770 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:36.792559  2845 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:36.792992  2845 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.793367  2845 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:36.793695  2833 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.796167  2833 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.796247  2821 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.764653 30150 leader_election.cc:304] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.796838  2821 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.799038  2821 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.799623  2770 raft_consensus.cc:2804] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:36.800576  2821 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.801182  2821 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.803331  2821 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.800256  2770 raft_consensus.cc:697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:36.810266  2770 consensus_queue.cc:237] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.806250  2829 raft_consensus.cc:515] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.823081  2829 leader_election.cc:290] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.833317  2829 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.802060  2845 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.773132  2834 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.837745 30740 raft_consensus.cc:1275] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:36.839077  2834 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.841784 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a1d04afff45a7a0def29171749edf" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.842670 30113 raft_consensus.cc:3060] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:36.843101 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:36.845347 30705 leader_election.cc:336] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.846128  2845 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.847303 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.861325 30109 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:36.848058 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a9a88da98d43b8a556cba3e2768e28" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:36.862308 30180 raft_consensus.cc:3060] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.791392  2844 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.848620 29932 catalog_manager.cc:5697] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 10 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 11 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.834172  2829 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.856163 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.864526 30187 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 9.
I20260709 13:13:36.857229 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.865463  2849 consensus_queue.cc:1048] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:36.865761  2829 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.865821 30182 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 11.
I20260709 13:13:36.866485 30740 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 16.
I20260709 13:13:36.866513 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.867523 30108 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 13: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:36.852053  2832 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:36.859051 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.869016 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:36.869616 30108 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 9.
I20260709 13:13:36.871784  2832 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:36.873451 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.858074  2770 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.859756 30113 raft_consensus.cc:2468] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:36.877174  2770 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.878991 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:36.881860 30108 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:36.880383 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.884735 30151 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.885253 30151 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.885454 30077 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.885768 30151 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.886065 30077 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:36.886874 30180 raft_consensus.cc:2468] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:36.864117 29934 catalog_manager.cc:5697] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 13 to 14, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.887593  2845 raft_consensus.cc:2749] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:36.884100  2770 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.898236 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:36.899300 30180 raft_consensus.cc:2393] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 13: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:36.903337 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:36.903411 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.904126 30182 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 16.
I20260709 13:13:36.905043  2833 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:36.905570  2833 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.906031  2833 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:36.923894 30151 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.920888 30705 leader_election.cc:304] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.927793  2829 raft_consensus.cc:2804] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:36.928354  2829 raft_consensus.cc:697] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:36.929275  2829 consensus_queue.cc:237] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.932169 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:36.933072  2832 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:36.933557  2832 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.933933  2832 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.933936 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.935081  2830 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:36.935889  2830 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.936587  2830 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:36.942577 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:36.944387  2770 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:36.946178  2830 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.955838  2830 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:36.953107 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.967024  2845 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:36.967592  2845 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.968039  2845 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:36.967162 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:36.957310  2770 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.969363  2770 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.971809  2770 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:36.959225  2832 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:36.947356 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
W20260709 13:13:36.960407 30705 leader_election.cc:336] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.973001  2834 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:36.973613  2834 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:36.974042  2834 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.981336 30187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:36.983285 30151 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.984051 29934 catalog_manager.cc:5697] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:36.986223 30077 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.986898 30705 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:36.987136 30077 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:36.989893  2833 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:36.992357  2714 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:37.013664  2714 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
W20260709 13:13:36.993572 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 46297.1us
I20260709 13:13:37.014473  2714 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:37.016213 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:37.017016 30180 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:36.998744  2834 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:37.019656 30705 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.020558  2832 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:37.029372  2714 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.031474  2714 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:37.023097  2845 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.034345 30150 leader_election.cc:304] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:37.032585  2834 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:37.042222 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.042871  2714 raft_consensus.cc:2804] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:37.043126 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.051334 30151 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.051345 30740 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:37.053113 30187 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d2f11cccca04a7683da4080ab797bd7 in current term 17: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:37.060662  2714 raft_consensus.cc:697] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:37.061837  2714 consensus_queue.cc:237] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.066039 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:37.061298  2770 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:13:37.084583  2845 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:37.073025  2796 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:13:37.105789 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 63860.4us
I20260709 13:13:37.106678 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:37.108019  2770 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:37.124640 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:37.126482 30108 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:37.130496 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:37.131232 30109 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:37.132193 30108 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:37.135093 30109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:37.135499 30106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:37.135911 30109 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 12: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
I20260709 13:13:37.136313 30106 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 10: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:37.140466 30077 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.158766  2833 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:37.169581 30077 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:37.170970  2859 raft_consensus.cc:2749] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:37.172060 30077 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:37.174649 30151 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.177503 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:37.178411 30739 raft_consensus.cc:2393] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 17: Already voted for candidate 8d2f11cccca04a7683da4080ab797bd7 in this term.
I20260709 13:13:37.184679 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 8d2f11cccca04a7683da4080ab797bd7
I20260709 13:13:37.186282  2833 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:37.188751 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:37.189599 30185 raft_consensus.cc:2393] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 12: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:37.195289 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:37.196086 30185 raft_consensus.cc:2393] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 10: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:37.200919 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:37.203138 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:37.208165 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:37.206684  2821 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:37.211063  2844 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:37.211512  2844 raft_consensus.cc:493] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:37.211881  2844 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.207463  2857 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:37.218201  2857 raft_consensus.cc:493] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34f51764a89048468a6faa21020812b0)
I20260709 13:13:37.218652  2857 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.219316  2833 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:13:37.227465 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:37.257319 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.258577  2833 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:37.259179 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:37.261953  2833 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:37.263362  2857 raft_consensus.cc:515] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.264676  2844 raft_consensus.cc:515] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.267693 29934 catalog_manager.cc:5697] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 9 to 10, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 10 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:37.271380 30151 leader_election.cc:336] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:37.279230 30151 leader_election.cc:336] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:37.280618 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 71004.9us
I20260709 13:13:37.292725  2857 leader_election.cc:290] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:37.296733  2844 leader_election.cc:290] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:37.306556 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.329939 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c91803ea87d43adb17baf51a5093b3c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:37.330646 30108 raft_consensus.cc:3060] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.330819 30113 raft_consensus.cc:1275] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:37.336484 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f7556bbcd34819a44043784cacf8b2" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:37.337180 30110 raft_consensus.cc:3060] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.339838 30108 raft_consensus.cc:2468] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:37.346866 30110 raft_consensus.cc:2468] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
W20260709 13:13:37.350036 30077 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.354161 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:37.358148  2865 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:37.359490 30077 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:37.360900 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:37.362453  2865 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:37.363600 30077 consensus_peers.cc:597] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.375186  2857 consensus_queue.cc:1048] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:37.390878 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.415674 30150 leader_election.cc:304] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:37.416962  2857 raft_consensus.cc:2804] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.417591  2857 raft_consensus.cc:697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:37.418430  2857 consensus_queue.cc:237] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.422308 30150 leader_election.cc:304] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:37.428699 30108 raft_consensus.cc:1275] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:37.429050  2844 raft_consensus.cc:2804] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.432513 30182 raft_consensus.cc:1275] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:37.435930  2844 raft_consensus.cc:697] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:37.439385  2844 consensus_queue.cc:237] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:37.442054 30182 raft_consensus.cc:1275] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:37.445241  2602 consensus_queue.cc:1048] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:37.448168  2849 consensus_queue.cc:1048] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:37.457070  2831 consensus_queue.cc:1048] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:13:37.548833 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.559587 30185 raft_consensus.cc:1275] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:13:37.552098 29932 catalog_manager.cc:5697] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 13 to 14, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.575356  2851 consensus_queue.cc:1048] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:37.587980 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:37.592280 30110 raft_consensus.cc:1275] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:13:37.595077 30077 consensus_peers.cc:597] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.618211 29934 catalog_manager.cc:5697] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 13 to 14, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.633101  2833 consensus_queue.cc:1048] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:13:37.700277 28922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:37.831467 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.923753 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:37.936061 30109 raft_consensus.cc:1275] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:37.938735  2832 consensus_queue.cc:1048] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:37.944010 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.991055 30109 raft_consensus.cc:1275] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:37.993165  2832 consensus_queue.cc:1048] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:38.087308 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.118914 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.149628 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.194830 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.340651 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.348198 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.361157 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.384903 30705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 13:13:38.388209 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.434800 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.446580 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.459719 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.501004 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.509002 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.518064 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.545603 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.552232 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.575806 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.584950 30185 consensus_queue.cc:237] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:38.604089 30740 raft_consensus.cc:1275] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:38.605683  2832 consensus_queue.cc:1048] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:13:38.615518 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:38.628196 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.669771  2844 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 8 to 10, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:38.679241 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.681586 30740 raft_consensus.cc:2955] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:38.700829 28922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:38.724045 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.742535 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.749759 29932 catalog_manager.cc:5697] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: config changed from index 8 to 10, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:38.783515 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.773229 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.801848 30077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 77863.5us
I20260709 13:13:38.814081 29921 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 056561f84fe249b496e33c1560ab5a76 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:13:38.824293  2849 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.824976  2849 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:38.827522  2849 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:38.866933 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:38.867924 30739 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 17.
W20260709 13:13:38.873524 30151 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:38.879777 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.903023 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:38.903952  2832 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:38.904402  2832 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.904785  2832 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:38.919366 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.924916 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:38.920881  2855 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.939302  2855 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:38.947600  2855 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:38.952313  2849 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.953001  2849 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:38.955788  2849 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:38.957373 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.958024 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.964520 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:38.971936 30704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 47606.2us
W20260709 13:13:38.973549 30151 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:38.971910  2832 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:38.986685 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838f13bafde24742a950e2e4d62e21e9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:38.987389 30739 raft_consensus.cc:3060] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:38.993541  2832 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:38.999228 30739 raft_consensus.cc:2468] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 18.
I20260709 13:13:39.000716 30153 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.005676  2832 raft_consensus.cc:2804] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:39.024991  2832 raft_consensus.cc:697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 18 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:39.031600  2832 consensus_queue.cc:237] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:39.037528 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:39.038553 30151 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.043314 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:39.044040 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:39.044735 30185 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 12.
I20260709 13:13:39.044054 30113 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
W20260709 13:13:39.047528 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:39.047816 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:39.054159 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:39.070145 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:39.070994  2849 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:39.071462  2849 raft_consensus.cc:493] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.071847  2849 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:39.078490 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.079488  2894 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:39.079924  2894 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.080271  2894 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:39.081773 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet 056561f84fe249b496e33c1560ab5a76 with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50288
W20260709 13:13:39.090536 30077 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.093994  2897 tablet_replica.cc:333] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:39.100304  2889 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.100888  2889 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.104333  2897 raft_consensus.cc:2243] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.109151  2885 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.133711  2885 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.135927  2897 raft_consensus.cc:2272] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.143289 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:39.144012 30185 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 10.
I20260709 13:13:39.143529 29932 catalog_manager.cc:5697] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 16 to 18, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 18 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.123126 30108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:39.125989  2894 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.146564 30108 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:39.148059  2894 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:39.095862  2849 raft_consensus.cc:515] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.135919  2885 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:39.115692  2889 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:39.150794 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.151067  2849 leader_election.cc:290] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:39.151818  2849 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:39.152292  2849 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.159852  2849 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:39.153585 30185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31c2ecc47149adb9b7dd839def365c" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:39.162243 30185 raft_consensus.cc:3060] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:39.163071 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.166951 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.167805  2897 ts_tablet_manager.cc:1916] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:39.168562  2885 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:39.177721  2885 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.178150  2885 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:39.170822 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "396297d3a2474246b40507f61f59858c" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:39.181680 30110 raft_consensus.cc:3060] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:39.185026 30151 leader_election.cc:336] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:39.170838 30077 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.199895 30185 raft_consensus.cc:2468] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98b3b699b87245df85d3aa84c13f5691 in term 13.
I20260709 13:13:39.204104  2885 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.204548  2849 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.206568  2885 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:39.208668 30110 raft_consensus.cc:2468] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 14.
I20260709 13:13:39.214112 30077 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.215348  2894 raft_consensus.cc:2804] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:39.215854  2894 raft_consensus.cc:697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Becoming Leader. State: Replica: 98b3b699b87245df85d3aa84c13f5691, State: Running, Role: LEADER
I20260709 13:13:39.217103  2849 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:39.218668 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.219139 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:39.219280 30150 leader_election.cc:304] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:39.216784  2894 consensus_queue.cc:237] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.219918 30182 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98b3b699b87245df85d3aa84c13f5691 in current term 11: Already voted for candidate ef9ab4d665234a799376bf42ef5d058c in this term.
I20260709 13:13:39.221443  2889 raft_consensus.cc:2804] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:39.222029  2889 raft_consensus.cc:697] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:39.223006  2889 consensus_queue.cc:237] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.225636 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:39.226480 30110 raft_consensus.cc:2393] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9ab4d665234a799376bf42ef5d058c in current term 11: Already voted for candidate 98b3b699b87245df85d3aa84c13f5691 in this term.
W20260709 13:13:39.231118 30077 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.234966 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:39.238982 30077 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.240254  2832 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:39.245805 30077 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:39.251453  2885 raft_consensus.cc:2749] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:39.267817  2887 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.268528  2887 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.270956  2887 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:39.277806 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:39.278602 30110 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 10.
I20260709 13:13:39.280730 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:39.282387  2832 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:39.282827  2832 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.283140  2832 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:39.291034 30151 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.301592 29934 catalog_manager.cc:5697] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 reported cstate change: term changed from 11 to 13, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130). New cstate: current_term: 13 leader_uuid: "98b3b699b87245df85d3aa84c13f5691" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.266850 29932 catalog_manager.cc:5697] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 12 to 14, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 14 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.317306  2832 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.360632  2897 ts_tablet_manager.cc:1929] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:13:39.368752  2832 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:39.370203 30110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
W20260709 13:13:39.370599 30151 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.376992 30110 raft_consensus.cc:3060] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:39.385708 30110 raft_consensus.cc:2468] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:39.387701 30150 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:39.388705  2832 raft_consensus.cc:2804] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:39.389359  2832 raft_consensus.cc:697] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:39.390378  2832 consensus_queue.cc:237] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:39.381558  2897 log.cc:1199] T 056561f84fe249b496e33c1560ab5a76 P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/056561f84fe249b496e33c1560ab5a76
I20260709 13:13:39.411774 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet 056561f84fe249b496e33c1560ab5a76 (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
W20260709 13:13:39.413895 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:39.463891 29932 catalog_manager.cc:5697] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 9 to 11, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 11 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:39.489254 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:39.627166 30740 raft_consensus.cc:1275] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:39.629042  2887 consensus_queue.cc:1048] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:39.657178 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.701541 28922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30059)
I20260709 13:13:39.739661 30108 raft_consensus.cc:1275] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:39.742955  2887 consensus_queue.cc:1048] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:13:39.823673 30185 raft_consensus.cc:1275] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Refusing update from remote peer 98b3b699b87245df85d3aa84c13f5691: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:39.826215  2890 consensus_queue.cc:1048] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:13:39.837376 30077 consensus_peers.cc:597] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:39.845293 30077 consensus_peers.cc:597] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.855399 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.869014 30113 raft_consensus.cc:1275] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:39.871371  2832 consensus_queue.cc:1048] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:13:39.877319 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:39.978127 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.986097 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:39.994325 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:40.022565 30077 consensus_peers.cc:597] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:40.082221 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:40.281656 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.286027 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.300379 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.414731 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:40.586135 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.606904 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:40.676046 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.702210 28922 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:40.731936 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.849325 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.901475 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:40.987310 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.008378 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.021339 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 46766.5us
W20260709 13:13:41.061000 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.107117 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.133265 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.137071 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.303284 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.327013 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 51364.3us
W20260709 13:13:41.349594 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.355201 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.357933 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.442548 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.457005 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.506667 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.513561 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.577955 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.584580 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.614588 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.669763 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.680524 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:41.702950 28922 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:41.787820 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.859349 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.842825 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:41.880722 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.893520 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:41.912366 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:41.962939 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:42.051283 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:42.065116 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:42.106472  2887 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.107366  2887 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:42.110488 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:42.115934 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:42.119820  2887 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:42.122478 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691" is_pre_election: true
I20260709 13:13:42.123445 30113 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 11.
I20260709 13:13:42.127183 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:42.130102  2912 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:42.130564  2912 raft_consensus.cc:493] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.130883  2912 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.180624  2912 raft_consensus.cc:515] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:42.185907 30150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:38581, user_credentials={real_user=slave}} blocked reactor thread for 58918.9us
I20260709 13:13:42.211568  2912 leader_election.cc:290] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Requested vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:42.216090 30151 leader_election.cc:336] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:42.220975 30113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2caa8c9ec4f85b73c3be44168d116" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "98b3b699b87245df85d3aa84c13f5691"
I20260709 13:13:42.221861 30113 raft_consensus.cc:3060] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.287614 30113 raft_consensus.cc:2468] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:42.291954 30150 leader_election.cc:304] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0
I20260709 13:13:42.293485  2912 raft_consensus.cc:2804] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:42.294061  2912 raft_consensus.cc:697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:42.295222  2912 consensus_queue.cc:237] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:42.314849 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:42.341254 30077 consensus_peers.cc:597] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:42.346341 30077 consensus_peers.cc:597] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:42.349702 29934 catalog_manager.cc:5697] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 9 to 12, leader changed from 34f51764a89048468a6faa21020812b0 (127.28.62.129) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 12 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:42.458952 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:42.459610 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:42.518097 30077 consensus_peers.cc:597] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:42.532246 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:42.553071 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:42.645447 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:42.703969 28922 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:42.737488 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.862627 30113 raft_consensus.cc:1275] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:42.864215  2912 consensus_queue.cc:1048] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:42.999897 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:43.000459 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.063345 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.080179 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.083127 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.123934 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:43.131961 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.172127 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:43.275311 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.348381 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.381165 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.401782 30151 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111) [suppressed 468 similar messages]
W20260709 13:13:43.633466 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.646329 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.647249 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.704463 28922 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:43.737877 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:43.754604 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.770205 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.800431 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:43.801329 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.809227 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.857883 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.860528 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.898468 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:43.958706 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.002838 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.008234 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.030525 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.081292 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:44.186269 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.235110 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.282821 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.319989 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.363191 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.365618 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:44.379802 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.437017 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.493383 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.513769 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.514799 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:44.745680 28922 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:44.906975 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:44.910992 30739 consensus_queue.cc:237] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:44.931514 30077 consensus_peers.cc:597] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:44.936051 30077 consensus_peers.cc:597] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:44.990130 30077 consensus_peers.cc:597] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:45.027400 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:45.031828 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:45.035688 30185 raft_consensus.cc:1275] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:45.066833  2949 consensus_queue.cc:1048] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:45.072548 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.105865  2948 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 6 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:45.107831 30185 raft_consensus.cc:2955] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 6 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
I20260709 13:13:45.122356 29923 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbc08410209249758a644676ff99841d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:13:45.132340 29934 catalog_manager.cc:5697] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c reported cstate change: config changed from index 6 to 11, VOTER 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) evicted. New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } } }
W20260709 13:13:45.147185 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:45.233337 30103 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc08410209249758a644676ff99841d with delete_type TABLET_DATA_TOMBSTONED (TS 98b3b699b87245df85d3aa84c13f5691 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50288
I20260709 13:13:45.284554  2958 tablet_replica.cc:333] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:45.292860  2958 raft_consensus.cc:2243] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.293884  2958 raft_consensus.cc:2272] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.301723  2958 ts_tablet_manager.cc:1916] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:45.331869 30077 consensus_peers.cc:597] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.396906 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:45.405654  2958 ts_tablet_manager.cc:1929] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:13:45.429687  2958 log.cc:1199] T bbc08410209249758a644676ff99841d P 98b3b699b87245df85d3aa84c13f5691: Deleting WAL directory at /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/wals/bbc08410209249758a644676ff99841d
W20260709 13:13:45.408167 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:45.437381 29920 catalog_manager.cc:5028] TS 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): tablet bbc08410209249758a644676ff99841d (table test-workload [id=012533f1dcd54f46bda6dfc4a671cbe8]) successfully deleted
W20260709 13:13:45.444094 30077 consensus_peers.cc:597] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.469619 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.517499 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:45.575754 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.579290 30077 consensus_peers.cc:597] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:45.599519 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.603220 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.746313 28922 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30059)
W20260709 13:13:45.764952 30077 consensus_peers.cc:597] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.794365 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:45.822928 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08001c77e0 after lost signal to thread 28925
W20260709 13:13:45.824101 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba640 after lost signal to thread 29970
W20260709 13:13:45.825498 29967 debug-util.cc:398] Leaking SignalData structure 0x7b08002755a0 after lost signal to thread 30137
W20260709 13:13:45.826663 29967 debug-util.cc:398] Leaking SignalData structure 0x7b080005a120 after lost signal to thread 30211
W20260709 13:13:45.830201 29967 debug-util.cc:398] Leaking SignalData structure 0x7b0800382d80 after lost signal to thread 30765
W20260709 13:13:45.931739 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:45.933552 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.051303 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.079391 30077 consensus_peers.cc:597] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.108630 30077 consensus_peers.cc:597] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.140138 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.151558 30077 consensus_peers.cc:597] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.154654 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:46.195354 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:13:46.200532 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.213629 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.302568 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.352001 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.396484 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.458736 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.514403 30077 consensus_peers.cc:597] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.536448 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.548749 30077 consensus_peers.cc:597] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.553998 30077 consensus_peers.cc:597] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.581225 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:46.740293 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:46.764950 30077 consensus_peers.cc:597] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:46.855682 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
W20260709 13:13:46.888824 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.893819 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:46.896072 30704 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.919183 30150 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.973029 30150 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.992465 30704 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.003997 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:47.008015 30150 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.011550 30704 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.039676 30704 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.078436 30150 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.098589 30704 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.100332 30150 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.101029 30150 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.106326 30704 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.141947 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:47.149977 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:47.151441 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:47.165771 30704 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.167585 30150 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.180267 30150 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.184682 30150 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.188028 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:47.189457 28922 tablet_replica.cc:333] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.191470 28922 raft_consensus.cc:2243] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.192482 28922 raft_consensus.cc:2272] T b7398efc3342427c8ca63da3a989684d P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.196808 28922 tablet_replica.cc:333] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.198436 28922 raft_consensus.cc:2243] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:47.201162 30077 consensus_peers.cc:597] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:47.205623 28922 raft_consensus.cc:2272] T cfbfe72ddc624143b4f12cb68c249a4e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.207201 30150 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.214309 28922 tablet_replica.cc:333] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.222765 28922 raft_consensus.cc:2243] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:13:47.223675 30150 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.223887 28922 raft_consensus.cc:2272] T 42209a176ad44af88b5b1710846183cb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.227922 28922 tablet_replica.cc:333] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.230207 28922 raft_consensus.cc:2243] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.232746 28922 raft_consensus.cc:2272] T 9b108c73739d43d89aafdc212aae9d1b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.235620 28922 tablet_replica.cc:333] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
W20260709 13:13:47.235733 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:47.236660 28922 raft_consensus.cc:2243] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.238183 28922 raft_consensus.cc:2272] T d14e2286ffc64880b1518c6743938daa P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.240998 28922 tablet_replica.cc:333] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.241978 28922 raft_consensus.cc:2243] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.243023 28922 raft_consensus.cc:2272] T 9ddff3913cdf4e70a580878770e0b745 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.265172 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:47.266291 30150 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.267544 30150 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.265807 28922 tablet_replica.cc:333] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
W20260709 13:13:47.265452 30704 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.281281 28922 raft_consensus.cc:2243] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:47.284574 30704 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.282588 28922 raft_consensus.cc:2272] T 92792ac48d644c99ac833ab354f052c3 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.297037 28922 tablet_replica.cc:333] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.298278 28922 raft_consensus.cc:2243] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.299741 28922 raft_consensus.cc:2272] T 3f8dc2d031b14a58b3ed72d7a06855e1 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.308730 30150 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.326423 28922 tablet_replica.cc:333] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.327513 28922 raft_consensus.cc:2243] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.328577 28922 raft_consensus.cc:2272] T 814415efcb8c4963a2b88aafeeaa75bb P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.330025 30150 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.336997 30704 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.341702 30150 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.344414 28922 tablet_replica.cc:333] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
W20260709 13:13:47.351105 30150 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:47.351934 30150 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.353340 28922 raft_consensus.cc:2243] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.357317 28922 raft_consensus.cc:2272] T 15751030df864f9c84e3d822bc8b63e3 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.359627 30704 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.360260 28922 tablet_replica.cc:333] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.371827 28922 raft_consensus.cc:2243] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.373358 28922 raft_consensus.cc:2272] T 729e969847cf4fbcb29c2681ec03a97a P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.377671 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:47.387861 28922 tablet_replica.cc:333] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.397284 28922 raft_consensus.cc:2243] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.406477 28922 raft_consensus.cc:2272] T 1df0056e71a84e3aa2756ee599e24a66 P 98b3b699b87245df85d3aa84c13f5691 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.410034 28922 tablet_replica.cc:333] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
W20260709 13:13:47.422730 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:47.433288 28922 raft_consensus.cc:2243] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.435379 28922 raft_consensus.cc:2272] T d11240e2763045ecaa6122102420302e P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.453279 28922 tablet_replica.cc:333] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.454284 28922 raft_consensus.cc:2243] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:13:47.457700 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:47.459512 28922 raft_consensus.cc:2272] T e3976f5c231948d6bd8a5345ec54d5d5 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.462667 28922 tablet_replica.cc:333] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.477762 28922 raft_consensus.cc:2243] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.486259 28922 raft_consensus.cc:2272] T 6d7dd6e303964f99bd9728c2f53891af P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.523713 28922 tablet_replica.cc:333] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.531625 28922 raft_consensus.cc:2243] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.532594 28922 raft_consensus.cc:2272] T 722cf622ecb54a338f6b0c13e1ce9bed P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.536059 28922 tablet_replica.cc:333] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.554766 28922 raft_consensus.cc:2243] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.565068 28922 raft_consensus.cc:2272] T fa63b06fc4f446c8b2e800abeaaeabce P 98b3b699b87245df85d3aa84c13f5691 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.580068 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:47.591804 28922 tablet_replica.cc:333] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.616485 28922 raft_consensus.cc:2243] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.623284 28922 raft_consensus.cc:2272] T 2a3a1d04afff45a7a0def29171749edf P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.634411 28922 tablet_replica.cc:333] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.654121 28922 raft_consensus.cc:2243] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.655082 28922 raft_consensus.cc:2272] T d99bf410d55b470d8191aa69458330db P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.657780 28922 tablet_replica.cc:333] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.658578 28922 raft_consensus.cc:2243] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.659345 28922 raft_consensus.cc:2272] T f86541372f8c463da3fe465d9c571876 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.671265 28922 tablet_replica.cc:333] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.682106 28922 raft_consensus.cc:2243] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.683460 28922 raft_consensus.cc:2272] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.686396 28922 tablet_replica.cc:333] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.687435 28922 raft_consensus.cc:2243] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.688197 28922 raft_consensus.cc:2272] T db55e372a60b4a1a9c52676be275cf56 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.700680 28922 tablet_replica.cc:333] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.710047 28922 raft_consensus.cc:2243] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.711529 28922 raft_consensus.cc:2272] T 535e413e4f2b46fe966812acbf31570a P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.714409 28922 tablet_replica.cc:333] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.715956 28922 raft_consensus.cc:2243] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:47.729300 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:47.733940 28922 raft_consensus.cc:2272] T 76d91f22e2654dd1ae5451605e7a3b23 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.737119 28922 tablet_replica.cc:333] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.738003 28922 raft_consensus.cc:2243] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.746510 28922 raft_consensus.cc:2272] T 9ce29391518248688fe4f7fd0e2eee7a P 98b3b699b87245df85d3aa84c13f5691 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.750946 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:47.761461 28922 tablet_replica.cc:333] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.762543 28922 raft_consensus.cc:2243] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.763430 28922 raft_consensus.cc:2272] T 396297d3a2474246b40507f61f59858c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.778106 28922 tablet_replica.cc:333] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.783028 28922 raft_consensus.cc:2243] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.786306 28922 raft_consensus.cc:2272] T 34df6751216d4ac584919e5640b25bc4 P 98b3b699b87245df85d3aa84c13f5691 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.803450 28922 tablet_replica.cc:333] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.804183 28922 raft_consensus.cc:2243] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.804919 28922 raft_consensus.cc:2272] T 74c6f7e90c624b64bdbb67860d561418 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.809096 28922 tablet_replica.cc:333] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.821913 28922 raft_consensus.cc:2243] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.822748 28922 raft_consensus.cc:2272] T 0c855bd93d50418aa0aec7a1a3c2e228 P 98b3b699b87245df85d3aa84c13f5691 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.827827 28922 tablet_replica.cc:333] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.828786 28922 raft_consensus.cc:2243] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.830024 28922 raft_consensus.cc:2272] T cb153e5e2ed243b6a7741de46f707450 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.833230 28922 tablet_replica.cc:333] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.834257 28922 raft_consensus.cc:2243] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.835482 28922 raft_consensus.cc:2272] T 155d3e6034f842759244a283f46a67b9 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:47.848665 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:47.849978 28922 tablet_replica.cc:333] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.850980 28922 raft_consensus.cc:2243] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.851814 28922 raft_consensus.cc:2272] T 82bd288ed43e47fbabdbcfbfaca06dfb P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.855051 28922 tablet_replica.cc:333] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.866113 28922 raft_consensus.cc:2243] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.866253  2961 raft_consensus.cc:493] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:47.867200 28922 raft_consensus.cc:2272] T fd9e5e8f77524a8e8e19542c915fb343 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.866884  2961 raft_consensus.cc:515] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:47.871379  2961 leader_election.cc:290] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:47.878448 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:47.880662 30077 leader_election.cc:336] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:47.885164 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd68eba45b4971b4072c8ef0de88d5" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:47.888204 30077 leader_election.cc:304] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:47.889206  2961 raft_consensus.cc:2749] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:47.871869 28922 tablet_replica.cc:333] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.890470 28922 raft_consensus.cc:2243] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.891646 28922 raft_consensus.cc:2272] T 3facd19034dd44899de7471297d45bbc P 98b3b699b87245df85d3aa84c13f5691 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.894949 28922 tablet_replica.cc:333] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.895821 28922 raft_consensus.cc:2243] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.896555 28922 raft_consensus.cc:2272] T 01f7556bbcd34819a44043784cacf8b2 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.908380 28922 tablet_replica.cc:333] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.920466 28922 raft_consensus.cc:2243] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.921629 28922 raft_consensus.cc:2272] T 0d31c2ecc47149adb9b7dd839def365c P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.924225 28922 tablet_replica.cc:333] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.924947 28922 raft_consensus.cc:2243] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:47.926524 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:47.935679 28922 raft_consensus.cc:2272] T 7a672a61589048279810adba842422a0 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.938530 28922 tablet_replica.cc:333] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.939368 28922 raft_consensus.cc:2243] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.939966 28922 raft_consensus.cc:2272] T 4c91803ea87d43adb17baf51a5093b3c P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.942883 28922 tablet_replica.cc:333] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.965430  2961 raft_consensus.cc:493] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:47.970021 28922 raft_consensus.cc:2243] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:47.969815  2961 raft_consensus.cc:515] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:47.970659 28922 raft_consensus.cc:2272] T 9a61c48865d1417593366ed1611c2836 P 98b3b699b87245df85d3aa84c13f5691 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.972407  2961 leader_election.cc:290] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:47.974781 28922 tablet_replica.cc:333] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.975719 28922 raft_consensus.cc:2243] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.976877 28922 raft_consensus.cc:2272] T 6065fdc6916b4a589b781d16204e51c6 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:47.979274 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e3e05564894b51b12ceb093978f695" candidate_uuid: "98b3b699b87245df85d3aa84c13f5691" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:47.979813 28922 tablet_replica.cc:333] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:47.980767 28922 raft_consensus.cc:2243] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:47.998915 28922 raft_consensus.cc:2272] T c0bc2d269504461f9c5ae0cdf5385b9b P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.003786 30705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:36297, user_credentials={real_user=slave}} blocked reactor thread for 45178.4us
I20260709 13:13:48.010109 28922 tablet_replica.cc:333] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:48.011096 28922 raft_consensus.cc:2243] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.011999 28922 raft_consensus.cc:2272] T 39df33df3e0d43b5a35e334a03324f92 P 98b3b699b87245df85d3aa84c13f5691 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.025697 28922 tablet_replica.cc:333] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:48.026572 28922 raft_consensus.cc:2243] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.027287 28922 raft_consensus.cc:2272] T 3ff2caa8c9ec4f85b73c3be44168d116 P 98b3b699b87245df85d3aa84c13f5691 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.029959 28922 tablet_replica.cc:333] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:48.042003 28922 raft_consensus.cc:2243] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.042618 28922 raft_consensus.cc:2272] T dadd68eba45b4971b4072c8ef0de88d5 P 98b3b699b87245df85d3aa84c13f5691 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.051298 28922 tablet_replica.cc:333] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:48.052181 28922 raft_consensus.cc:2243] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.053205 28922 raft_consensus.cc:2272] T e06bbfa07cb545c8b65a4a6f1dae9516 P 98b3b699b87245df85d3aa84c13f5691 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.056450 28922 tablet_replica.cc:333] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
W20260709 13:13:48.059749 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:48.073514 28922 raft_consensus.cc:2243] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:48.073784 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:48.074456 28922 raft_consensus.cc:2272] T e0f2e33addec48d89bb483d29ce55ad4 P 98b3b699b87245df85d3aa84c13f5691 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.076328 30077 leader_election.cc:336] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:48.077663 28922 tablet_replica.cc:333] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691: stopping tablet replica
I20260709 13:13:48.079912 30077 leader_election.cc:304] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98b3b699b87245df85d3aa84c13f5691; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:48.080915 28922 raft_consensus.cc:2243] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.083930  2961 raft_consensus.cc:2706] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Received pre-election callback for term 14 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:13:48.085536 28922 raft_consensus.cc:2272] T 88e3e05564894b51b12ceb093978f695 P 98b3b699b87245df85d3aa84c13f5691 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.156440 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.160392 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.252910 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:48.321862 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:48.403007 30705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111) [suppressed 545 similar messages]
I20260709 13:13:48.435006  2941 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.435689  2941 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.441239  2941 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.453322 30705 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:48.459336 30704 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.461777 30704 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.472777  2941 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.494123  2952 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.494697  2952 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.496774  2952 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.515633 30151 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:48.518980 30150 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.523458 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.530632  2952 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:48.533325  2965 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.533876  2965 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.537657  2965 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.542443 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:48.551506  2965 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.552286  2965 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.554693  2965 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.558187 30151 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:48.564181 30150 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.565229 30150 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.569612  2965 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:48.577605 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.586658 30151 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:48.591524 30150 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.592077 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.592995  2952 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:48.600977 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:48.648068  2965 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.648721  2965 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.651213  2965 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.669879 30151 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:48.671164 30150 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.671725 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.672465  2965 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:48.683523  2964 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.684162  2964 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.693061  2964 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.707113 30704 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.717554  2965 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.718293  2965 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
W20260709 13:13:48.727034 30150 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:48.730747 30705 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:48.732643 30705 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.730130  2965 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:48.734961  2964 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:48.743391 30151 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:48.743921 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.746150  2965 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:48.806573 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:48.832731 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:48.838081  2941 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.838667  2941 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.840804  2941 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:48.844898 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
W20260709 13:13:48.848603 30704 leader_election.cc:336] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:48.851843 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:48.852102 30704 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 98b3b699b87245df85d3aa84c13f5691, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:48.851527  2965 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.852981  2965 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.856920  2964 raft_consensus.cc:2749] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:48.859912 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
W20260709 13:13:48.860559 30150 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.861304  2965 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:48.862855 30153 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.864584  2965 raft_consensus.cc:2749] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:48.881655  2965 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.882484  2965 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.887806  2952 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.888363  2952 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.888811  2965 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:48.890348  2952 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.897845 30150 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:48.904174 30150 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.909631  2952 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.910413  2952 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:48.913164  2952 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.944789 30151 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:48.954926 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.956845  2952 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:48.959890  2964 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.960585  2964 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:48.961611 30151 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:48.964032 30151 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:48.965986  2952 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.963052  2964 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:48.969213 30150 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.969724  2952 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:48.973788 30704 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:48.973788  2952 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.977641  2965 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:48.978300  2965 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:48.983165  2965 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:48.990887  2952 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:49.010187  2952 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
W20260709 13:13:49.011003 30151 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:49.010301  2965 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.013198  2965 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.014124 30739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:49.017522  2965 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:49.011235  2952 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.019104 30741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:49.019704 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:49.020828 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:49.019318  2952 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
I20260709 13:13:49.021612  2952 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:49.026064 30150 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.030251 30150 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.031589  2965 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:49.032769 30151 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:49.036598 30150 leader_election.cc:336] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.037227 30150 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:49.041131 30705 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:49.040966 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:49.045672 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.045866 30734 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 12.
I20260709 13:13:49.041989 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7" is_pre_election: true
I20260709 13:13:49.046490  2941 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:49.042308  2965 raft_consensus.cc:2749] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:49.047490 30153 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:49.048342  2965 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:49.048846  2965 raft_consensus.cc:493] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.050510  2965 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:49.056149 30150 leader_election.cc:336] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:49.058439 30150 leader_election.cc:336] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.069586 30150 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 8d2f11cccca04a7683da4080ab797bd7, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.070798  2965 raft_consensus.cc:515] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.072016  2952 raft_consensus.cc:2749] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:49.074069  2965 leader_election.cc:290] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132:36585)
W20260709 13:13:49.080367 30150 leader_election.cc:336] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.084237 30740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d3e6034f842759244a283f46a67b9" candidate_uuid: "ef9ab4d665234a799376bf42ef5d058c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8d2f11cccca04a7683da4080ab797bd7"
I20260709 13:13:49.084909 30740 raft_consensus.cc:3060] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:49.092255  2941 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.092816  2941 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.094785  2941 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.098548 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:49.099200 30179 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 10.
I20260709 13:13:49.100529 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:49.097489 30740 raft_consensus.cc:2468] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9ab4d665234a799376bf42ef5d058c in term 13.
I20260709 13:13:49.104629 30153 leader_election.cc:304] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:49.105789 30704 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.106058  2941 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:49.106436  2941 raft_consensus.cc:493] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.105836  2952 raft_consensus.cc:2804] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:49.107321  2952 raft_consensus.cc:697] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Becoming Leader. State: Replica: ef9ab4d665234a799376bf42ef5d058c, State: Running, Role: LEADER
I20260709 13:13:49.108157  2952 consensus_queue.cc:237] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.106748  2941 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:49.135677  2941 raft_consensus.cc:515] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:49.143477 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:49.153117  2941 leader_election.cc:290] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.156589 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535e413e4f2b46fe966812acbf31570a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
I20260709 13:13:49.158187 30179 raft_consensus.cc:3060] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:49.157614 30704 leader_election.cc:336] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.165359 29934 catalog_manager.cc:5697] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c reported cstate change: term changed from 12 to 13, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to ef9ab4d665234a799376bf42ef5d058c (127.28.62.131). New cstate: current_term: 13 leader_uuid: "ef9ab4d665234a799376bf42ef5d058c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.166539 30179 raft_consensus.cc:2468] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:49.169000  2941 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.169597  2941 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.173291 30705 leader_election.cc:304] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.174739  2968 raft_consensus.cc:2804] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:49.175266  2968 raft_consensus.cc:697] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
W20260709 13:13:49.176048 30704 leader_election.cc:336] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.176174  2968 consensus_queue.cc:237] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.178345  2941 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.179399 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:49.180241 30180 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 11.
I20260709 13:13:49.181656 30705 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.183729  2964 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:49.184253  2964 raft_consensus.cc:493] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.184715  2964 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:49.200914 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:49.207713  2965 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.208613  2965 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:49.211009  2965 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:49.218122 30150 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.217865 29932 catalog_manager.cc:5697] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 10 to 11, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 11 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:49.223851 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:49.224483 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.226432  2965 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:49.230648 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:49.235491 30704 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.237641 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:49.213066  2964 raft_consensus.cc:515] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.240967  2941 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.241601  2941 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.244071  2941 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.244174  2968 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.244796  2968 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.246526 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:49.246949  2968 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:49.247223 30180 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 17.
W20260709 13:13:49.258740 30705 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:49.259948 30705 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:49.259337  2941 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.261791  2941 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:49.258335 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.269264 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:49.273928  2941 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.276353 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:49.288494 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 16.
I20260709 13:13:49.289469  2964 leader_election.cc:290] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.292834 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f18f2a27f1f4c5d8d0af8abe0f87bf7" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:49.293426 30704 leader_election.cc:336] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.294301 30180 raft_consensus.cc:3060] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:49.294440 30704 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.294953 30704 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:49.296005 30704 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.296376 30704 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.290766 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 
I20260709 13:13:49.297163  2976 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:49.297796  2941 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:49.297931  2976 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:49.298415  2976 raft_consensus.cc:493] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.298933  2976 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:49.302340 30180 raft_consensus.cc:2468] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 12.
I20260709 13:13:49.303673 30705 leader_election.cc:304] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.306459  2964 raft_consensus.cc:2804] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:49.307137  2964 raft_consensus.cc:697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:49.308413  2964 consensus_queue.cc:237] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:49.313133 30704 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.315503 30704 leader_election.cc:336] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.314288  2976 raft_consensus.cc:515] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.318310  2976 leader_election.cc:290] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: Requested vote from peers 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:49.319571 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3facd19034dd44899de7471297d45bbc" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c"
W20260709 13:13:49.325449 30704 leader_election.cc:336] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:49.328433 30180 raft_consensus.cc:3060] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:49.334120 29932 catalog_manager.cc:5697] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 11 to 12, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 12 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.336336 30180 raft_consensus.cc:2468] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 17.
I20260709 13:13:49.337888 30705 leader_election.cc:304] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:49.338757  2976 raft_consensus.cc:2804] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:49.339318  2976 raft_consensus.cc:697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEADER]: Becoming Leader. State: Replica: 8d2f11cccca04a7683da4080ab797bd7, State: Running, Role: LEADER
I20260709 13:13:49.340377  2976 consensus_queue.cc:237] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:49.357604 30704 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.371827 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:49.374574 29932 catalog_manager.cc:5697] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 reported cstate change: term changed from 16 to 17, leader changed from 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130) to 8d2f11cccca04a7683da4080ab797bd7 (127.28.62.132). New cstate: current_term: 17 leader_uuid: "8d2f11cccca04a7683da4080ab797bd7" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:49.379468 30150 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.404331 30150 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.405794 28922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:49.435844 30704 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.437258 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:49.526073 30704 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.535815 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:49.552968 30150 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.553525 30150 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.553982 30150 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.556314 30704 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.573895 30704 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.577216 30150 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.581995 30150 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.585983 30150 consensus_peers.cc:597] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.613358 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:49.638803 30150 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.651484 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:49.665169 30740 raft_consensus.cc:1275] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Refusing update from remote peer ef9ab4d665234a799376bf42ef5d058c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:49.667225  2926 consensus_queue.cc:1048] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:49.678733 30704 consensus_peers.cc:597] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.699358 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:49.706733 30150 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:49.716142 30180 raft_consensus.cc:1275] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:13:49.716634 30150 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:49.717780  2976 consensus_queue.cc:1048] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:49.720377 30150 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.735610 30704 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.748925 30150 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.751907 30704 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.757361 30150 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.778474 30150 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:49.794569 30179 raft_consensus.cc:1275] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:49.798794  2976 consensus_queue.cc:1048] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:49.805702 30704 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.806427 30704 consensus_peers.cc:597] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.822587 30150 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.860741 30150 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.890913 30150 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:49.901943 30179 raft_consensus.cc:1275] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Refusing update from remote peer 8d2f11cccca04a7683da4080ab797bd7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:49.905164  2964 consensus_queue.cc:1048] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:49.918552 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:49.924817 30150 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.980911 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:49.984498 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:49.986281  2968 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:49.986943  2968 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:49.989353  2968 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:49.997543 30704 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.008024 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:50.014489 30705 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.015090 30705 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.016299  2968 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:50.031527 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:50.075111 30704 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:50.099561  2985 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.100296  2985 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.104096  2985 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:50.121721 30151 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:50.124445 30150 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:50.125000 30150 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.138501  2985 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:50.148388 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:50.154937 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:50.218520 30704 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:50.229305  2952 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.230038  2952 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.232304  2952 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:50.253088  2952 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.253808  2952 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.256570  2952 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:50.260692 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:50.274196 30150 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.280704 30151 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.289229 30151 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.291241  2952 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:50.289958 30150 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.360694 30151 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.364866 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.366407  2952 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:50.406348 28922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:50.460748 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:50.490188 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:50.493803 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:13:50.501969  2964 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.502722  2964 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:50.512653  2964 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:50.515710 30705 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:50.547147 30704 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:50.552140 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:50.547696 30151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39437, user_credentials={real_user=slave}} blocked reactor thread for 51700.3us
I20260709 13:13:50.558020  2952 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.558627  2952 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.563714  2952 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:50.567250  2968 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:50.587342 30150 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.638852 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.641631 30151 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.646893  2952 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.647706  2952 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.649893  2952 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
I20260709 13:13:50.651131 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.655323  2952 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:50.675189  2968 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.677834  2968 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:50.681710  2968 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:50.687626 30704 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.702915 30150 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:50.710071 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:50.726336 30705 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.733997 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:50.738893 30151 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:50.740080 30151 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.741175  2984 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:50.742288  2968 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:50.748109 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:50.751691 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:13:50.802199  2952 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.802685  2952 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:50.804589  2952 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:50.821002 30151 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:50.825445 30150 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:50.826819 30150 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.837903  2985 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:50.946554  2964 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:50.947201  2964 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:50.950730  2964 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:50.968391 30704 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:50.970288 30179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:50.971019 30179 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 17.
W20260709 13:13:50.981330 30705 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:50.981719 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:50.981848 30705 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:50.982702  2964 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:51.025645  2985 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.026350  2985 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:51.031805  2985 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.037621 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:51.039949 30150 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:51.041684 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.043639  2952 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:51.048755 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:13:51.054313  2952 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.054998  2952 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:51.065086  2952 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.069906 30151 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:51.076700 30150 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:51.077311 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.078665  2985 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:51.083412  2987 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.084022  2987 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:51.086210  2987 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.087868 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.094563 30704 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:51.128763 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.166226 30705 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:51.166841 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.167701  2964 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:51.252980  2952 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.253552  2952 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:51.263021  2952 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.275017 30151 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:51.289060 30150 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:51.294783 30150 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.298010  2952 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:51.406823 28922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:51.409291 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.424278 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.511461 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.520932 30704 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.544466 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:51.643169  2964 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.644284  2964 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:51.648970  2964 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.659803 30705 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:51.666448 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.669431 30704 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:51.671835 30704 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.673389  2964 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:51.730736 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.734745 30150 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.755803 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.774102 30704 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.840452 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.894809 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.902601 30704 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.919754 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:51.927429 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:51.939541 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:13:51.975466  2992 raft_consensus.cc:493] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:51.976230  2992 raft_consensus.cc:515] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:51.978695  2992 leader_election.cc:290] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:51.980008 30150 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.985451 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:51.987345 30150 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:51.990314 30150 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.992023 30704 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:51.994835 30151 leader_election.cc:336] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:51.995462 30151 leader_election.cc:304] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:51.996559  2993 raft_consensus.cc:2749] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:52.022571 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:52.099205 30704 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:52.101687  2998 raft_consensus.cc:493] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:52.102610  2998 raft_consensus.cc:515] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:52.107018  2998 leader_election.cc:290] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:52.108189 30150 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.125787 30150 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.119000 30704 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.132500 30151 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:52.134868 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:52.150516 30150 leader_election.cc:336] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:52.151119 30150 leader_election.cc:304] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:52.152287 30150 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:52.152822  2992 raft_consensus.cc:2749] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:52.167824 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:52.173420 30704 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.166078 30150 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.176936 30150 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.180092 30150 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.202531 30150 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.244879 30704 consensus_peers.cc:597] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:52.245551 30704 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.247563 30150 consensus_peers.cc:597] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:52.287176 30704 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.326197 30150 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.388906 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:52.389856 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:52.403872 30150 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.407522 28922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:52.405027 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.417613 30704 consensus_peers.cc:597] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:52.420465 30704 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:52.432565 30150 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.456090 30150 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.466027 30150 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.486929 30150 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.610437 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:52.628396 30150 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.700214 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:52.734794 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:52.740298 30704 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:52.746373 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:52.768419 30150 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:52.786657  2968 raft_consensus.cc:493] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:52.787703  2968 raft_consensus.cc:515] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:52.812611  2968 leader_election.cc:290] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:52.794045 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:52.818261 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:52.824280 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:52.827922 30704 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:52.832026 30704 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:52.836781  2964 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:52.837694  2964 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:52.839979  2964 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:52.844429 30705 leader_election.cc:336] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:52.844929 30705 leader_election.cc:304] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:52.846004  2968 raft_consensus.cc:2749] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:52.850426 30705 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:52.857210 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:52.870548 30704 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:52.871327 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:52.874274  2987 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:52.992478  2998 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:52.993058  2998 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:52.995868  2998 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.016667 30150 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.027549 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:53.039619  2998 raft_consensus.cc:493] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.040323  2998 raft_consensus.cc:515] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:53.043864  2998 leader_election.cc:290] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.047050 30151 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.050747 30151 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.064908  2998 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:53.071249 30150 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.089092 30151 leader_election.cc:336] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.089718 30151 leader_election.cc:304] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.091125  2998 raft_consensus.cc:2749] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:53.099110 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.176121 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:53.182160 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:53.242071  2998 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.242695  2998 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:53.253378  2998 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.268054 30150 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.313524 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.331890 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.332825 30151 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.333636  2998 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:53.355194 30151 consensus_peers.cc:597] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:53.368925  2987 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.370224  2987 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:53.383378  2987 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:53.390220 30180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce29391518248688fe4f7fd0e2eee7a" candidate_uuid: "8d2f11cccca04a7683da4080ab797bd7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ef9ab4d665234a799376bf42ef5d058c" is_pre_election: true
I20260709 13:13:53.400631 30180 raft_consensus.cc:2468] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2f11cccca04a7683da4080ab797bd7 in term 17.
I20260709 13:13:53.402369  2964 raft_consensus.cc:493] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.402881  2964 raft_consensus.cc:515] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:53.404968  2964 leader_election.cc:290] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.409591 30704 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.411239 28922 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:53.411109 30705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111) [suppressed 749 similar messages]
W20260709 13:13:53.418684 30705 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.421433 30705 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7, ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.424345  2987 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:53.425606 30704 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:53.442732  2998 raft_consensus.cc:493] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.443534  2998 raft_consensus.cc:515] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:53.446264  2998 leader_election.cc:290] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.453814 30150 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.458225 30705 leader_election.cc:336] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.470013 30705 leader_election.cc:304] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.478267  2987 raft_consensus.cc:2749] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:53.512987 30151 leader_election.cc:336] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.519691 30151 leader_election.cc:304] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.521977  2998 raft_consensus.cc:2749] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:53.523149  2992 raft_consensus.cc:493] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.523831  2992 raft_consensus.cc:515] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:53.526511  2992 leader_election.cc:290] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.532125 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.558430 30150 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.559227 30151 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:53.586813 30151 leader_election.cc:336] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.589675 30151 leader_election.cc:304] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.591995  2998 raft_consensus.cc:2749] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:53.610345  2998 raft_consensus.cc:493] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:53.611066  2998 raft_consensus.cc:515] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:53.614341  2998 leader_election.cc:290] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:53.630864 30150 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:53.646695 30151 leader_election.cc:336] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:53.647258 30151 leader_election.cc:304] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:53.648070  2998 raft_consensus.cc:2749] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:53.781422 30151 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:53.835842 30704 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:53.938355 30151 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.013302 30151 consensus_peers.cc:597] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.034036 30151 consensus_peers.cc:597] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:13:54.035954  3000 raft_consensus.cc:493] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:54.042855  3000 raft_consensus.cc:515] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:54.045524  3000 leader_election.cc:290] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:54.072929 30151 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.073522 30151 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:54.074404 30150 leader_election.cc:336] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:54.076138 30150 leader_election.cc:304] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:54.079334  3000 raft_consensus.cc:2749] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:54.089890 30150 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.102789 30151 consensus_peers.cc:597] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:54.115273  2964 raft_consensus.cc:493] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:54.116000  2964 raft_consensus.cc:515] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:54.121068  2964 leader_election.cc:290] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:54.124548 30704 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:54.150525 30705 leader_election.cc:336] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:54.151001 30705 leader_election.cc:304] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:54.152084  3003 raft_consensus.cc:2749] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:54.155802 30704 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.303200 30151 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.347333 30150 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.348619 30151 consensus_peers.cc:597] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:54.356839 30151 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.372694 30150 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.396028 30704 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.397233 30151 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:54.411835 28922 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30134)
W20260709 13:13:54.428479 30150 consensus_peers.cc:597] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.436586 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.452546 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.476850 30150 consensus_peers.cc:597] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.495986 30150 consensus_peers.cc:597] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.510545 30150 consensus_peers.cc:597] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.547394 30150 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.551666 30704 consensus_peers.cc:597] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:54.551666 30151 consensus_peers.cc:597] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:54.572517 30704 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.599362 30704 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.602527 30705 consensus_peers.cc:597] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:13:54.608096  3005 raft_consensus.cc:493] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:54.609172  3005 raft_consensus.cc:515] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:54.617955  3005 leader_election.cc:290] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:54.619215 30705 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.620733 30151 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:54.624349 30150 leader_election.cc:336] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:54.624904 30150 leader_election.cc:304] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:54.626142  3005 raft_consensus.cc:2749] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:54.650264 30704 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.668579 30150 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.724378 30705 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.736263 30150 consensus_peers.cc:597] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.757382 30704 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.757894 30704 consensus_peers.cc:597] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.770965 30150 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.795203 30704 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.815075 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:54.826419 30150 consensus_peers.cc:597] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:54.836385 30705 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:54.840544 30704 consensus_peers.cc:597] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:54.843221 30704 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:54.923950 30150 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.937263 30150 consensus_peers.cc:597] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.968250 30150 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:54.986162 30150 consensus_peers.cc:597] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:55.022936 30150 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:55.049226 30151 consensus_peers.cc:597] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:55.075763 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:55.106755 30151 consensus_peers.cc:597] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.144017 30150 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:55.168658 30705 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:13:55.170516 30151 consensus_peers.cc:597] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:13:55.173250 30704 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:55.291296 30151 consensus_peers.cc:597] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:55.296985 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:55.324009 30151 consensus_peers.cc:597] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:55.371584 30704 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:55.372352 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
W20260709 13:13:55.425084 30151 consensus_peers.cc:597] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:13:55.447412 30150 consensus_peers.cc:597] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:55.526826 30151 consensus_peers.cc:597] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:13:55.537137 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
I20260709 13:13:55.541011  2998 raft_consensus.cc:493] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:55.541620  2998 raft_consensus.cc:515] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } }
I20260709 13:13:55.544410  2998 leader_election.cc:290] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:55.548341 30151 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:55.550619 30150 leader_election.cc:336] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:55.554641 30150 leader_election.cc:304] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9ab4d665234a799376bf42ef5d058c; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
W20260709 13:13:55.560892 30151 consensus_peers.cc:597] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:13:55.561559 30151 consensus_peers.cc:597] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:13:55.567440  2998 raft_consensus.cc:2749] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:55.601953 30705 consensus_peers.cc:597] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.602799 30705 consensus_peers.cc:597] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.629644 30705 consensus_peers.cc:597] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.630476 30705 consensus_peers.cc:597] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.633579 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:55.634845 28922 tablet_replica.cc:333] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.635917 28922 raft_consensus.cc:2243] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.637259 28922 raft_consensus.cc:2272] T b7398efc3342427c8ca63da3a989684d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.639627 28922 tablet_replica.cc:333] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.640408 28922 raft_consensus.cc:2243] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.641674 28922 raft_consensus.cc:2272] T cfbfe72ddc624143b4f12cb68c249a4e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.644003 28922 tablet_replica.cc:333] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.644609 28922 raft_consensus.cc:2243] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.645108 28922 raft_consensus.cc:2272] T 42209a176ad44af88b5b1710846183cb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.647164 28922 tablet_replica.cc:333] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.647729 28922 raft_consensus.cc:2243] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.648320 28922 raft_consensus.cc:2272] T 0285ca89cc9843cab1c6899c6f83dd16 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.650928 28922 tablet_replica.cc:333] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.651590 28922 raft_consensus.cc:2243] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.652262 28922 raft_consensus.cc:2272] T d14e2286ffc64880b1518c6743938daa P ef9ab4d665234a799376bf42ef5d058c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.654999 28922 tablet_replica.cc:333] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.655850 28922 raft_consensus.cc:2243] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.656581 28922 raft_consensus.cc:2272] T 9ddff3913cdf4e70a580878770e0b745 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.659181 28922 tablet_replica.cc:333] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.659947 28922 raft_consensus.cc:2243] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.660976 28922 raft_consensus.cc:2272] T 814415efcb8c4963a2b88aafeeaa75bb P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.662986 28922 tablet_replica.cc:333] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.663837 28922 raft_consensus.cc:2243] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.665057 28922 raft_consensus.cc:2272] T 92792ac48d644c99ac833ab354f052c3 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.667568 28922 tablet_replica.cc:333] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.668473 28922 raft_consensus.cc:2243] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.669145 28922 raft_consensus.cc:2272] T 3f8dc2d031b14a58b3ed72d7a06855e1 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.671764 28922 tablet_replica.cc:333] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.672646 28922 raft_consensus.cc:2243] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.673261 28922 raft_consensus.cc:2272] T 15751030df864f9c84e3d822bc8b63e3 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.675962 28922 tablet_replica.cc:333] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.676530 28922 raft_consensus.cc:2243] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:55.671696 30705 consensus_peers.cc:597] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.677496 28922 raft_consensus.cc:2272] T 1df0056e71a84e3aa2756ee599e24a66 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.677994 30705 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:13:55.680356 28922 tablet_replica.cc:333] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.680980 28922 raft_consensus.cc:2243] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.681566 28922 raft_consensus.cc:2272] T d11240e2763045ecaa6122102420302e P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.683827 28922 tablet_replica.cc:333] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.684432 28922 raft_consensus.cc:2243] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.685201 28922 raft_consensus.cc:2272] T e3976f5c231948d6bd8a5345ec54d5d5 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.687119 28922 tablet_replica.cc:333] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.687692 28922 raft_consensus.cc:2243] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.688433 28922 raft_consensus.cc:2272] T fa63b06fc4f446c8b2e800abeaaeabce P ef9ab4d665234a799376bf42ef5d058c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.690482 28922 tablet_replica.cc:333] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.691023 28922 raft_consensus.cc:2243] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.692595 28922 raft_consensus.cc:2272] T 056561f84fe249b496e33c1560ab5a76 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.695245 28922 tablet_replica.cc:333] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.696050 28922 raft_consensus.cc:2243] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.697227 28922 raft_consensus.cc:2272] T 722cf622ecb54a338f6b0c13e1ce9bed P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.698045 30151 consensus_peers.cc:597] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:13:55.699374 28922 tablet_replica.cc:333] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.699991 28922 raft_consensus.cc:2243] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.701143 28922 raft_consensus.cc:2272] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.703110 28922 tablet_replica.cc:333] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.703696 28922 raft_consensus.cc:2243] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.704643 28922 raft_consensus.cc:2272] T 2a3a1d04afff45a7a0def29171749edf P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.707279 28922 tablet_replica.cc:333] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.707990 28922 raft_consensus.cc:2243] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.709306 28922 raft_consensus.cc:2272] T f86541372f8c463da3fe465d9c571876 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.710548 30151 consensus_peers.cc:597] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:13:55.711633 28922 tablet_replica.cc:333] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.712244 28922 raft_consensus.cc:2243] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.712819 28922 raft_consensus.cc:2272] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.714860 28922 tablet_replica.cc:333] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.715536 28922 raft_consensus.cc:2243] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.716455 28922 raft_consensus.cc:2272] T 9d12004749df410ea5dcce097780c358 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.718827 28922 tablet_replica.cc:333] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.720016 28922 raft_consensus.cc:2243] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.721036 28922 raft_consensus.cc:2272] T f3d5b014e8a54181ad5978055b4514b4 P ef9ab4d665234a799376bf42ef5d058c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.723126 28922 tablet_replica.cc:333] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.723706 28922 raft_consensus.cc:2243] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.724855 28922 raft_consensus.cc:2272] T 535e413e4f2b46fe966812acbf31570a P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.727928 28922 tablet_replica.cc:333] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.728739 28922 raft_consensus.cc:2243] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.730465 28922 raft_consensus.cc:2272] T 01f7556bbcd34819a44043784cacf8b2 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.734424 28922 tablet_replica.cc:333] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.735422 28922 raft_consensus.cc:2243] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.736202 28922 raft_consensus.cc:2272] T 0d31c2ecc47149adb9b7dd839def365c P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.738407 28922 tablet_replica.cc:333] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.738973 28922 raft_consensus.cc:2243] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.740051 28922 raft_consensus.cc:2272] T 6920367ae7ee4f54a639b9db0e071e84 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.742674 28922 tablet_replica.cc:333] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.743464 28922 raft_consensus.cc:2243] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.744697 28922 raft_consensus.cc:2272] T 155d3e6034f842759244a283f46a67b9 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.747493 28922 tablet_replica.cc:333] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.748102 28922 raft_consensus.cc:2243] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.749019 28922 raft_consensus.cc:2272] T 82bd288ed43e47fbabdbcfbfaca06dfb P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.751569 28922 tablet_replica.cc:333] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.752436 28922 raft_consensus.cc:2243] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.754007 28922 raft_consensus.cc:2272] T 3facd19034dd44899de7471297d45bbc P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.757054 28922 tablet_replica.cc:333] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.757987 28922 raft_consensus.cc:2243] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.758757 28922 raft_consensus.cc:2272] T ef9600254f4d48368aff10ed883134fd P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.761139 28922 tablet_replica.cc:333] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.761816 28922 raft_consensus.cc:2243] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.762907 28922 raft_consensus.cc:2272] T 9ce29391518248688fe4f7fd0e2eee7a P ef9ab4d665234a799376bf42ef5d058c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.764940 28922 tablet_replica.cc:333] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.765611 28922 raft_consensus.cc:2243] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.766824 28922 raft_consensus.cc:2272] T 396297d3a2474246b40507f61f59858c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.769644 28922 tablet_replica.cc:333] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.770435 28922 raft_consensus.cc:2243] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.771108 28922 raft_consensus.cc:2272] T 34df6751216d4ac584919e5640b25bc4 P ef9ab4d665234a799376bf42ef5d058c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.773728 28922 tablet_replica.cc:333] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.774320 28922 raft_consensus.cc:2243] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.775210 28922 raft_consensus.cc:2272] T 0c855bd93d50418aa0aec7a1a3c2e228 P ef9ab4d665234a799376bf42ef5d058c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.777204 28922 tablet_replica.cc:333] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.777921 28922 raft_consensus.cc:2243] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.779237 28922 raft_consensus.cc:2272] T b7a9a88da98d43b8a556cba3e2768e28 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.781165 28922 tablet_replica.cc:333] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.781836 28922 raft_consensus.cc:2243] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.782801 28922 raft_consensus.cc:2272] T 7a672a61589048279810adba842422a0 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.784857 28922 tablet_replica.cc:333] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.785523 28922 raft_consensus.cc:2243] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.786465 28922 raft_consensus.cc:2272] T 838f13bafde24742a950e2e4d62e21e9 P ef9ab4d665234a799376bf42ef5d058c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.788873 28922 tablet_replica.cc:333] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.789486 28922 raft_consensus.cc:2243] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.790177 28922 raft_consensus.cc:2272] T 74c6f7e90c624b64bdbb67860d561418 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.792804 28922 tablet_replica.cc:333] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.793571 28922 raft_consensus.cc:2243] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.795233 28922 raft_consensus.cc:2272] T 4c91803ea87d43adb17baf51a5093b3c P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.796598 30705 consensus_peers.cc:597] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.798002 28922 tablet_replica.cc:333] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.798867 28922 raft_consensus.cc:2243] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.799799 28922 raft_consensus.cc:2272] T 9a61c48865d1417593366ed1611c2836 P ef9ab4d665234a799376bf42ef5d058c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.802955 28922 tablet_replica.cc:333] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.803725 28922 raft_consensus.cc:2243] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.805455 28922 raft_consensus.cc:2272] T 39df33df3e0d43b5a35e334a03324f92 P ef9ab4d665234a799376bf42ef5d058c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.807587 28922 tablet_replica.cc:333] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.808135 28922 raft_consensus.cc:2243] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.808652 28922 raft_consensus.cc:2272] T 2c1b7d91eea54fb4990789f41041df86 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.810655 28922 tablet_replica.cc:333] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.811169 28922 raft_consensus.cc:2243] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.812041 28922 raft_consensus.cc:2272] T 3ff2caa8c9ec4f85b73c3be44168d116 P ef9ab4d665234a799376bf42ef5d058c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.814066 28922 tablet_replica.cc:333] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.814679 28922 raft_consensus.cc:2243] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.815537 28922 raft_consensus.cc:2272] T dadd68eba45b4971b4072c8ef0de88d5 P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.817373 28922 tablet_replica.cc:333] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.817934 28922 raft_consensus.cc:2243] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.818668 28922 raft_consensus.cc:2272] T bbc08410209249758a644676ff99841d P ef9ab4d665234a799376bf42ef5d058c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.820500 28922 tablet_replica.cc:333] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.820999 28922 raft_consensus.cc:2243] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.822090 28922 raft_consensus.cc:2272] T e0f2e33addec48d89bb483d29ce55ad4 P ef9ab4d665234a799376bf42ef5d058c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.824369 28922 tablet_replica.cc:333] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.824925 28922 raft_consensus.cc:2243] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.826113 28922 raft_consensus.cc:2272] T 813e1f3ea7f7411c9c6061753e927dfe P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.828366 28922 tablet_replica.cc:333] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.828924 28922 raft_consensus.cc:2243] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.829921 28922 raft_consensus.cc:2272] T e06bbfa07cb545c8b65a4a6f1dae9516 P ef9ab4d665234a799376bf42ef5d058c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.832728 28922 tablet_replica.cc:333] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c: stopping tablet replica
I20260709 13:13:55.833253 28922 raft_consensus.cc:2243] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.834434 28922 raft_consensus.cc:2272] T 88e3e05564894b51b12ceb093978f695 P ef9ab4d665234a799376bf42ef5d058c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.834398 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.848354 30705 consensus_peers.cc:597] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.917603 30705 consensus_peers.cc:597] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.922400 30705 consensus_peers.cc:597] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.939085 30705 consensus_peers.cc:597] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.953358  3008 raft_consensus.cc:493] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:55.954056  3008 raft_consensus.cc:515] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:55.959617  3008 leader_election.cc:290] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
W20260709 13:13:55.961850 30704 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
W20260709 13:13:55.964517 30705 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:55.964958 30705 leader_election.cc:304] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:55.965740  3008 raft_consensus.cc:2749] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:55.965798 30705 leader_election.cc:336] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111)
W20260709 13:13:56.006475 30705 consensus_peers.cc:597] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:56.099608 30705 consensus_peers.cc:597] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 -> Peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Couldn't send request to peer ef9ab4d665234a799376bf42ef5d058c. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:56.247964 30704 consensus_peers.cc:597] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:56.536978  3004 raft_consensus.cc:493] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98b3b699b87245df85d3aa84c13f5691)
I20260709 13:13:56.537581  3004 raft_consensus.cc:515] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "98b3b699b87245df85d3aa84c13f5691" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 38581 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
W20260709 13:13:56.544497 30704 consensus_peers.cc:597] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:56.546624  3004 leader_election.cc:290] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581)
W20260709 13:13:56.561239 30705 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:56.561856 30704 leader_election.cc:336] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111)
I20260709 13:13:56.562289 30704 leader_election.cc:304] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, 98b3b699b87245df85d3aa84c13f5691
I20260709 13:13:56.563030  3004 raft_consensus.cc:2749] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:56.621018 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
W20260709 13:13:56.675570 30705 consensus_peers.cc:597] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Couldn't send request to peer 34f51764a89048468a6faa21020812b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:13:56.735966 28922 tablet_server.cc:179] TabletServer@127.28.62.132:0 shutting down...
I20260709 13:13:56.796633  3004 raft_consensus.cc:493] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:56.797295  3004 raft_consensus.cc:515] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:56.799685  3004 leader_election.cc:290] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:56.804896 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:56.805972 30705 leader_election.cc:336] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:56.807063 30705 leader_election.cc:336] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111)
I20260709 13:13:56.807734 30705 leader_election.cc:304] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:56.808533  3004 raft_consensus.cc:2749] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:56.809108 28922 tablet_replica.cc:333] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.810168 28922 raft_consensus.cc:2243] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.811187 28922 raft_consensus.cc:2272] T 056561f84fe249b496e33c1560ab5a76 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.814713 28922 tablet_replica.cc:333] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.815670 28922 raft_consensus.cc:2243] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.816576 28922 raft_consensus.cc:2272] T 729e969847cf4fbcb29c2681ec03a97a P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.819778 28922 tablet_replica.cc:333] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.820804 28922 raft_consensus.cc:2243] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.821651 28922 raft_consensus.cc:2272] T cfbfe72ddc624143b4f12cb68c249a4e P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.825372 28922 tablet_replica.cc:333] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.826267 28922 raft_consensus.cc:2243] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.827557 28922 raft_consensus.cc:2272] T bbc08410209249758a644676ff99841d P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.830915 28922 tablet_replica.cc:333] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.831895 28922 raft_consensus.cc:2243] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.833174 28922 raft_consensus.cc:2272] T 2c1b7d91eea54fb4990789f41041df86 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.834403  3003 raft_consensus.cc:493] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:56.834941  3003 raft_consensus.cc:515] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:56.836313 28922 tablet_replica.cc:333] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.836999  3003 leader_election.cc:290] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:56.837327 28922 raft_consensus.cc:2243] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.838652 28922 raft_consensus.cc:2272] T 76d91f22e2654dd1ae5451605e7a3b23 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.842006 28922 tablet_replica.cc:333] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.842867 28922 raft_consensus.cc:2243] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:13:56.843448 30705 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:13:56.844384 28922 raft_consensus.cc:2272] T b7a9a88da98d43b8a556cba3e2768e28 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.844975 30704 consensus_peers.cc:597] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:56.845706 30705 leader_election.cc:336] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111)
I20260709 13:13:56.846190 30705 leader_election.cc:304] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:56.846825  3003 raft_consensus.cc:2749] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:56.847957 28922 tablet_replica.cc:333] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.848958 28922 raft_consensus.cc:2243] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.850186 28922 raft_consensus.cc:2272] T cb153e5e2ed243b6a7741de46f707450 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.853251 28922 tablet_replica.cc:333] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.854122 28922 raft_consensus.cc:2243] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.855294 28922 raft_consensus.cc:2272] T db55e372a60b4a1a9c52676be275cf56 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.858348 28922 tablet_replica.cc:333] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.859299 28922 raft_consensus.cc:2243] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.859949 28922 raft_consensus.cc:2272] T 838f13bafde24742a950e2e4d62e21e9 P 8d2f11cccca04a7683da4080ab797bd7 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.862836 28922 tablet_replica.cc:333] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.863623 28922 raft_consensus.cc:2243] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.864748 28922 raft_consensus.cc:2272] T 82bd288ed43e47fbabdbcfbfaca06dfb P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.868031 28922 tablet_replica.cc:333] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.868832 28922 raft_consensus.cc:2243] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.869473 28922 raft_consensus.cc:2272] T 155d3e6034f842759244a283f46a67b9 P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.872247 28922 tablet_replica.cc:333] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.873068 28922 raft_consensus.cc:2243] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.875124 28922 raft_consensus.cc:2272] T 3f18f2a27f1f4c5d8d0af8abe0f87bf7 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.878335 28922 tablet_replica.cc:333] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.879217 28922 raft_consensus.cc:2243] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.880144  3003 raft_consensus.cc:493] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef9ab4d665234a799376bf42ef5d058c)
I20260709 13:13:56.880628 28922 raft_consensus.cc:2272] T d99bf410d55b470d8191aa69458330db P 8d2f11cccca04a7683da4080ab797bd7 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.881242  3003 raft_consensus.cc:515] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34f51764a89048468a6faa21020812b0" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39437 } } peers { permanent_uuid: "ef9ab4d665234a799376bf42ef5d058c" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 36297 } } peers { permanent_uuid: "8d2f11cccca04a7683da4080ab797bd7" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 36585 } attrs { promote: false } }
I20260709 13:13:56.883992  3003 leader_election.cc:290] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437), ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297)
I20260709 13:13:56.884285 28922 tablet_replica.cc:333] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.886598 28922 raft_consensus.cc:2243] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.887283 28922 raft_consensus.cc:2272] T 6920367ae7ee4f54a639b9db0e071e84 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.888365 30705 leader_election.cc:336] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
W20260709 13:13:56.889146 30705 leader_election.cc:336] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef9ab4d665234a799376bf42ef5d058c (127.28.62.131:36297): Network error: Client connection negotiation failed: client connection to 127.28.62.131:36297: connect: Connection refused (error 111)
I20260709 13:13:56.889554 30705 leader_election.cc:304] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d2f11cccca04a7683da4080ab797bd7; no voters: 34f51764a89048468a6faa21020812b0, ef9ab4d665234a799376bf42ef5d058c
I20260709 13:13:56.890386 28922 tablet_replica.cc:333] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.890297  3003 raft_consensus.cc:2749] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:56.891289 28922 raft_consensus.cc:2243] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.892390 28922 raft_consensus.cc:2272] T 6d7dd6e303964f99bd9728c2f53891af P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.895835 28922 tablet_replica.cc:333] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.896672 28922 raft_consensus.cc:2243] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.897972 28922 raft_consensus.cc:2272] T 9a61c48865d1417593366ed1611c2836 P 8d2f11cccca04a7683da4080ab797bd7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.900995 28922 tablet_replica.cc:333] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.901842 28922 raft_consensus.cc:2243] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.902535 28922 raft_consensus.cc:2272] T d16b5c6cb31b4fa0bba89be17ed2c0c3 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.905474 28922 tablet_replica.cc:333] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.906443 28922 raft_consensus.cc:2243] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.907162 28922 raft_consensus.cc:2272] T 9d12004749df410ea5dcce097780c358 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.909941 28922 tablet_replica.cc:333] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.910715 28922 raft_consensus.cc:2243] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.911299 28922 raft_consensus.cc:2272] T 9b108c73739d43d89aafdc212aae9d1b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.913923 28922 tablet_replica.cc:333] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.914680 28922 raft_consensus.cc:2243] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.915725 28922 raft_consensus.cc:2272] T fa63b06fc4f446c8b2e800abeaaeabce P 8d2f11cccca04a7683da4080ab797bd7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.918411 28922 tablet_replica.cc:333] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.919137 28922 raft_consensus.cc:2243] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.920068 28922 raft_consensus.cc:2272] T 0285ca89cc9843cab1c6899c6f83dd16 P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.923046 28922 tablet_replica.cc:333] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.923882 28922 raft_consensus.cc:2243] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.924671 28922 raft_consensus.cc:2272] T 9ce29391518248688fe4f7fd0e2eee7a P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.928067 28922 tablet_replica.cc:333] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.928808 28922 raft_consensus.cc:2243] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.930037 28922 raft_consensus.cc:2272] T ef9600254f4d48368aff10ed883134fd P 8d2f11cccca04a7683da4080ab797bd7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.932776 28922 tablet_replica.cc:333] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.933616 28922 raft_consensus.cc:2243] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.934898 28922 raft_consensus.cc:2272] T 34df6751216d4ac584919e5640b25bc4 P 8d2f11cccca04a7683da4080ab797bd7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.937815 28922 tablet_replica.cc:333] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.938577 28922 raft_consensus.cc:2243] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.939216 28922 raft_consensus.cc:2272] T 813e1f3ea7f7411c9c6061753e927dfe P 8d2f11cccca04a7683da4080ab797bd7 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.942081 28922 tablet_replica.cc:333] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.942830 28922 raft_consensus.cc:2243] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.943944 28922 raft_consensus.cc:2272] T 535e413e4f2b46fe966812acbf31570a P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.946768 28922 tablet_replica.cc:333] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.947525 28922 raft_consensus.cc:2243] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.948127 28922 raft_consensus.cc:2272] T f3d5b014e8a54181ad5978055b4514b4 P 8d2f11cccca04a7683da4080ab797bd7 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.948191 30704 consensus_peers.cc:597] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 -> Peer 98b3b699b87245df85d3aa84c13f5691 (127.28.62.130:38581): Couldn't send request to peer 98b3b699b87245df85d3aa84c13f5691. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:38581: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:56.950889 28922 tablet_replica.cc:333] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.951774 28922 raft_consensus.cc:2243] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.952836 28922 raft_consensus.cc:2272] T 74c6f7e90c624b64bdbb67860d561418 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.955664 28922 tablet_replica.cc:333] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.956401 28922 raft_consensus.cc:2243] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.957664 28922 raft_consensus.cc:2272] T 3facd19034dd44899de7471297d45bbc P 8d2f11cccca04a7683da4080ab797bd7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.960558 28922 tablet_replica.cc:333] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.961244 28922 raft_consensus.cc:2243] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.962374 28922 raft_consensus.cc:2272] T fd9e5e8f77524a8e8e19542c915fb343 P 8d2f11cccca04a7683da4080ab797bd7 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.965062 28922 tablet_replica.cc:333] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.965744 28922 raft_consensus.cc:2243] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.966328 28922 raft_consensus.cc:2272] T 6065fdc6916b4a589b781d16204e51c6 P 8d2f11cccca04a7683da4080ab797bd7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.969008 28922 tablet_replica.cc:333] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7: stopping tablet replica
I20260709 13:13:56.969663 28922 raft_consensus.cc:2243] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.970224 28922 raft_consensus.cc:2272] T c0bc2d269504461f9c5ae0cdf5385b9b P 8d2f11cccca04a7683da4080ab797bd7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:57.416046 28922 tablet_server.cc:196] TabletServer@127.28.62.132:0 shutdown complete.
I20260709 13:13:57.481359 28922 master.cc:562] Master@127.28.62.190:37953 shutting down...
W20260709 13:13:57.524768 29984 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:13:57.525178 29984 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:13:57.525427 29984 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:14:08.439893 29921 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111) [suppressed 442 similar messages]
W20260709 13:14:08.444561 29921 catalog_manager.cc:4755] TS 34f51764a89048468a6faa21020812b0 (127.28.62.129:39437): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cfbfe72ddc624143b4f12cb68c249a4e: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39437: connect: Connection refused (error 111)
I20260709 13:14:11.143786 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.145156 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.145592 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5ee583f4769f453a90eb7fcae5ac930b: stopping tablet replica
I20260709 13:14:11.384492 28922 master.cc:584] Master@127.28.62.190:37953 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (192824 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:14:11.520998 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:41111
I20260709 13:14:11.522732 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.531018  3016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.531217  3013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.531973  3014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.532941 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:11.537348 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.537837 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.538029 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602851538010 us; error 0 us; skew 500 ppm
I20260709 13:14:11.538722 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.542095 28922 webserver.cc:533] Webserver started at http://127.28.62.190:40359/ using document root <none> and password file <none>
I20260709 13:14:11.542742 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.542932 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.543299 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.552398 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "486352c3a45b4734aca4453334f7e74e"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.559666 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:14:11.565680  3022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.566710 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:14:11.567224 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "486352c3a45b4734aca4453334f7e74e"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.567675 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.582383 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.584117 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.638085 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:41111
I20260709 13:14:11.638214  3073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:41111 every 8 connection(s)
I20260709 13:14:11.644330  3074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.656913  3074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: Bootstrap starting.
I20260709 13:14:11.662348  3074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.667375  3074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: No bootstrap required, opened a new log
I20260709 13:14:11.670100  3074 raft_consensus.cc:359] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER }
I20260709 13:14:11.670635  3074 raft_consensus.cc:385] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.671093  3074 raft_consensus.cc:740] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 486352c3a45b4734aca4453334f7e74e, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.671805  3074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER }
I20260709 13:14:11.672350  3074 raft_consensus.cc:399] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:11.672592  3074 raft_consensus.cc:493] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:11.673010  3074 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.678351  3074 raft_consensus.cc:515] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER }
I20260709 13:14:11.678927  3074 leader_election.cc:304] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 486352c3a45b4734aca4453334f7e74e; no voters: 
I20260709 13:14:11.680258  3074 leader_election.cc:290] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:11.680967  3077 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.682613  3077 raft_consensus.cc:697] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 1 LEADER]: Becoming Leader. State: Replica: 486352c3a45b4734aca4453334f7e74e, State: Running, Role: LEADER
I20260709 13:14:11.683478  3077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER }
I20260709 13:14:11.684129  3074 sys_catalog.cc:565] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:11.692281  3079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 486352c3a45b4734aca4453334f7e74e. Latest consensus state: current_term: 1 leader_uuid: "486352c3a45b4734aca4453334f7e74e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER } }
I20260709 13:14:11.693071  3079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.693766  3078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "486352c3a45b4734aca4453334f7e74e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "486352c3a45b4734aca4453334f7e74e" member_type: VOTER } }
I20260709 13:14:11.694589  3078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.706754 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 13:14:11.710615  3093 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 13:14:11.711105  3093 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 13:14:11.711642  3086 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:11.716993  3086 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:11.728071  3086 catalog_manager.cc:1383] Generated new cluster ID: b7a3daf6bd1a4379b9e8eed0c15f2047
I20260709 13:14:11.728509  3086 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:11.745995  3086 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:11.747707  3086 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:11.764742  3086 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: Generated new TSK 0
I20260709 13:14:11.765522  3086 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:11.774541 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.783486  3095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.783900  3096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.785531  3098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.788516 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:11.791021 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.791280 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.791532 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602851791515 us; error 0 us; skew 500 ppm
I20260709 13:14:11.792184 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.795535 28922 webserver.cc:533] Webserver started at http://127.28.62.129:35937/ using document root <none> and password file <none>
I20260709 13:14:11.796103 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.796327 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.796630 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.798005 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "f15b6c3cd4774f618572acbd29feffa2"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.804144 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:11.808301  3103 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.809597 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:11.810006 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "f15b6c3cd4774f618572acbd29feffa2"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.810307 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.826335 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.827720 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.829679 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:11.832657 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:11.832945 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.833276 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:11.833513 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:14:11.894982 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:39973
I20260709 13:14:11.895140  3165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:39973 every 8 connection(s)
I20260709 13:14:11.902112 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.912099  3170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.913581  3171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.918274  3173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.918550 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:11.921705 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.922130 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.922367 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602851922326 us; error 0 us; skew 500 ppm
I20260709 13:14:11.923283 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.926306  3166 heartbeater.cc:344] Connected to a master server at 127.28.62.190:41111
I20260709 13:14:11.926896  3166 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:11.927431 28922 webserver.cc:533] Webserver started at http://127.28.62.130:38811/ using document root <none> and password file <none>
I20260709 13:14:11.928156  3166 heartbeater.cc:507] Master 127.28.62.190:41111 requested a full tablet report, sending...
I20260709 13:14:11.928186 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.929014 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.929668 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.931783 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "445754f29ffe4648a57f8124ddf8be20"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.931852  3039 ts_manager.cc:194] Registered new tserver with Master: f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:11.934377  3039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58064
I20260709 13:14:11.938521 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:14:11.944075  3178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.945164 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:11.945654 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "445754f29ffe4648a57f8124ddf8be20"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:11.946094 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.978467 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.980453 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.982574 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:11.986119 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:11.986429 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.986739 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:11.986939 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.046547 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:46533
I20260709 13:14:12.046622  3240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:46533 every 8 connection(s)
I20260709 13:14:12.052660 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:12.063817  3244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.065035  3245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.069133  3247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:12.069908 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:12.071256 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:12.071336  3241 heartbeater.cc:344] Connected to a master server at 127.28.62.190:41111
W20260709 13:14:12.071671 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:12.071895  3241 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.071930 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602852071906 us; error 0 us; skew 500 ppm
I20260709 13:14:12.073161 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:12.073365  3241 heartbeater.cc:507] Master 127.28.62.190:41111 requested a full tablet report, sending...
I20260709 13:14:12.076699  3039 ts_manager.cc:194] Registered new tserver with Master: 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:12.077343 28922 webserver.cc:533] Webserver started at http://127.28.62.131:38189/ using document root <none> and password file <none>
I20260709 13:14:12.078119 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:12.078301 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:12.078543 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:12.078598  3039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58080
I20260709 13:14:12.080210 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-50cs"
I20260709 13:14:12.086308 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:14:12.091275  3252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.092300 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:14:12.092834 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-50cs"
I20260709 13:14:12.093235 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.108117 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.109999 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.112120 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.115347 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.115677 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.115978 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.116181 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.169457 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:35457
I20260709 13:14:12.169561  3314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:35457 every 8 connection(s)
I20260709 13:14:12.175436 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:12.184430  3318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.186568  3319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.188876  3321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:12.190021 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:12.190836  3315 heartbeater.cc:344] Connected to a master server at 127.28.62.190:41111
I20260709 13:14:12.191023 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:12.191332 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:12.191442  3315 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.191548 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602852191530 us; error 0 us; skew 500 ppm
I20260709 13:14:12.192363 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:12.192575  3315 heartbeater.cc:507] Master 127.28.62.190:41111 requested a full tablet report, sending...
I20260709 13:14:12.194888  3039 ts_manager.cc:194] Registered new tserver with Master: d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:12.195834 28922 webserver.cc:533] Webserver started at http://127.28.62.132:34823/ using document root <none> and password file <none>
I20260709 13:14:12.196453 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:12.196682 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:12.196738  3039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58092
I20260709 13:14:12.196972 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:12.198623 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-3-root/instance:
uuid: "0d7210a87d254adba064447cda99b137"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-50cs"
I20260709 13:14:12.203528 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:12.207728  3326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.208606 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:14:12.208966 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
uuid: "0d7210a87d254adba064447cda99b137"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-50cs"
I20260709 13:14:12.209273 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.238855 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.240188 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.241755 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.244611 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.244894 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.245160 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.245337 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.292932 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.132:43535
I20260709 13:14:12.293063  3388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.132:43535 every 8 connection(s)
I20260709 13:14:12.308578  3389 heartbeater.cc:344] Connected to a master server at 127.28.62.190:41111
I20260709 13:14:12.309213  3389 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.310240  3389 heartbeater.cc:507] Master 127.28.62.190:41111 requested a full tablet report, sending...
I20260709 13:14:12.312690  3039 ts_manager.cc:194] Registered new tserver with Master: 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:12.312870 28922 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016536243s
I20260709 13:14:12.314656  3039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58104
I20260709 13:14:12.342800  3039 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58114:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:14:12.609501  3354 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1f2f8cedde4cd3b992d015ba644252 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:12.611336  3354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1f2f8cedde4cd3b992d015ba644252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.616830  3353 tablet_service.cc:1511] Processing CreateTablet for tablet 94672ea4db5244b9ac8b5046a0149fec (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:12.618557  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94672ea4db5244b9ac8b5046a0149fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.619575  3352 tablet_service.cc:1511] Processing CreateTablet for tablet bd79b371bd37425ca172f8db6667a9ce (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:12.621289  3352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd79b371bd37425ca172f8db6667a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.622929  3131 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1f2f8cedde4cd3b992d015ba644252 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:12.624747  3131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1f2f8cedde4cd3b992d015ba644252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.626556  3351 tablet_service.cc:1511] Processing CreateTablet for tablet 09f56cff7d5e42d1828255add82ab240 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:12.626802  3130 tablet_service.cc:1511] Processing CreateTablet for tablet 635e301b4bec4ff889241f95afc76f35 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:12.628428  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635e301b4bec4ff889241f95afc76f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.628983  3127 tablet_service.cc:1511] Processing CreateTablet for tablet 09f56cff7d5e42d1828255add82ab240 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:12.630031  3280 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1f2f8cedde4cd3b992d015ba644252 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:12.630736  3127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f56cff7d5e42d1828255add82ab240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.630966  3129 tablet_service.cc:1511] Processing CreateTablet for tablet 94672ea4db5244b9ac8b5046a0149fec (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:12.631840  3280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1f2f8cedde4cd3b992d015ba644252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.634079  3279 tablet_service.cc:1511] Processing CreateTablet for tablet 635e301b4bec4ff889241f95afc76f35 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:12.635308  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 30dfc159d3e44c748c3eba625cfb200a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:12.636113  3279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635e301b4bec4ff889241f95afc76f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.638487  3278 tablet_service.cc:1511] Processing CreateTablet for tablet bd79b371bd37425ca172f8db6667a9ce (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:12.643337  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 491c3de1fd26459c8e5bb1b42dbfa546 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:12.633147  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94672ea4db5244b9ac8b5046a0149fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.653455  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd79b371bd37425ca172f8db6667a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.654830  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c3de1fd26459c8e5bb1b42dbfa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.655962  3275 tablet_service.cc:1511] Processing CreateTablet for tablet b3212147d3064988b5c1ad49eb50d04d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:12.638016  3277 tablet_service.cc:1511] Processing CreateTablet for tablet 30dfc159d3e44c748c3eba625cfb200a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:12.659500  3349 tablet_service.cc:1511] Processing CreateTablet for tablet b3212147d3064988b5c1ad49eb50d04d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:12.639724  3276 tablet_service.cc:1511] Processing CreateTablet for tablet 491c3de1fd26459c8e5bb1b42dbfa546 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:12.659967  3125 tablet_service.cc:1511] Processing CreateTablet for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:12.628360  3351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f56cff7d5e42d1828255add82ab240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.661598  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.663508  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:12.661624  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3212147d3064988b5c1ad49eb50d04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.666975  3348 tablet_service.cc:1511] Processing CreateTablet for tablet 0d533b92378e42ffb969e732f2b89ea5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:12.668984  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d533b92378e42ffb969e732f2b89ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.670049  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.669602  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 0d533b92378e42ffb969e732f2b89ea5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:12.671661  3275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3212147d3064988b5c1ad49eb50d04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.671792  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d533b92378e42ffb969e732f2b89ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.643198  3350 tablet_service.cc:1511] Processing CreateTablet for tablet 491c3de1fd26459c8e5bb1b42dbfa546 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:12.674496  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dfc159d3e44c748c3eba625cfb200a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.675379  3350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c3de1fd26459c8e5bb1b42dbfa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.680197  3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c3de1fd26459c8e5bb1b42dbfa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.683854  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 213ebf5b3e5548359ec47659f5461eed (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:12.685542  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213ebf5b3e5548359ec47659f5461eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.686162  3347 tablet_service.cc:1511] Processing CreateTablet for tablet 213ebf5b3e5548359ec47659f5461eed (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:12.688073  3347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213ebf5b3e5548359ec47659f5461eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.690966  3277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dfc159d3e44c748c3eba625cfb200a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:12.702059  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:12.719502  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 213ebf5b3e5548359ec47659f5461eed (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:12.721114  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213ebf5b3e5548359ec47659f5461eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.734179  3272 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2be9da907458e82ba3b70769eaab4 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:12.735841  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2be9da907458e82ba3b70769eaab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.752719  3346 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2be9da907458e82ba3b70769eaab4 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:12.754388  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2be9da907458e82ba3b70769eaab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.758757  3122 tablet_service.cc:1511] Processing CreateTablet for tablet b2a76547731d4f008e06b068ba25d7d0 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:12.760488  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a76547731d4f008e06b068ba25d7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.770901  3271 tablet_service.cc:1511] Processing CreateTablet for tablet b2a76547731d4f008e06b068ba25d7d0 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:12.772585  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a76547731d4f008e06b068ba25d7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.819908  3409 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:12.850353  3129 tablet_service.cc:1511] Processing CreateTablet for tablet a1e914af73c7464c8a474702750e862f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:12.852468  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e914af73c7464c8a474702750e862f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.909857  3345 tablet_service.cc:1511] Processing CreateTablet for tablet a1e914af73c7464c8a474702750e862f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:12.911815  3345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e914af73c7464c8a474702750e862f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.920370  3409 tablet_bootstrap.cc:654] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.926647  3205 tablet_service.cc:1511] Processing CreateTablet for tablet 94672ea4db5244b9ac8b5046a0149fec (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:12.946343  3272 tablet_service.cc:1511] Processing CreateTablet for tablet 0f650af1337541488d26f54b98a050df (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:12.931622  3206 tablet_service.cc:1511] Processing CreateTablet for tablet 635e301b4bec4ff889241f95afc76f35 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:12.934587  3203 tablet_service.cc:1511] Processing CreateTablet for tablet 30dfc159d3e44c748c3eba625cfb200a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:12.947324  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2be9da907458e82ba3b70769eaab4 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:12.935925  3201 tablet_service.cc:1511] Processing CreateTablet for tablet b3212147d3064988b5c1ad49eb50d04d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:12.939571  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:12.936740  3202 tablet_service.cc:1511] Processing CreateTablet for tablet 09f56cff7d5e42d1828255add82ab240 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:12.940362  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 0d533b92378e42ffb969e732f2b89ea5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:12.934587  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 54b9bc7bb2494d188055fd77fbdd0c93 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:12.949717  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b9bc7bb2494d188055fd77fbdd0c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.950152  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f650af1337541488d26f54b98a050df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.907951  3410 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:12.943540  3279 tablet_service.cc:1511] Processing CreateTablet for tablet 54b9bc7bb2494d188055fd77fbdd0c93 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:12.943747  3197 tablet_service.cc:1511] Processing CreateTablet for tablet b2a76547731d4f008e06b068ba25d7d0 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:12.945649  3166 heartbeater.cc:499] Master 127.28.62.190:41111 was elected leader, sending a full tablet report...
I20260709 13:14:12.966173  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 302a732ff54a4673bd480a2aa501cfa1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:12.967803  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302a732ff54a4673bd480a2aa501cfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.946794  3205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94672ea4db5244b9ac8b5046a0149fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.928705  3204 tablet_service.cc:1511] Processing CreateTablet for tablet bd79b371bd37425ca172f8db6667a9ce (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:12.974354  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd79b371bd37425ca172f8db6667a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.976831  3278 tablet_service.cc:1511] Processing CreateTablet for tablet 302a732ff54a4673bd480a2aa501cfa1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:12.983942  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 635e301b4bec4ff889241f95afc76f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.985034  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3212147d3064988b5c1ad49eb50d04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.989945  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d533b92378e42ffb969e732f2b89ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.992470  3203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dfc159d3e44c748c3eba625cfb200a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.993981  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9436ea12f5e14810aef6c3bb3c5e4f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.998113  3202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f56cff7d5e42d1828255add82ab240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.000723  3353 tablet_service.cc:1511] Processing CreateTablet for tablet 54b9bc7bb2494d188055fd77fbdd0c93 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:13.001878  3197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a76547731d4f008e06b068ba25d7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.002236  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b9bc7bb2494d188055fd77fbdd0c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.017781  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2be9da907458e82ba3b70769eaab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.018170  3410 tablet_bootstrap.cc:654] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.034089  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302a732ff54a4673bd480a2aa501cfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.054250  3279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b9bc7bb2494d188055fd77fbdd0c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.066413  3410 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:13.078737  3348 tablet_service.cc:1511] Processing CreateTablet for tablet 0f650af1337541488d26f54b98a050df (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:13.080472  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f650af1337541488d26f54b98a050df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.081491  3411 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:13.081679  3241 heartbeater.cc:499] Master 127.28.62.190:41111 was elected leader, sending a full tablet report...
I20260709 13:14:13.082028  3349 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4b7ad2aa204fb1912df90f00ccde0a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:13.087042  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4b7ad2aa204fb1912df90f00ccde0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.088771  3273 tablet_service.cc:1511] Processing CreateTablet for tablet fd93a03a51b6448b86959645526e2dd1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:13.090246  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd93a03a51b6448b86959645526e2dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.070583  3410 ts_tablet_manager.cc:1403] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.024s
I20260709 13:14:13.066459  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4b7ad2aa204fb1912df90f00ccde0a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:13.127671  3414 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:13.127526  3345 tablet_service.cc:1511] Processing CreateTablet for tablet fd93a03a51b6448b86959645526e2dd1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:13.129144  3345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd93a03a51b6448b86959645526e2dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.128975  3205 tablet_service.cc:1511] Processing CreateTablet for tablet a1e914af73c7464c8a474702750e862f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:13.130345  3205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e914af73c7464c8a474702750e862f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.124152  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4b7ad2aa204fb1912df90f00ccde0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.140525  3126 tablet_service.cc:1511] Processing CreateTablet for tablet fd93a03a51b6448b86959645526e2dd1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:13.155972  3205 tablet_service.cc:1511] Processing CreateTablet for tablet 0f650af1337541488d26f54b98a050df (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:13.157445  3205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f650af1337541488d26f54b98a050df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.157124  3276 tablet_service.cc:1511] Processing CreateTablet for tablet 90595259a0e645f18c3ca5eafdf245f2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:13.158556  3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90595259a0e645f18c3ca5eafdf245f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.163273  3410 raft_consensus.cc:359] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:13.174431  3410 raft_consensus.cc:385] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.167709  3204 tablet_service.cc:1511] Processing CreateTablet for tablet 302a732ff54a4673bd480a2aa501cfa1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:13.177606  3205 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4b7ad2aa204fb1912df90f00ccde0a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:13.178478  3414 tablet_bootstrap.cc:654] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.179469  3205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4b7ad2aa204fb1912df90f00ccde0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.176971  3410 raft_consensus.cc:740] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.173105  3411 tablet_bootstrap.cc:654] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.182129  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302a732ff54a4673bd480a2aa501cfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.177060  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 90595259a0e645f18c3ca5eafdf245f2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:13.196808  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90595259a0e645f18c3ca5eafdf245f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.197678  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd93a03a51b6448b86959645526e2dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.199826  3315 heartbeater.cc:499] Master 127.28.62.190:41111 was elected leader, sending a full tablet report...
I20260709 13:14:13.203985  3410 consensus_queue.cc:260] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:13.229802  3025 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 45381.7us
I20260709 13:14:13.232738  3410 ts_tablet_manager.cc:1434] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.003s
I20260709 13:14:13.236536  3410 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:13.238179  3346 tablet_service.cc:1511] Processing CreateTablet for tablet 90595259a0e645f18c3ca5eafdf245f2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:13.248112  3130 tablet_service.cc:1511] Processing CreateTablet for tablet cef153cabc764fe2ba8ac3fb612bf68c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:13.249634  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef153cabc764fe2ba8ac3fb612bf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.269791  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90595259a0e645f18c3ca5eafdf245f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.262912  3409 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:13.274341  3409 ts_tablet_manager.cc:1403] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.455s	user 0.020s	sys 0.009s
I20260709 13:14:13.277118  3410 tablet_bootstrap.cc:654] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.277630  3409 raft_consensus.cc:359] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.290839  3409 raft_consensus.cc:385] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.291227  3409 raft_consensus.cc:740] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.292122  3409 consensus_queue.cc:260] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.282778  3411 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:13.300705  3411 ts_tablet_manager.cc:1403] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.004s
I20260709 13:14:13.302989  3414 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:13.303645  3414 ts_tablet_manager.cc:1403] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.000s
I20260709 13:14:13.304193  3411 raft_consensus.cc:359] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.305022  3411 raft_consensus.cc:385] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.307271  3414 raft_consensus.cc:359] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.308036  3414 raft_consensus.cc:385] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.308336  3414 raft_consensus.cc:740] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.309156  3414 consensus_queue.cc:260] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.324342  3389 heartbeater.cc:499] Master 127.28.62.190:41111 was elected leader, sending a full tablet report...
I20260709 13:14:13.324446  3409 ts_tablet_manager.cc:1434] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 13:14:13.326866  3200 tablet_service.cc:1511] Processing CreateTablet for tablet cef153cabc764fe2ba8ac3fb612bf68c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:13.328465  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef153cabc764fe2ba8ac3fb612bf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.330510  3278 tablet_service.cc:1511] Processing CreateTablet for tablet cef153cabc764fe2ba8ac3fb612bf68c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:13.331975  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cef153cabc764fe2ba8ac3fb612bf68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.335443  3409 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:13.339869  3345 tablet_service.cc:1511] Processing CreateTablet for tablet 161c10ebbba04c93bd1debaffb57b9f3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:13.341390  3345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161c10ebbba04c93bd1debaffb57b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.346488  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 161c10ebbba04c93bd1debaffb57b9f3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:13.347962  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 161c10ebbba04c93bd1debaffb57b9f3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:13.346645  3279 tablet_service.cc:1511] Processing CreateTablet for tablet fd631ae86be54b36b7ed84e2b1b50a68 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:13.348685  3353 tablet_service.cc:1511] Processing CreateTablet for tablet fd631ae86be54b36b7ed84e2b1b50a68 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:13.350701  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161c10ebbba04c93bd1debaffb57b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.350792  3206 tablet_service.cc:1511] Processing CreateTablet for tablet d121904185e8450abb721293cc7b640f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:13.351564  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd631ae86be54b36b7ed84e2b1b50a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.352303  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121904185e8450abb721293cc7b640f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.349180  3128 tablet_service.cc:1511] Processing CreateTablet for tablet fd631ae86be54b36b7ed84e2b1b50a68 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:13.354331  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd631ae86be54b36b7ed84e2b1b50a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.359627  3276 tablet_service.cc:1511] Processing CreateTablet for tablet d121904185e8450abb721293cc7b640f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:13.350701  3279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd631ae86be54b36b7ed84e2b1b50a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.360692  3349 tablet_service.cc:1511] Processing CreateTablet for tablet d121904185e8450abb721293cc7b640f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:13.364060  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121904185e8450abb721293cc7b640f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.365267  3130 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:13.369693  3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d121904185e8450abb721293cc7b640f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.305343  3411 raft_consensus.cc:740] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.374383  3411 consensus_queue.cc:260] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.381242  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 161c10ebbba04c93bd1debaffb57b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.387609  3204 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:13.393672  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.400269  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.402637  3167 tablet.cc:2406] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:13.402585  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:13.404294  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa5d68f72ea43e8973ceedb1ddfcb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.426535  3409 tablet_bootstrap.cc:654] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.437170  3414 ts_tablet_manager.cc:1434] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.133s	user 0.031s	sys 0.052s
I20260709 13:14:13.446296  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecb53642c2843ecaa6e646c37b94237 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:13.447866  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb53642c2843ecaa6e646c37b94237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.449600  3129 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecb53642c2843ecaa6e646c37b94237 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:13.451148  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb53642c2843ecaa6e646c37b94237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.439518  3348 tablet_service.cc:1511] Processing CreateTablet for tablet 44413e6de00643eb907ef2494cacf07d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:13.452539  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 44413e6de00643eb907ef2494cacf07d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:13.454012  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44413e6de00643eb907ef2494cacf07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.454548  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 12d502876a864c95a9caf2957c69812b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:13.458388  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d502876a864c95a9caf2957c69812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.458164  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 12d502876a864c95a9caf2957c69812b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:13.459669  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d502876a864c95a9caf2957c69812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.446372  3414 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:13.458164  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 44413e6de00643eb907ef2494cacf07d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:13.463804  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44413e6de00643eb907ef2494cacf07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.453313  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44413e6de00643eb907ef2494cacf07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.488333  3349 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecb53642c2843ecaa6e646c37b94237 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:13.490593  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb53642c2843ecaa6e646c37b94237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.501792  3410 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:13.502455  3410 ts_tablet_manager.cc:1403] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.009s
I20260709 13:14:13.522679  3411 ts_tablet_manager.cc:1434] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.222s	user 0.013s	sys 0.004s
I20260709 13:14:13.526645  3411 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:13.533174  3345 tablet_service.cc:1511] Processing CreateTablet for tablet 12d502876a864c95a9caf2957c69812b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:13.533998  3409 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:13.534518  3409 ts_tablet_manager.cc:1403] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.200s	user 0.027s	sys 0.050s
I20260709 13:14:13.534758  3345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d502876a864c95a9caf2957c69812b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.538065  3409 raft_consensus.cc:359] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.538971  3409 raft_consensus.cc:385] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.539291  3409 raft_consensus.cc:740] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.534528  3410 raft_consensus.cc:359] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.542501  3410 raft_consensus.cc:385] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.542829  3410 raft_consensus.cc:740] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.547011  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 04212fef1d744adb9d0591162c6db6b6 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:13.548688  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04212fef1d744adb9d0591162c6db6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.549492  3414 tablet_bootstrap.cc:654] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.550076  3206 tablet_service.cc:1511] Processing CreateTablet for tablet 04212fef1d744adb9d0591162c6db6b6 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:13.551506  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04212fef1d744adb9d0591162c6db6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.552284  3353 tablet_service.cc:1511] Processing CreateTablet for tablet ba17a83551cc4376a2c46e57f9cf2ed1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:13.553661  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba17a83551cc4376a2c46e57f9cf2ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.554543  3278 tablet_service.cc:1511] Processing CreateTablet for tablet 04212fef1d744adb9d0591162c6db6b6 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:13.555346  3122 tablet_service.cc:1511] Processing CreateTablet for tablet ba17a83551cc4376a2c46e57f9cf2ed1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:13.555955  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04212fef1d744adb9d0591162c6db6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.556615  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba17a83551cc4376a2c46e57f9cf2ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.559854  3410 consensus_queue.cc:260] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.564752  3410 ts_tablet_manager.cc:1434] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.005s
I20260709 13:14:13.582793  3204 tablet_service.cc:1511] Processing CreateTablet for tablet ba17a83551cc4376a2c46e57f9cf2ed1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:13.584259  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba17a83551cc4376a2c46e57f9cf2ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.592042  3421 raft_consensus.cc:493] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.592921  3421 raft_consensus.cc:515] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.597280  3271 tablet_service.cc:1511] Processing CreateTablet for tablet d06abc8907064e7fa5e6b6da9b9f0104 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:13.599150  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06abc8907064e7fa5e6b6da9b9f0104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.604604  3416 raft_consensus.cc:493] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.604936  3421 leader_election.cc:290] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:13.605233  3416 raft_consensus.cc:515] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:13.605947  3414 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:13.613039  3424 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.613621  3424 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.606518  3414 ts_tablet_manager.cc:1403] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.003s
I20260709 13:14:13.637208  3411 tablet_bootstrap.cc:654] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.626746  3424 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:13.643693  3419 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.644135  3410 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:13.644749  3416 leader_election.cc:290] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:13.593444  3409 consensus_queue.cc:260] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.675951  3418 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.666803  3419 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.677500  3418 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.694365  3414 raft_consensus.cc:359] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.695262  3414 raft_consensus.cc:385] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.694998  3348 tablet_service.cc:1511] Processing CreateTablet for tablet d06abc8907064e7fa5e6b6da9b9f0104 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:13.695605  3414 raft_consensus.cc:740] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.696570  3414 consensus_queue.cc:260] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.696600  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06abc8907064e7fa5e6b6da9b9f0104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.699487  3349 tablet_service.cc:1511] Processing CreateTablet for tablet 58c68824dda743d8b97417c774968f45 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:13.702075  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c68824dda743d8b97417c774968f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.682145  3419 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:13.707515  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:13.727129  3418 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:13.735888  3409 ts_tablet_manager.cc:1434] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.201s	user 0.010s	sys 0.000s
I20260709 13:14:13.737246  3409 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:13.772545  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 58c68824dda743d8b97417c774968f45 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:13.774827  3129 tablet_service.cc:1511] Processing CreateTablet for tablet d06abc8907064e7fa5e6b6da9b9f0104 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:13.796476  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c68824dda743d8b97417c774968f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.801005  3353 tablet_service.cc:1511] Processing CreateTablet for tablet ebc82eb45cde416fa64698383ea73ce1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:13.802897  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc82eb45cde416fa64698383ea73ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.795982  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 543ba4118aea4f4a896a49c4a10875e5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:13.816623  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 543ba4118aea4f4a896a49c4a10875e5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:13.818397  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ba4118aea4f4a896a49c4a10875e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.818714  3130 tablet_service.cc:1511] Processing CreateTablet for tablet ebc82eb45cde416fa64698383ea73ce1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:13.826203  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 543ba4118aea4f4a896a49c4a10875e5 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:13.827679  3410 tablet_bootstrap.cc:654] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.827682  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ba4118aea4f4a896a49c4a10875e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.832875  3409 tablet_bootstrap.cc:654] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.832515  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:13.835278  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06abc8907064e7fa5e6b6da9b9f0104. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.843281  3328 leader_election.cc:343] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.843480  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:13.844121  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:13.836450  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 58c68824dda743d8b97417c774968f45 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:13.845281  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:13.846485  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c68824dda743d8b97417c774968f45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.851444  3106 leader_election.cc:343] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.851819  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc82eb45cde416fa64698383ea73ce1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.852337  3106 leader_election.cc:343] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.855971  3414 ts_tablet_manager.cc:1434] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.228s	user 0.011s	sys 0.019s
I20260709 13:14:13.857136  3414 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:13.862578  3206 tablet_service.cc:1511] Processing CreateTablet for tablet ebc82eb45cde416fa64698383ea73ce1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:13.863914  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:13.864192  3414 tablet_bootstrap.cc:654] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:13.865696  3106 leader_election.cc:343] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.866292  3106 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:13.867241  3418 raft_consensus.cc:2749] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.864116  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc82eb45cde416fa64698383ea73ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.876899  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:13.882009  3216 raft_consensus.cc:2468] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
W20260709 13:14:13.882256  3329 leader_election.cc:343] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.884647  3104 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:13.889562  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 543ba4118aea4f4a896a49c4a10875e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.890313  3418 raft_consensus.cc:2804] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.890812  3418 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.891208  3418 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.891623  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:13.893983  3253 leader_election.cc:343] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.906639  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:13.907279  3416 raft_consensus.cc:493] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.907802  3416 raft_consensus.cc:515] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.912333  3124 tablet_service.cc:1511] Processing CreateTablet for tablet eb1ead8560d7474aa8151592a32d2504 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:13.913971  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1ead8560d7474aa8151592a32d2504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.915738  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:13.916559  3216 raft_consensus.cc:2468] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:13.918249  3253 leader_election.cc:304] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:13.918586  3349 tablet_service.cc:1511] Processing CreateTablet for tablet eb1ead8560d7474aa8151592a32d2504 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:13.923848  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1ead8560d7474aa8151592a32d2504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.924911  3204 tablet_service.cc:1511] Processing CreateTablet for tablet 68e1a9ca444a4778b0939095c9d3b4b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:13.926364  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e1a9ca444a4778b0939095c9d3b4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.920933  3416 leader_election.cc:290] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:13.928963  3418 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.935844  3271 tablet_service.cc:1511] Processing CreateTablet for tablet eb1ead8560d7474aa8151592a32d2504 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:13.938210  3416 raft_consensus.cc:2804] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.945065  3416 raft_consensus.cc:493] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.945638  3416 raft_consensus.cc:3060] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.902878  3329 leader_election.cc:304] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:13.947137  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1ead8560d7474aa8151592a32d2504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.961623  3141 raft_consensus.cc:2393] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:13.962795  3421 raft_consensus.cc:2749] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.968815  3348 tablet_service.cc:1511] Processing CreateTablet for tablet 68e1a9ca444a4778b0939095c9d3b4b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:13.970399  3411 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:13.971392  3411 ts_tablet_manager.cc:1403] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.445s	user 0.024s	sys 0.028s
I20260709 13:14:13.971624  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:13.972185  3418 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:13.972443  3216 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:13.973532  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 91474.7us
I20260709 13:14:13.975828  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:13.976162  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc0b5eeeb9a42c4a9407009215af4c1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:13.970469  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e1a9ca444a4778b0939095c9d3b4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.977717  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc0b5eeeb9a42c4a9407009215af4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.980216  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc0b5eeeb9a42c4a9407009215af4c1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:13.980464  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:13.982488  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc0b5eeeb9a42c4a9407009215af4c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.982551  3255 leader_election.cc:343] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.983448  3410 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:13.984009  3410 ts_tablet_manager.cc:1403] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.362s	user 0.015s	sys 0.011s
I20260709 13:14:13.985538  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:13.985460  3414 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:13.986995  3414 ts_tablet_manager.cc:1403] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.029s
I20260709 13:14:13.988408  3411 raft_consensus.cc:359] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.986186  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:13.989827  3106 leader_election.cc:343] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:13.991209  3254 leader_election.cc:343] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.991005  3410 raft_consensus.cc:359] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.991989  3254 leader_election.cc:304] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:13.992170  3410 raft_consensus.cc:385] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.993042  3444 raft_consensus.cc:2749] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.992614  3410 raft_consensus.cc:740] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.995121  3410 consensus_queue.cc:260] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:13.995728  3278 tablet_service.cc:1511] Processing CreateTablet for tablet 68e1a9ca444a4778b0939095c9d3b4b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:13.989283  3411 raft_consensus.cc:385] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.997550  3411 raft_consensus.cc:740] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.998368  3411 consensus_queue.cc:260] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:13.998569  3276 tablet_service.cc:1511] Processing CreateTablet for tablet 3bc0b5eeeb9a42c4a9407009215af4c1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:13.999476  3362 raft_consensus.cc:2468] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:14.000033  3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc0b5eeeb9a42c4a9407009215af4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.002334  3181 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:14.003216  3411 ts_tablet_manager.cc:1434] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:14:14.004474  3411 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:14.002369  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e1a9ca444a4778b0939095c9d3b4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.020498  3411 tablet_bootstrap.cc:654] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.020761  3410 ts_tablet_manager.cc:1434] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:14:14.022145  3410 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:14.029211  3410 tablet_bootstrap.cc:654] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.043841  3416 raft_consensus.cc:515] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.047885  3410 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:14.090128  3410 ts_tablet_manager.cc:1403] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.006s
I20260709 13:14:14.091313  3353 tablet_service.cc:1511] Processing CreateTablet for tablet bcbc57c19cbf45639b5504d44069ba50 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:14.092864  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbc57c19cbf45639b5504d44069ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.049508  3216 raft_consensus.cc:2468] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:13.991144  3414 raft_consensus.cc:359] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.094136  3440 raft_consensus.cc:2764] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:14.094646  3104 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:14.095165  3410 raft_consensus.cc:359] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.095940  3418 raft_consensus.cc:2804] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.096125  3410 raft_consensus.cc:385] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.096568  3418 raft_consensus.cc:697] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:14.096627  3410 raft_consensus.cc:740] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.094175  3414 raft_consensus.cc:385] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.097514  3414 raft_consensus.cc:740] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.097697  3418 consensus_queue.cc:237] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.097815  3410 consensus_queue.cc:260] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.098471  3414 consensus_queue.cc:260] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.082887  3409 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:14.100975  3414 ts_tablet_manager.cc:1434] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 13:14:14.084359  3200 tablet_service.cc:1511] Processing CreateTablet for tablet ec41f0b588b54cef878b9f2521faccf2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:14.101423  3409 ts_tablet_manager.cc:1403] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.364s	user 0.032s	sys 0.022s
I20260709 13:14:14.085273  3349 tablet_service.cc:1511] Processing CreateTablet for tablet ec41f0b588b54cef878b9f2521faccf2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:14.102763  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec41f0b588b54cef878b9f2521faccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.109838  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:14.110531  3216 raft_consensus.cc:3060] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.111231  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec41f0b588b54cef878b9f2521faccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.114379  3122 tablet_service.cc:1511] Processing CreateTablet for tablet bcbc57c19cbf45639b5504d44069ba50 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:14.115840  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbc57c19cbf45639b5504d44069ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.105194  3409 raft_consensus.cc:359] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.126555  3409 raft_consensus.cc:385] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.126894  3409 raft_consensus.cc:740] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.127640  3409 consensus_queue.cc:260] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.130373  3345 tablet_service.cc:1511] Processing CreateTablet for tablet 06e5cb02e52a438e964626a80223bbf1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:14.131172  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 06e5cb02e52a438e964626a80223bbf1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:14.131855  3345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e5cb02e52a438e964626a80223bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.132486  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e5cb02e52a438e964626a80223bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.120275  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:14.133890  3444 raft_consensus.cc:493] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.121155  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 06e5cb02e52a438e964626a80223bbf1 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:14.134377  3444 raft_consensus.cc:515] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:14.134893  3255 leader_election.cc:343] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.135691  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e5cb02e52a438e964626a80223bbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.136888  3444 leader_election.cc:290] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.138950  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:14.139575  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:14.110543  3414 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:14.100975  3410 ts_tablet_manager.cc:1434] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:14:14.145241  3409 ts_tablet_manager.cc:1434] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
W20260709 13:14:14.145721  3253 leader_election.cc:343] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.146894  3409 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:14.147439  3255 leader_election.cc:343] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.147933  3255 leader_election.cc:304] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:14.148630  3130 tablet_service.cc:1511] Processing CreateTablet for tablet cf6f299d36fd4914a70ec6a42cd7b6b3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:14.149226  3444 raft_consensus.cc:2749] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.119042  3416 leader_election.cc:290] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.150044  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6f299d36fd4914a70ec6a42cd7b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.118496  3216 raft_consensus.cc:2468] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:14.117090  3276 tablet_service.cc:1511] Processing CreateTablet for tablet bcbc57c19cbf45639b5504d44069ba50 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:14.154634  3253 leader_election.cc:304] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:14.156054  3416 raft_consensus.cc:2804] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.156533  3416 raft_consensus.cc:697] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:14.157284  3411 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:14.157891  3411 ts_tablet_manager.cc:1403] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.032s
I20260709 13:14:14.157352  3416 consensus_queue.cc:237] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.161067  3410 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:14.165266  3348 tablet_service.cc:1511] Processing CreateTablet for tablet 63dc51b539a24310ac2d3e91b733fc8a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:14.165969  3276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbc57c19cbf45639b5504d44069ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.168478  3409 tablet_bootstrap.cc:654] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.169086  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 63dc51b539a24310ac2d3e91b733fc8a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:14.179261  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63dc51b539a24310ac2d3e91b733fc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.171212  3271 tablet_service.cc:1511] Processing CreateTablet for tablet cf6f299d36fd4914a70ec6a42cd7b6b3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:14.171490  3204 tablet_service.cc:1511] Processing CreateTablet for tablet 63dc51b539a24310ac2d3e91b733fc8a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:14.182353  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63dc51b539a24310ac2d3e91b733fc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.167752  3039 catalog_manager.cc:5697] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.173552  3206 tablet_service.cc:1511] Processing CreateTablet for tablet cf6f299d36fd4914a70ec6a42cd7b6b3 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:14.184072  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6f299d36fd4914a70ec6a42cd7b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.173554  3274 tablet_service.cc:1511] Processing CreateTablet for tablet e63193ea538e42d1913abde82e22fbda (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:14.182355  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6f299d36fd4914a70ec6a42cd7b6b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.186201  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63193ea538e42d1913abde82e22fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.125627  3126 tablet_service.cc:1511] Processing CreateTablet for tablet ec41f0b588b54cef878b9f2521faccf2 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:14.193312  3346 tablet_service.cc:1511] Processing CreateTablet for tablet e63193ea538e42d1913abde82e22fbda (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:14.190440  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63dc51b539a24310ac2d3e91b733fc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.194367  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec41f0b588b54cef878b9f2521faccf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.211886  3198 tablet_service.cc:1511] Processing CreateTablet for tablet e0bca49e16e1444591119e2dd581d328 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:14.222177  3347 tablet_service.cc:1511] Processing CreateTablet for tablet e0bca49e16e1444591119e2dd581d328 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:14.207921  3129 tablet_service.cc:1511] Processing CreateTablet for tablet e63193ea538e42d1913abde82e22fbda (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:14.205911  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63193ea538e42d1913abde82e22fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.198299  3411 raft_consensus.cc:359] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.232705  3411 raft_consensus.cc:385] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.233074  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 84775eef96c643ac81766e32fa580a4e (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:14.233055  3411 raft_consensus.cc:740] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.234954  3440 raft_consensus.cc:493] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.235437  3440 raft_consensus.cc:515] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.217419  3278 tablet_service.cc:1511] Processing CreateTablet for tablet e0bca49e16e1444591119e2dd581d328 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:14.239215  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bca49e16e1444591119e2dd581d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.241948  3410 tablet_bootstrap.cc:654] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.251459  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63193ea538e42d1913abde82e22fbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.254267  3279 tablet_service.cc:1511] Processing CreateTablet for tablet 84775eef96c643ac81766e32fa580a4e (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:14.255914  3279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84775eef96c643ac81766e32fa580a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.257798  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84775eef96c643ac81766e32fa580a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.249833  3411 consensus_queue.cc:260] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.258239  3440 leader_election.cc:290] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:14.259680  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:14.260252  3411 ts_tablet_manager.cc:1434] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.008s
I20260709 13:14:14.260080  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:14.261749  3180 leader_election.cc:343] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.262928  3414 tablet_bootstrap.cc:654] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.268900  3038 catalog_manager.cc:5697] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.272316  3199 tablet_service.cc:1511] Processing CreateTablet for tablet 84775eef96c643ac81766e32fa580a4e (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:14.273712  3411 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:14.275483  3347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bca49e16e1444591119e2dd581d328. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:14.278734  3181 leader_election.cc:343] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.279301  3181 leader_election.cc:304] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:14.280603  3440 raft_consensus.cc:2749] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.282300  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0bca49e16e1444591119e2dd581d328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.283520  3353 tablet_service.cc:1511] Processing CreateTablet for tablet c2d9a2a7adeb4cec89a15b5825dd2b84 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:14.285197  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d9a2a7adeb4cec89a15b5825dd2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.290267  3201 tablet_service.cc:1511] Processing CreateTablet for tablet c2d9a2a7adeb4cec89a15b5825dd2b84 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:14.297922  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84775eef96c643ac81766e32fa580a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.304365  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d9a2a7adeb4cec89a15b5825dd2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.305137  3271 tablet_service.cc:1511] Processing CreateTablet for tablet cbbc30fbceeb4d5089322bab45cb7e92 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:14.306497  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbc30fbceeb4d5089322bab45cb7e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.318416  3124 tablet_service.cc:1511] Processing CreateTablet for tablet c2d9a2a7adeb4cec89a15b5825dd2b84 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:14.343006  3198 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c04ed8911404c8d0a9c6aecbf3f71 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:14.343376  3273 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c04ed8911404c8d0a9c6aecbf3f71 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:14.344853  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c04ed8911404c8d0a9c6aecbf3f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.344887  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c04ed8911404c8d0a9c6aecbf3f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.352186  3409 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:14.352968  3409 ts_tablet_manager.cc:1403] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.207s	user 0.016s	sys 0.013s
I20260709 13:14:14.355047  3130 tablet_service.cc:1511] Processing CreateTablet for tablet cbbc30fbceeb4d5089322bab45cb7e92 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:14.357048  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbc30fbceeb4d5089322bab45cb7e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.360339  3409 raft_consensus.cc:359] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.361291  3409 raft_consensus.cc:385] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.374419  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d9a2a7adeb4cec89a15b5825dd2b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.375996  3414 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:14.376665  3414 ts_tablet_manager.cc:1403] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.266s	user 0.019s	sys 0.002s
I20260709 13:14:14.379278  3122 tablet_service.cc:1511] Processing CreateTablet for tablet 29fbebd988e2438d9be8247d581ce029 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:14.380767  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fbebd988e2438d9be8247d581ce029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.382622  3204 tablet_service.cc:1511] Processing CreateTablet for tablet 29fbebd988e2438d9be8247d581ce029 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:14.384171  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fbebd988e2438d9be8247d581ce029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.383826  3348 tablet_service.cc:1511] Processing CreateTablet for tablet cbbc30fbceeb4d5089322bab45cb7e92 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:14.385362  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbc30fbceeb4d5089322bab45cb7e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.385579  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc30d61f594798856e57196b3f0490 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:14.386979  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc30d61f594798856e57196b3f0490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.395176  3277 tablet_service.cc:1511] Processing CreateTablet for tablet 29fbebd988e2438d9be8247d581ce029 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:14.395483  3346 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc30d61f594798856e57196b3f0490 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:14.396836  3277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fbebd988e2438d9be8247d581ce029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.367702  3409 raft_consensus.cc:740] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.396836  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc30d61f594798856e57196b3f0490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.399098  3206 tablet_service.cc:1511] Processing CreateTablet for tablet 5acc30d61f594798856e57196b3f0490 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:14.402412  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acc30d61f594798856e57196b3f0490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.410360  3347 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c04ed8911404c8d0a9c6aecbf3f71 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:14.412439  3347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c04ed8911404c8d0a9c6aecbf3f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.421957  3414 raft_consensus.cc:359] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.422890  3414 raft_consensus.cc:385] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.423229  3414 raft_consensus.cc:740] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.424062  3414 consensus_queue.cc:260] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.433557  3411 tablet_bootstrap.cc:654] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.436892  3416 raft_consensus.cc:493] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.437486  3416 raft_consensus.cc:515] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.441031  3416 leader_election.cc:290] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.441313  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:14.445852  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:14.450857  3362 raft_consensus.cc:2468] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:14.452488  3410 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:14.452294  3280 tablet_service.cc:1511] Processing CreateTablet for tablet c66bac0298e146bc8cbd817d3014f8ee (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:14.453114  3410 ts_tablet_manager.cc:1403] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.292s	user 0.020s	sys 0.005s
I20260709 13:14:14.454123  3280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66bac0298e146bc8cbd817d3014f8ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:14.450968  3253 leader_election.cc:343] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.459861  3255 leader_election.cc:304] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:14.461366  3416 raft_consensus.cc:2804] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.463243  3416 raft_consensus.cc:493] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.463644  3416 raft_consensus.cc:3060] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.461100  3414 ts_tablet_manager.cc:1434] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 13:14:14.470780  3346 tablet_service.cc:1511] Processing CreateTablet for tablet c66bac0298e146bc8cbd817d3014f8ee (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:14.465590  3130 tablet_service.cc:1511] Processing CreateTablet for tablet c66bac0298e146bc8cbd817d3014f8ee (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:14.454360  3409 consensus_queue.cc:260] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.473733  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66bac0298e146bc8cbd817d3014f8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.473958  3418 raft_consensus.cc:493] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.474507  3418 raft_consensus.cc:515] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.461233  3410 raft_consensus.cc:359] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.475577  3410 raft_consensus.cc:385] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.475925  3410 raft_consensus.cc:740] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.472566  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66bac0298e146bc8cbd817d3014f8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.477097  3410 consensus_queue.cc:260] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.497641  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:14.499435  3104 leader_election.cc:343] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.500334  3416 raft_consensus.cc:515] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.490553  3414 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:14.504374  3418 leader_election.cc:290] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:14.505553  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:14.506402  3200 tablet_service.cc:1511] Processing CreateTablet for tablet 1752bd797b664bdc8cbfe571234287b7 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:14:14.507256  3106 leader_election.cc:343] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.507778  3200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1752bd797b664bdc8cbfe571234287b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.507746  3106 leader_election.cc:304] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:14.509382  3418 raft_consensus.cc:2749] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.509841  3274 tablet_service.cc:1511] Processing CreateTablet for tablet 1752bd797b664bdc8cbfe571234287b7 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:14.510246  3411 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:14.511631  3411 ts_tablet_manager.cc:1403] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.250s	user 0.016s	sys 0.004s
I20260709 13:14:14.518400  3409 ts_tablet_manager.cc:1434] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.165s	user 0.011s	sys 0.000s
I20260709 13:14:14.519625  3409 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:14.527562  3440 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.528153  3440 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.528880  3274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1752bd797b664bdc8cbfe571234287b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.530774  3440 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.536769  3414 tablet_bootstrap.cc:654] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.528316  3411 raft_consensus.cc:359] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.542606  3411 raft_consensus.cc:385] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.557955  3123 tablet_service.cc:1511] Processing CreateTablet for tablet ec65a4c4148f48d7ba5bd19407e9777b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:14.560531  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec65a4c4148f48d7ba5bd19407e9777b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.563524  3278 tablet_service.cc:1511] Processing CreateTablet for tablet ec65a4c4148f48d7ba5bd19407e9777b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:14.559396  3410 ts_tablet_manager.cc:1434] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.004s
I20260709 13:14:14.565313  3410 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:14.571276  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec65a4c4148f48d7ba5bd19407e9777b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.578426  3353 tablet_service.cc:1511] Processing CreateTablet for tablet 1752bd797b664bdc8cbfe571234287b7 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:14.582862  3416 leader_election.cc:290] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.583079  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:14.584908  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:14.554692  3411 raft_consensus.cc:740] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.590560  3362 raft_consensus.cc:3060] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.598698  3130 tablet_service.cc:1511] Processing CreateTablet for tablet a8c4d51b5f734584ad6775456f893f3f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:14.600167  3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c4d51b5f734584ad6775456f893f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.599838  3411 consensus_queue.cc:260] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.597508  3363 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.602376  3411 ts_tablet_manager.cc:1434] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.090s	user 0.003s	sys 0.005s
I20260709 13:14:14.602500  3414 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:14.603309  3414 ts_tablet_manager.cc:1403] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.003s
I20260709 13:14:14.605067  3411 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:14.605343  3418 raft_consensus.cc:493] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.605877  3418 raft_consensus.cc:515] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.607024  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1752bd797b664bdc8cbfe571234287b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.608286  3418 leader_election.cc:290] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:14.609790  3253 leader_election.cc:343] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.613415  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:14.613554  3414 raft_consensus.cc:359] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.614090  3348 tablet_service.cc:1511] Processing CreateTablet for tablet a8c4d51b5f734584ad6775456f893f3f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:14.614931  3414 raft_consensus.cc:385] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.615314  3414 raft_consensus.cc:740] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.615940  3348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c4d51b5f734584ad6775456f893f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.616482  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:14.617358  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 7a549cce7b7f418eb35ed1c1251524b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:14:14.618942  3106 leader_election.cc:343] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.620325  3410 tablet_bootstrap.cc:654] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.622464  3271 tablet_service.cc:1511] Processing CreateTablet for tablet 7a549cce7b7f418eb35ed1c1251524b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:14.624208  3199 tablet_service.cc:1511] Processing CreateTablet for tablet cac2abd7128a46079164d4d9c65c09af (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:14.633095  3362 raft_consensus.cc:2468] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:14.630179  3349 tablet_service.cc:1511] Processing CreateTablet for tablet 7a549cce7b7f418eb35ed1c1251524b9 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:14.631196  3409 tablet_bootstrap.cc:654] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.658785  3255 leader_election.cc:304] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:14.660122  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a549cce7b7f418eb35ed1c1251524b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.661016  3416 raft_consensus.cc:2804] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.636409  3411 tablet_bootstrap.cc:654] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.650504  3199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac2abd7128a46079164d4d9c65c09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.624993  3414 consensus_queue.cc:260] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:14.652623  3201 tablet_service.cc:1511] Processing CreateTablet for tablet ec65a4c4148f48d7ba5bd19407e9777b (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:14.653712  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a549cce7b7f418eb35ed1c1251524b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.654309  3271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a549cce7b7f418eb35ed1c1251524b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.655035  3204 tablet_service.cc:1511] Processing CreateTablet for tablet a8c4d51b5f734584ad6775456f893f3f (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:14:14.674350  3181 leader_election.cc:343] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.708958  3198 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5ca5ebd2fd460db5be94489079d53d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:14.712515  3410 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:14.713135  3410 ts_tablet_manager.cc:1403] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.148s	user 0.005s	sys 0.044s
I20260709 13:14:14.716157  3414 ts_tablet_manager.cc:1434] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.004s
I20260709 13:14:14.715884  3129 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5ca5ebd2fd460db5be94489079d53d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:14:14.716707  3255 consensus_peers.cc:597] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Couldn't send request to peer 0d7210a87d254adba064447cda99b137. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:14.717337  3129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5ca5ebd2fd460db5be94489079d53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.721781  3126 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9d964541c4496f9e463032efb20c9a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:14.724480  3206 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9d964541c4496f9e463032efb20c9a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:14:14.725013  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:14.732260  3349 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9d964541c4496f9e463032efb20c9a (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:14.733633  3349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9d964541c4496f9e463032efb20c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.735419  3128 tablet_service.cc:1511] Processing CreateTablet for tablet 0125b77760be464886c1533e8749b934 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:14.740545  3410 raft_consensus.cc:359] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.741976  3273 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5ca5ebd2fd460db5be94489079d53d (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:14.743747  3273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5ca5ebd2fd460db5be94489079d53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.743795  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:14.741871  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:14.746066  3290 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:14.746479  3280 tablet_service.cc:1511] Processing CreateTablet for tablet 0125b77760be464886c1533e8749b934 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:14.747763  3280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0125b77760be464886c1533e8749b934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.747915  3181 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:14.749018  3440 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.749518  3440 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.749904  3440 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.750703  3346 tablet_service.cc:1511] Processing CreateTablet for tablet cac2abd7128a46079164d4d9c65c09af (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:14.752077  3346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac2abd7128a46079164d4d9c65c09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.753616  3201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec65a4c4148f48d7ba5bd19407e9777b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.749538  3418 consensus_queue.cc:1048] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:14:14.753990  3104 leader_election.cc:343] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.754470  3104 leader_election.cc:304] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:14.755208  3418 raft_consensus.cc:2749] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.756233  3198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5ca5ebd2fd460db5be94489079d53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.757582  3424 consensus_queue.cc:1048] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.758102  3410 raft_consensus.cc:385] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.758548  3410 raft_consensus.cc:740] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.759436  3204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c4d51b5f734584ad6775456f893f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.759323  3410 consensus_queue.cc:260] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.760419  3444 consensus_queue.cc:1048] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.724886  3126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9d964541c4496f9e463032efb20c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.763083  3414 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:14.763710  3410 ts_tablet_manager.cc:1434] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 13:14:14.764770  3410 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:14.765959  3206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9d964541c4496f9e463032efb20c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.768105  3353 tablet_service.cc:1511] Processing CreateTablet for tablet 0125b77760be464886c1533e8749b934 (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:14.701840  3416 raft_consensus.cc:697] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:14.769245  3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0125b77760be464886c1533e8749b934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.740411  3277 tablet_service.cc:1511] Processing CreateTablet for tablet cac2abd7128a46079164d4d9c65c09af (DEFAULT_TABLE table=test-workload [id=dae7a9c6d15a4181aa926c2e0f7c7b1e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:14.779840  3277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac2abd7128a46079164d4d9c65c09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.781795  3128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0125b77760be464886c1533e8749b934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:14.775687  3410 tablet_bootstrap.cc:654] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.791270  3416 consensus_queue.cc:237] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.821812  3411 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:14.822499  3411 ts_tablet_manager.cc:1403] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.218s	user 0.019s	sys 0.001s
I20260709 13:14:14.827488  3421 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.828059  3421 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.836493  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:14.838618  3421 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:14.852612  3409 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
W20260709 13:14:14.847034  3328 leader_election.cc:343] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.855199  3409 ts_tablet_manager.cc:1403] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.336s	user 0.014s	sys 0.024s
I20260709 13:14:14.837438  3440 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.857470  3440 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:14.859316  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:14.860051  3290 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.861955  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:14.862732  3414 tablet_bootstrap.cc:654] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:14.863884  3181 leader_election.cc:343] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.874024  3290 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:14.876214  3181 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:14.877599  3440 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.878419  3440 raft_consensus.cc:697] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:14.879540  3440 consensus_queue.cc:237] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:14.882354  3411 raft_consensus.cc:359] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.897861  3462 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.883459  3411 raft_consensus.cc:385] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.907331  3411 raft_consensus.cc:740] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.914407  3409 raft_consensus.cc:359] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.915321  3409 raft_consensus.cc:385] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.914522  3411 consensus_queue.cc:260] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.917389  3411 ts_tablet_manager.cc:1434] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.003s
I20260709 13:14:14.921554  3411 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:14.898557  3462 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:14.927129  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:14.943045  3255 leader_election.cc:343] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.941954  3462 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:14.943480  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:14.953047  3411 tablet_bootstrap.cc:654] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.953280  3141 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:14.955251  3254 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:14.929472  3409 raft_consensus.cc:740] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.967810  3416 raft_consensus.cc:2804] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.946805  3036 catalog_manager.cc:5697] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.975270  3416 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.982949  3416 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.985679  3409 consensus_queue.cc:260] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:14.988304  3409 ts_tablet_manager.cc:1434] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.133s	user 0.011s	sys 0.000s
I20260709 13:14:14.992156  3409 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.020257  3421 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.020951  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.020903  3421 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:15.022841  3327 leader_election.cc:343] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.023334  3421 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.025560  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.023377  3327 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.043830  3410 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.044453  3410 ts_tablet_manager.cc:1403] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.280s	user 0.024s	sys 0.015s
I20260709 13:14:15.044364  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:15.042760  3329 leader_election.cc:343] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.044867  3421 raft_consensus.cc:2749] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:15.046559  3328 leader_election.cc:343] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.050158  3467 raft_consensus.cc:493] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.050767  3467 raft_consensus.cc:515] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.051757  3328 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.054571  3416 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.055115  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.055502  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.055919  3141 raft_consensus.cc:2468] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:15.056483  3421 raft_consensus.cc:2749] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.056681  3410 raft_consensus.cc:359] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.057546  3416 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.058091  3180 leader_election.cc:304] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.057775  3410 raft_consensus.cc:385] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:15.058795  3181 leader_election.cc:343] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.059041  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.059305  3410 raft_consensus.cc:740] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.059831  3141 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.060331  3410 consensus_queue.cc:260] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.062945  3410 ts_tablet_manager.cc:1434] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 13:14:15.064623  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
W20260709 13:14:15.066879  3255 leader_election.cc:343] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.067739  3467 leader_election.cc:290] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.071995  3141 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:15.075280  3254 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:15.077867  3462 raft_consensus.cc:2804] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.078778  3410 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.078902  3462 raft_consensus.cc:697] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:15.079875  3462 consensus_queue.cc:237] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.081019  3467 raft_consensus.cc:2804] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.081494  3467 raft_consensus.cc:493] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.082114  3467 raft_consensus.cc:3060] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.077189  3414 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.093881  3414 ts_tablet_manager.cc:1403] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.331s	user 0.015s	sys 0.021s
I20260709 13:14:15.098471  3414 raft_consensus.cc:359] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.099277  3414 raft_consensus.cc:385] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.101063  3414 raft_consensus.cc:740] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.101912  3414 consensus_queue.cc:260] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.104488  3414 ts_tablet_manager.cc:1434] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:15.105657  3414 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.105477  3409 tablet_bootstrap.cc:654] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.114012  3414 tablet_bootstrap.cc:654] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.118933  3410 tablet_bootstrap.cc:654] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.122536  3411 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.123185  3411 ts_tablet_manager.cc:1403] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.202s	user 0.027s	sys 0.009s
I20260709 13:14:15.123347  3467 raft_consensus.cc:515] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.126768  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.126621  3411 raft_consensus.cc:359] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.127105  3467 leader_election.cc:290] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.127431  3141 raft_consensus.cc:3060] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.129180  3409 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.129770  3409 ts_tablet_manager.cc:1403] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.003s
I20260709 13:14:15.132912  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:15.127449  3411 raft_consensus.cc:385] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.133796  3411 raft_consensus.cc:740] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
W20260709 13:14:15.134816  3181 leader_election.cc:343] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.134624  3411 consensus_queue.cc:260] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.137014  3411 ts_tablet_manager.cc:1434] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.003s
I20260709 13:14:15.132898  3409 raft_consensus.cc:359] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.137849  3409 raft_consensus.cc:385] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.138180  3409 raft_consensus.cc:740] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.139006  3409 consensus_queue.cc:260] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.140784  3141 raft_consensus.cc:2468] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:15.142623  3411 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.143440  3180 leader_election.cc:304] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:15.144691  3467 raft_consensus.cc:2804] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.145205  3467 raft_consensus.cc:697] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:15.145274  3414 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.145982  3414 ts_tablet_manager.cc:1403] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.009s
I20260709 13:14:15.146173  3467 consensus_queue.cc:237] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.149345  3414 raft_consensus.cc:359] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.150309  3414 raft_consensus.cc:385] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.150502  3411 tablet_bootstrap.cc:654] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.150624  3414 raft_consensus.cc:740] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.151569  3414 consensus_queue.cc:260] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.141601  3409 ts_tablet_manager.cc:1434] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:14:15.154486  3409 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.160166  3409 tablet_bootstrap.cc:654] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.162289  3414 ts_tablet_manager.cc:1434] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:14:15.164238  3414 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.179072  3414 tablet_bootstrap.cc:654] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.138847  3037 catalog_manager.cc:5697] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.196990  3414 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.198248  3414 ts_tablet_manager.cc:1403] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.007s
I20260709 13:14:15.202721  3424 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.203543  3424 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.208798  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.209789  3363 raft_consensus.cc:2468] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:15.211925  3106 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.213768  3418 raft_consensus.cc:2804] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.214377  3418 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.215267  3418 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.219852  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.220496  3411 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.221109  3411 ts_tablet_manager.cc:1403] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.017s
W20260709 13:14:15.221508  3104 leader_election.cc:343] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.220512  3424 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.220260  3036 catalog_manager.cc:5697] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.222769  3410 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.225009  3410 ts_tablet_manager.cc:1403] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.161s	user 0.037s	sys 0.043s
I20260709 13:14:15.225747  3409 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.225494  3411 raft_consensus.cc:359] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.226428  3409 ts_tablet_manager.cc:1403] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.072s	user 0.027s	sys 0.022s
I20260709 13:14:15.226502  3411 raft_consensus.cc:385] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.227006  3411 raft_consensus.cc:740] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.227949  3410 raft_consensus.cc:359] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.228716  3410 raft_consensus.cc:385] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.229318  3410 raft_consensus.cc:740] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.228844  3036 catalog_manager.cc:5697] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.229820  3409 raft_consensus.cc:359] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.230193  3410 consensus_queue.cc:260] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.232172  3410 ts_tablet_manager.cc:1434] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:15.230608  3409 raft_consensus.cc:385] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.230934  3418 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.232483  3409 raft_consensus.cc:740] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.233038  3411 consensus_queue.cc:260] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.228576  3414 raft_consensus.cc:359] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.233909  3409 consensus_queue.cc:260] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.234400  3414 raft_consensus.cc:385] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.235867  3411 ts_tablet_manager.cc:1434] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:14:15.236423  3409 ts_tablet_manager.cc:1434] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:14:15.237008  3411 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.237752  3409 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.244256  3411 tablet_bootstrap.cc:654] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.245198  3409 tablet_bootstrap.cc:654] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.234858  3414 raft_consensus.cc:740] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.250483  3414 consensus_queue.cc:260] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.251855  3424 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.252411  3424 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.255609  3418 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.257019  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:15.258004  3363 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.262576  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
W20260709 13:14:15.264592  3104 leader_election.cc:343] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.266397  3409 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.266997  3409 ts_tablet_manager.cc:1403] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.013s
I20260709 13:14:15.267637  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.268383  3362 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:15.266453  3411 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.269722  3106 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.270035  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.270648  3411 ts_tablet_manager.cc:1403] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 13:14:15.270887  3418 raft_consensus.cc:2804] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.271427  3418 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.271888  3418 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.273093  3410 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.274290  3411 raft_consensus.cc:359] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.275053  3411 raft_consensus.cc:385] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.275343  3411 raft_consensus.cc:740] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.270814  3215 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:15.277097  3411 consensus_queue.cc:260] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.279384  3411 ts_tablet_manager.cc:1434] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:15.276175  3409 raft_consensus.cc:359] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.280376  3409 raft_consensus.cc:385] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.280539  3410 tablet_bootstrap.cc:654] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.280684  3409 raft_consensus.cc:740] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.281716  3409 consensus_queue.cc:260] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.283166  3418 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.286871  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:15.287799  3362 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.288005  3411 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.271576  3424 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.295414  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:15.296129  3215 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.296526  3362 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:15.302479  3414 ts_tablet_manager.cc:1434] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 13:14:15.302888  3106 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.304270  3215 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:15.304538  3424 raft_consensus.cc:2804] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.305171  3424 raft_consensus.cc:697] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:15.305927  3418 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.306143  3424 consensus_queue.cc:237] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.306916  3462 consensus_queue.cc:1048] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.308162  3411 tablet_bootstrap.cc:654] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.311259  3414 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.303457  3363 raft_consensus.cc:2468] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:15.319300  3106 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:15.321121  3418 raft_consensus.cc:2804] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.321883  3418 raft_consensus.cc:697] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:15.323246  3418 consensus_queue.cc:237] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.334470  3411 tablet_bootstrap.cc:492] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.335140  3411 ts_tablet_manager.cc:1403] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.011s
I20260709 13:14:15.338490  3411 raft_consensus.cc:359] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.339277  3411 raft_consensus.cc:385] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.339589  3411 raft_consensus.cc:740] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.340533  3411 consensus_queue.cc:260] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.341938  3414 tablet_bootstrap.cc:654] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.343104  3411 ts_tablet_manager.cc:1434] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:15.342543  3039 catalog_manager.cc:5697] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.344357  3411 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.350421  3410 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.351111  3410 ts_tablet_manager.cc:1403] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.078s	user 0.034s	sys 0.022s
I20260709 13:14:15.354633  3410 raft_consensus.cc:359] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.355422  3410 raft_consensus.cc:385] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.355717  3410 raft_consensus.cc:740] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.356630  3410 consensus_queue.cc:260] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.357765  3409 ts_tablet_manager.cc:1434] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.090s	user 0.014s	sys 0.006s
I20260709 13:14:15.358820  3409 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.359222  3410 ts_tablet_manager.cc:1434] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:15.360474  3410 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.367703  3421 raft_consensus.cc:493] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.368340  3421 raft_consensus.cc:515] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.372891  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.374809  3036 catalog_manager.cc:5697] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.377620  3410 tablet_bootstrap.cc:654] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.378559  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.381174  3329 leader_election.cc:304] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:15.382005  3467 consensus_queue.cc:1048] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.382310  3421 leader_election.cc:290] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.383018  3421 raft_consensus.cc:2749] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.396618  3414 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.397152  3414 ts_tablet_manager.cc:1403] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.009s
W20260709 13:14:15.400952  3253 consensus_peers.cc:597] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.361451  3411 tablet_bootstrap.cc:654] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.364876  3409 tablet_bootstrap.cc:654] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.410569  3416 raft_consensus.cc:493] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.411126  3416 raft_consensus.cc:515] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.413473  3416 leader_election.cc:290] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.414664  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.415599  3141 raft_consensus.cc:2468] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
W20260709 13:14:15.416625  3181 consensus_peers.cc:597] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 -> Peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Couldn't send request to peer 0d7210a87d254adba064447cda99b137. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.417222  3254 leader_election.cc:304] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.418538  3416 raft_consensus.cc:2804] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.418982  3416 raft_consensus.cc:493] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.419425  3416 raft_consensus.cc:3060] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.422152  3440 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.422462  3498 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.422977  3440 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.423192  3498 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.414569  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.427066  3362 raft_consensus.cc:2468] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:15.428267  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.429926  3440 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:15.431025  3181 leader_election.cc:343] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.431175  3498 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.431439  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.433169  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.434070  3409 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.434406  3140 raft_consensus.cc:2393] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:15.434610  3409 ts_tablet_manager.cc:1403] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.006s
I20260709 13:14:15.431073  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.439611  3329 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.440856  3414 raft_consensus.cc:359] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.441982  3414 raft_consensus.cc:385] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.442286  3414 raft_consensus.cc:740] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.442422  3409 raft_consensus.cc:359] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.443336  3409 raft_consensus.cc:385] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.443980  3409 raft_consensus.cc:740] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.445492  3498 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.445223  3409 consensus_queue.cc:260] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.443528  3414 consensus_queue.cc:260] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.447723  3410 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.448256  3410 ts_tablet_manager.cc:1403] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.037s
I20260709 13:14:15.449059  3414 ts_tablet_manager.cc:1434] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
W20260709 13:14:15.450382  3180 leader_election.cc:343] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.450940  3180 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.451211  3410 raft_consensus.cc:359] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.451982  3410 raft_consensus.cc:385] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.452270  3410 raft_consensus.cc:740] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.453306  3440 raft_consensus.cc:2749] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.453157  3410 consensus_queue.cc:260] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.455812  3409 ts_tablet_manager.cc:1434] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:14:15.457887  3410 ts_tablet_manager.cc:1434] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:14:15.458250  3491 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.458953  3410 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.458812  3491 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.461023  3416 raft_consensus.cc:515] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.463060  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.461236  3491 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:15.463940  3363 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:15.464089  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:15.464787  3362 raft_consensus.cc:3060] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.465483  3106 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.466442  3409 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.466737  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.467350  3411 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.467507  3289 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:15.457207  3498 raft_consensus.cc:2749] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.470112  3411 ts_tablet_manager.cc:1403] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.016s
I20260709 13:14:15.472694  3414 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.473795  3491 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.474330  3491 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.474725  3491 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.478885  3409 tablet_bootstrap.cc:654] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.480217  3414 tablet_bootstrap.cc:654] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.481739  3410 tablet_bootstrap.cc:654] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.474272  3362 raft_consensus.cc:2468] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:15.483860  3444 consensus_queue.cc:1048] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.484046  3255 leader_election.cc:304] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:15.485716  3416 leader_election.cc:290] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.486255  3444 raft_consensus.cc:2804] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.486575  3411 raft_consensus.cc:359] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.487229  3444 raft_consensus.cc:697] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:15.488098  3491 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.488508  3444 consensus_queue.cc:237] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.490098  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.491021  3140 raft_consensus.cc:3060] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.491888  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:15.492524  3411 raft_consensus.cc:385] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.492573  3289 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.493103  3411 raft_consensus.cc:740] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.493995  3411 consensus_queue.cc:260] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.496425  3411 ts_tablet_manager.cc:1434] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:14:15.500600  3411 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.504770  3289 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:15.509795  3491 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:15.511446  3106 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.512837  3491 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.513381  3491 raft_consensus.cc:697] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:15.514236  3491 consensus_queue.cc:237] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.511139  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:15.522457  3362 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.532142  3409 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.532923  3409 ts_tablet_manager.cc:1403] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.067s	user 0.033s	sys 0.009s
I20260709 13:14:15.537001  3409 raft_consensus.cc:359] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.543017  3498 raft_consensus.cc:493] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.552034  3498 raft_consensus.cc:515] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.542876  3140 raft_consensus.cc:2468] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
W20260709 13:14:15.548437  3181 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:15.551618  3409 raft_consensus.cc:385] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.554171  3409 raft_consensus.cc:740] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.554967  3409 consensus_queue.cc:260] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.551046  3039 catalog_manager.cc:5697] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.553118  3440 raft_consensus.cc:493] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.560153  3409 ts_tablet_manager.cc:1434] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:14:15.560477  3440 raft_consensus.cc:515] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.562994  3498 leader_election.cc:290] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.567282  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.567592  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.568099  3215 raft_consensus.cc:2468] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:15.571086  3327 leader_election.cc:304] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:15.571741  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.571991  3416 consensus_queue.cc:1048] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.572492  3498 raft_consensus.cc:2804] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.573098  3498 raft_consensus.cc:493] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.573498  3498 raft_consensus.cc:3060] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.573782  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:15.575515  3328 leader_election.cc:343] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.572520  3289 raft_consensus.cc:2468] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:15.578774  3440 leader_election.cc:290] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.579272  3181 leader_election.cc:304] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:15.582724  3440 raft_consensus.cc:2804] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:15.586565  3180 leader_election.cc:343] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.588840  3410 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.589243  3410 ts_tablet_manager.cc:1403] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.031s
I20260709 13:14:15.587524  3440 raft_consensus.cc:493] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.590497  3440 raft_consensus.cc:3060] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.591568  3414 tablet_bootstrap.cc:492] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.592062  3414 ts_tablet_manager.cc:1403] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.013s
I20260709 13:14:15.592109  3410 raft_consensus.cc:359] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.593155  3410 raft_consensus.cc:385] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.593500  3410 raft_consensus.cc:740] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.594372  3410 consensus_queue.cc:260] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.595191  3414 raft_consensus.cc:359] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.596010  3414 raft_consensus.cc:385] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.596299  3414 raft_consensus.cc:740] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.596697  3362 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:15.596987  3410 ts_tablet_manager.cc:1434] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:15.597098  3414 consensus_queue.cc:260] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.597326  3498 raft_consensus.cc:515] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.598577  3410 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.597609  3411 tablet_bootstrap.cc:654] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.602870  3409 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.603590  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.604310  3498 leader_election.cc:290] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:15.605149  3328 leader_election.cc:343] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.605180  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:15.606479  3215 raft_consensus.cc:3060] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.601287  3440 raft_consensus.cc:515] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.615846  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.615188  3036 catalog_manager.cc:5697] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.617249  3409 tablet_bootstrap.cc:654] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:15.617278  3180 leader_election.cc:343] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.619803  3414 ts_tablet_manager.cc:1434] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:14:15.622154  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:15.622884  3289 raft_consensus.cc:3060] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.628887  3215 raft_consensus.cc:2468] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:15.630957  3289 raft_consensus.cc:2468] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:15.630077  3440 leader_election.cc:290] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.636243  3467 raft_consensus.cc:493] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.642405  3491 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.646894  3327 leader_election.cc:304] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.647274  3467 raft_consensus.cc:515] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.647516  3491 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.646894  3181 leader_election.cc:304] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.649991  3498 raft_consensus.cc:2804] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.650648  3498 raft_consensus.cc:697] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:15.650913  3491 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:15.651741  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.651662  3498 consensus_queue.cc:237] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.652478  3141 raft_consensus.cc:2468] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:15.653498  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.653858  3180 leader_election.cc:304] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:15.654206  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.650327  3467 leader_election.cc:290] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.655782  3467 raft_consensus.cc:2804] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:15.655957  3106 leader_election.cc:343] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.656301  3467 raft_consensus.cc:697] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
W20260709 13:14:15.656733  3106 leader_election.cc:343] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.644613  3414 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.658128  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.658859  3290 raft_consensus.cc:2468] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:15.657142  3106 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:15.661113  3440 raft_consensus.cc:2804] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.661945  3418 raft_consensus.cc:2749] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.641871  3410 tablet_bootstrap.cc:654] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.661707  3440 raft_consensus.cc:493] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.663153  3440 raft_consensus.cc:3060] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.657176  3467 consensus_queue.cc:237] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.670077  3414 tablet_bootstrap.cc:654] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.673336  3410 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.682365  3410 ts_tablet_manager.cc:1403] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.002s
I20260709 13:14:15.677886  3409 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.684126  3409 ts_tablet_manager.cc:1403] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.081s	user 0.032s	sys 0.034s
I20260709 13:14:15.688908  3411 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.684191  3036 catalog_manager.cc:5697] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.689371  3409 raft_consensus.cc:359] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.689330  3410 raft_consensus.cc:359] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.690560  3409 raft_consensus.cc:385] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.690977  3410 raft_consensus.cc:385] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.690989  3409 raft_consensus.cc:740] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.691672  3410 raft_consensus.cc:740] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.689095  3440 raft_consensus.cc:515] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.692251  3409 consensus_queue.cc:260] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.692677  3410 consensus_queue.cc:260] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.695448  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.696118  3141 raft_consensus.cc:3060] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.689572  3411 ts_tablet_manager.cc:1403] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.189s	user 0.018s	sys 0.002s
I20260709 13:14:15.701578  3409 ts_tablet_manager.cc:1434] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:14:15.702014  3410 ts_tablet_manager.cc:1434] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:14:15.702939  3409 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.703105  3410 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.711259  3409 tablet_bootstrap.cc:654] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.703891  3498 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.703029  3411 raft_consensus.cc:359] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.712818  3411 raft_consensus.cc:385] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.713119  3411 raft_consensus.cc:740] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.711925  3498 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.716179  3411 consensus_queue.cc:260] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.716513  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.718719  3410 tablet_bootstrap.cc:654] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.709255  3414 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.719928  3414 ts_tablet_manager.cc:1403] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.005s
I20260709 13:14:15.720176  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.720866  3215 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:15.722265  3327 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:15.723240  3421 raft_consensus.cc:2804] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.723865  3421 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.724220  3421 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:15.728662  3328 leader_election.cc:343] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:15.729379  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:15.705184  3037 catalog_manager.cc:5697] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.731906  3411 ts_tablet_manager.cc:1434] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:14:15.733480  3411 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.724221  3498 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.733117  3421 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.723202  3414 raft_consensus.cc:359] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.775851  3414 raft_consensus.cc:385] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.776173  3414 raft_consensus.cc:740] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.776938  3410 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:15.777681  3410 ts_tablet_manager.cc:1403] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.011s
I20260709 13:14:15.769672  3440 leader_election.cc:290] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.738312  3416 raft_consensus.cc:493] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.778352  3421 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.758249  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dfc159d3e44c748c3eba625cfb200a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:15.779073  3289 raft_consensus.cc:3060] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.779610  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:15.779734  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.780339  3215 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.761413  3418 consensus_queue.cc:1048] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:15.781577  3328 leader_election.cc:343] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.738641  3409 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.775404  3411 tablet_bootstrap.cc:654] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.784057  3409 ts_tablet_manager.cc:1403] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.030s
I20260709 13:14:15.750519  3467 consensus_queue.cc:1048] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.778266  3416 raft_consensus.cc:515] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.776953  3414 consensus_queue.cc:260] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.787070  3414 ts_tablet_manager.cc:1434] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.004s
I20260709 13:14:15.788012  3414 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:15.788096  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd93a03a51b6448b86959645526e2dd1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.788359  3416 leader_election.cc:290] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:15.789798  3255 leader_election.cc:343] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.787573  3409 raft_consensus.cc:359] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.790724  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd93a03a51b6448b86959645526e2dd1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.791060  3409 raft_consensus.cc:385] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.791563  3409 raft_consensus.cc:740] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.791529  3140 raft_consensus.cc:2468] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:15.793066  3409 consensus_queue.cc:260] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.793757  3254 leader_election.cc:304] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:15.795055  3444 raft_consensus.cc:2804] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.795482  3444 raft_consensus.cc:493] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.795869  3444 raft_consensus.cc:3060] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.797009  3414 tablet_bootstrap.cc:654] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.800971  3362 raft_consensus.cc:3060] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.801878  3409 ts_tablet_manager.cc:1434] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:14:15.803627  3409 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.811825  3409 tablet_bootstrap.cc:654] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.773439  3141 raft_consensus.cc:2468] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:15.824455  3289 raft_consensus.cc:2468] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:15.826335  3181 leader_election.cc:304] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:15.834381  3467 raft_consensus.cc:2804] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.834995  3467 raft_consensus.cc:697] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:15.821349  3215 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:15.837252  3418 consensus_queue.cc:1048] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.838177  3327 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:15.839572  3421 raft_consensus.cc:2804] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:15.840068  3421 raft_consensus.cc:697] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:15.840946  3421 consensus_queue.cc:237] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.848132  3410 raft_consensus.cc:359] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.850409  3410 raft_consensus.cc:385] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.850807  3410 raft_consensus.cc:740] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.851758  3410 consensus_queue.cc:260] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.854756  3440 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.856810  3467 consensus_queue.cc:237] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.862912  3411 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:15.863461  3411 ts_tablet_manager.cc:1403] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.009s
I20260709 13:14:15.867887  3444 raft_consensus.cc:515] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.869722  3440 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.870394  3411 raft_consensus.cc:359] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.874838  3411 raft_consensus.cc:385] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.875319  3411 raft_consensus.cc:740] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.875942  3410 ts_tablet_manager.cc:1434] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.004s
I20260709 13:14:15.876264  3411 consensus_queue.cc:260] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:15.877990  3411 ts_tablet_manager.cc:1434] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:15.878786  3411 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:15.875720  3215 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.884469  3410 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:15.890746  3414 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:15.890544  3467 raft_consensus.cc:493] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.891274  3467 raft_consensus.cc:515] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.892771  3411 tablet_bootstrap.cc:654] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.893625  3467 leader_election.cc:290] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:15.891305  3414 ts_tablet_manager.cc:1403] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.010s
I20260709 13:14:15.903316  3440 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.903148  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.905126  3491 consensus_queue.cc:1048] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:15.907084  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.912278  3409 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:15.903151  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3212147d3064988b5c1ad49eb50d04d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.912854  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd93a03a51b6448b86959645526e2dd1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:15.913846  3361 raft_consensus.cc:3060] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.914567  3416 raft_consensus.cc:493] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.915171  3416 raft_consensus.cc:515] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.916520  3181 leader_election.cc:304] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:15.917372  3416 leader_election.cc:290] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.912849  3409 ts_tablet_manager.cc:1403] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.020s
I20260709 13:14:15.920579  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.921165  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:15.922775  3253 leader_election.cc:343] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.923883  3424 raft_consensus.cc:493] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.925880  3424 raft_consensus.cc:515] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.928113  3424 leader_election.cc:290] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:15.929740  3409 raft_consensus.cc:359] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.930517  3409 raft_consensus.cc:385] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.930811  3409 raft_consensus.cc:740] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.930639  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:15.931879  3289 raft_consensus.cc:2393] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:15.931960  3416 raft_consensus.cc:493] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.931799  3409 consensus_queue.cc:260] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:15.937714  3462 raft_consensus.cc:493] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.938414  3462 raft_consensus.cc:515] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:15.940670  3462 leader_election.cc:290] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:15.942507  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:15.942790  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.943568  3360 raft_consensus.cc:2468] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:15.933703  3416 raft_consensus.cc:515] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:15.944219  3253 leader_election.cc:343] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:15.945782  3255 leader_election.cc:304] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:15.953096  3409 ts_tablet_manager.cc:1434] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:14:15.954653  3409 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:15.946381  3416 leader_election.cc:290] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:15.948812  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd93a03a51b6448b86959645526e2dd1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:15.937273  3444 leader_election.cc:290] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:15.961724  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.962235  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:15.964337  3140 raft_consensus.cc:3060] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.964717  3141 raft_consensus.cc:2468] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:15.959661  3462 raft_consensus.cc:2804] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:15.966147  3462 raft_consensus.cc:493] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.966605  3462 raft_consensus.cc:3060] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.969471  3409 tablet_bootstrap.cc:654] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.970451  3414 raft_consensus.cc:359] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.971904  3414 raft_consensus.cc:385] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:15.972607  3414 raft_consensus.cc:740] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:15.950734  3467 raft_consensus.cc:2749] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:15.975494  3414 consensus_queue.cc:260] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:15.979353  3410 tablet_bootstrap.cc:654] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:15.980108  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:15.958372  3361 raft_consensus.cc:2468] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:15.988911  3213 raft_consensus.cc:3060] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:15.991285  3255 leader_election.cc:304] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:15.960202  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 43793.2us
I20260709 13:14:15.994040  3416 raft_consensus.cc:2804] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.006057  3411 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:16.006707  3411 ts_tablet_manager.cc:1403] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.000s
I20260709 13:14:15.996527  3254 leader_election.cc:304] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:16.007534  3444 raft_consensus.cc:2804] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.007946  3444 raft_consensus.cc:493] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.008281  3444 raft_consensus.cc:3060] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.008962  3491 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.009600  3411 raft_consensus.cc:359] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.010978  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a76547731d4f008e06b068ba25d7d0" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:16.011861  3414 ts_tablet_manager.cc:1434] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.001s
I20260709 13:14:16.011705  3411 raft_consensus.cc:385] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.026392  3411 raft_consensus.cc:740] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.031576  3411 consensus_queue.cc:260] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.032582  3416 raft_consensus.cc:697] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:16.042088  3410 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:16.045025  3410 ts_tablet_manager.cc:1403] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.014s
I20260709 13:14:16.047541  3411 ts_tablet_manager.cc:1434] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.007s
I20260709 13:14:16.048637  3411 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:16.030122  3181 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:16.050872  3513 raft_consensus.cc:2749] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.048828  3444 raft_consensus.cc:515] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.033336  3254 leader_election.cc:304] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:16.064550  3409 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:16.065277  3409 ts_tablet_manager.cc:1403] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.010s
I20260709 13:14:16.065798  3411 tablet_bootstrap.cc:654] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.068987  3104 leader_election.cc:304] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:16.070178  3414 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:16.070737  3409 raft_consensus.cc:359] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.071762  3409 raft_consensus.cc:385] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.072057  3409 raft_consensus.cc:740] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.072888  3409 consensus_queue.cc:260] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.083142  3418 raft_consensus.cc:3060] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.095403  3414 tablet_bootstrap.cc:654] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.104135  3039 catalog_manager.cc:5697] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:16.091126  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 63986.8us
I20260709 13:14:16.114405  3409 ts_tablet_manager.cc:1434] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.049s	user 0.014s	sys 0.013s
I20260709 13:14:16.115512  3409 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:16.116163  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:16.108201  3444 leader_election.cc:290] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:16.132098  3253 leader_election.cc:343] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.103698  3416 consensus_queue.cc:237] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.168365  3535 consensus_queue.cc:1048] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.170265  3410 raft_consensus.cc:359] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.171051  3410 raft_consensus.cc:385] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.171308  3410 raft_consensus.cc:740] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.171998  3410 consensus_queue.cc:260] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.179246  3409 tablet_bootstrap.cc:654] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:16.178030  3104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 67556us
I20260709 13:14:16.193286  3410 ts_tablet_manager.cc:1434] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.148s	user 0.007s	sys 0.000s
I20260709 13:14:16.194649  3410 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:16.203011  3411 tablet_bootstrap.cc:492] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:16.192250  3418 raft_consensus.cc:2749] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.203604  3411 ts_tablet_manager.cc:1403] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.008s
I20260709 13:14:16.212095  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:16.213779  3141 raft_consensus.cc:3060] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.216434  3513 consensus_queue.cc:1048] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:16.218482  3538 log.cc:927] Time spent T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:14:16.200802  3462 raft_consensus.cc:515] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.227025  3537 raft_consensus.cc:2749] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.227876  3544 consensus_queue.cc:1048] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.053s
I20260709 13:14:16.220394  3411 raft_consensus.cc:359] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.231882  3411 raft_consensus.cc:385] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.232365  3411 raft_consensus.cc:740] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.222656  3543 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:14:16.235105  3542 raft_consensus.cc:493] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.236336  3542 raft_consensus.cc:515] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.239740  3289 raft_consensus.cc:3060] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.242081  3414 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:16.242916  3414 ts_tablet_manager.cc:1403] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.028s
I20260709 13:14:16.247674  3414 raft_consensus.cc:359] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.248852  3140 raft_consensus.cc:2468] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:16.248828  3414 raft_consensus.cc:385] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.250519  3414 raft_consensus.cc:740] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.255462  3414 consensus_queue.cc:260] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.233811  3411 consensus_queue.cc:260] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:16.262380  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 111132us
I20260709 13:14:16.272905  3414 ts_tablet_manager.cc:1434] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:14:16.274209  3414 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:16.274689  3411 ts_tablet_manager.cc:1434] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.004s
I20260709 13:14:16.275727  3411 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:16.279096  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:16.285378  3140 raft_consensus.cc:3060] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.289670  3141 raft_consensus.cc:2468] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:16.293045  3421 consensus_queue.cc:1048] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.295109  3537 consensus_queue.cc:1048] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.296525  3498 consensus_queue.cc:1048] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.298166  3498 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.298677  3498 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.301759  3036 catalog_manager.cc:5697] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.313459  3410 tablet_bootstrap.cc:654] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.305800  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.316978  3548 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.317504  3513 consensus_queue.cc:1048] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.312983  3542 leader_election.cc:290] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:16.304812  3253 leader_election.cc:343] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:16.330180  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 45714.6us
I20260709 13:14:16.317620  3548 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.335000  3409 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:16.335631  3409 ts_tablet_manager.cc:1403] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.220s	user 0.012s	sys 0.011s
I20260709 13:14:16.335263  3548 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:16.335246  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:16.343564  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:16.344376  3364 raft_consensus.cc:3060] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.346493  3411 tablet_bootstrap.cc:654] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.338884  3287 raft_consensus.cc:2468] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
W20260709 13:14:16.354629  3255 leader_election.cc:343] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.355703  3255 leader_election.cc:304] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:16.356894  3548 raft_consensus.cc:2749] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.354728  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:16.358333  3409 raft_consensus.cc:359] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:16.358847  3462 leader_election.cc:290] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:16.359198  3409 raft_consensus.cc:385] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.358983  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:16.359720  3409 raft_consensus.cc:740] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:16.359918  3253 leader_election.cc:343] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.360284  3137 raft_consensus.cc:2468] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:16.360510  3409 consensus_queue.cc:260] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:16.351107  3498 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:16.393066  3254 leader_election.cc:304] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:16.394809  3542 raft_consensus.cc:2804] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.394893  3329 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:16.395534  3542 raft_consensus.cc:697] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
W20260709 13:14:16.396808  3328 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.396571  3542 consensus_queue.cc:237] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.398726  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:16.403152  3409 ts_tablet_manager.cc:1434] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.004s
I20260709 13:14:16.396325  3421 raft_consensus.cc:2804] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.414090  3409 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:16.404590  3421 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.426124  3440 consensus_queue.cc:1048] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.428655  3364 raft_consensus.cc:2468] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:16.430521  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:16.431358  3141 raft_consensus.cc:2468] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:16.433218  3254 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:16.433223  3539 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.434827  3539 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:16.419023  3421 raft_consensus.cc:3060] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.440480  3462 raft_consensus.cc:2804] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.441017  3462 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.441450  3462 raft_consensus.cc:3060] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.437239  3539 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:16.468339  3414 tablet_bootstrap.cc:654] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:16.479125  3557 log.cc:927] Time spent T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.069s	user 0.002s	sys 0.001s
I20260709 13:14:16.502467  3411 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:16.502995  3411 ts_tablet_manager.cc:1403] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.018s
I20260709 13:14:16.502234  3037 catalog_manager.cc:5697] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.456020  3440 raft_consensus.cc:493] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.508559  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:16.510458  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:16.511490  3215 raft_consensus.cc:2393] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:16.500819  3513 consensus_queue.cc:1048] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:14:16.497025  3421 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.531914  3498 consensus_queue.cc:1048] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:16.536883  3525 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.537546  3525 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.538327  3106 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:16.546546  3362 raft_consensus.cc:2393] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:16.546569  3411 raft_consensus.cc:359] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.547597  3421 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:16.547649  3411 raft_consensus.cc:385] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.548296  3411 raft_consensus.cc:740] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.514182  3255 leader_election.cc:304] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:16.514335  3440 raft_consensus.cc:515] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.548988  3411 consensus_queue.cc:260] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.557552  3409 tablet_bootstrap.cc:654] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.550251  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:16.561172  3411 ts_tablet_manager.cc:1434] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 13:14:16.549383  3542 raft_consensus.cc:2804] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.555969  3525 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:16.543963  3539 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.570173  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302a732ff54a4673bd480a2aa501cfa1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:16.571398  3137 raft_consensus.cc:2468] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:16.564934  3411 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:16.563042  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.573570  3410 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:16.581563  3410 ts_tablet_manager.cc:1403] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.387s	user 0.027s	sys 0.012s
I20260709 13:14:16.577571  3542 raft_consensus.cc:697] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:16.578984  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:16.572563  3141 raft_consensus.cc:3060] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.549935  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:16.552460  3440 leader_election.cc:290] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:16.549574  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 72334.3us
I20260709 13:14:16.571897  3462 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.600252  3414 tablet_bootstrap.cc:492] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:16.600952  3414 ts_tablet_manager.cc:1403] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.327s	user 0.024s	sys 0.022s
I20260709 13:14:16.610072  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302a732ff54a4673bd480a2aa501cfa1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.628815  3542 consensus_queue.cc:237] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.629842  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:16.630642  3462 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:16.640367  3410 raft_consensus.cc:359] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.641024  3410 raft_consensus.cc:385] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.641323  3410 raft_consensus.cc:740] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.636787  3288 raft_consensus.cc:2393] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
W20260709 13:14:16.648782  3181 leader_election.cc:343] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.656286  3327 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:16.657874  3567 raft_consensus.cc:2749] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.660643  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:16.661150  3414 raft_consensus.cc:359] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.661787  3360 raft_consensus.cc:2393] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:16.661957  3414 raft_consensus.cc:385] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.662251  3414 raft_consensus.cc:740] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.665349  3180 leader_election.cc:304] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:16.671133  3414 consensus_queue.cc:260] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.671139  3574 raft_consensus.cc:493] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.668706  3141 raft_consensus.cc:2468] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:16.645145  3410 consensus_queue.cc:260] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.674824  3440 raft_consensus.cc:2804] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.690658  3410 ts_tablet_manager.cc:1434] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 13:14:16.698143  3409 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:16.699036  3409 ts_tablet_manager.cc:1403] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.285s	user 0.024s	sys 0.016s
I20260709 13:14:16.673089  3574 raft_consensus.cc:515] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.690165  3440 raft_consensus.cc:493] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.710836  3410 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:16.704645  3539 raft_consensus.cc:2749] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.721557  3414 ts_tablet_manager.cc:1434] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.120s	user 0.021s	sys 0.019s
I20260709 13:14:16.690605  3255 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:16.722942  3328 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:16.724694  3570 raft_consensus.cc:2804] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.720575  3409 raft_consensus.cc:359] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.726773  3409 raft_consensus.cc:385] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.727203  3409 raft_consensus.cc:740] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.728072  3409 consensus_queue.cc:260] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.709383  3440 raft_consensus.cc:3060] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.731262  3414 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
W20260709 13:14:16.732409  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 46913.9us
I20260709 13:14:16.737362  3542 raft_consensus.cc:2749] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.738870  3360 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.726056  3570 raft_consensus.cc:697] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:16.742302  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.748262  3409 ts_tablet_manager.cc:1434] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
W20260709 13:14:16.748622  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:16.750461  3542 consensus_queue.cc:1048] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.743635  3570 consensus_queue.cc:237] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.756320  3467 raft_consensus.cc:493] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.757149  3411 tablet_bootstrap.cc:654] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.756914  3467 raft_consensus.cc:515] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.753224  3035 catalog_manager.cc:5697] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.759950  3467 leader_election.cc:290] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:16.764004  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:16.764550  3542 consensus_queue.cc:1048] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:16.769477  3362 raft_consensus.cc:2393] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:16.765484  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2be9da907458e82ba3b70769eaab4" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.773764  3181 leader_election.cc:304] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:16.766083  3409 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:16.730300  3574 leader_election.cc:290] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:16.775072  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 44221.1us
I20260709 13:14:16.783497  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "635e301b4bec4ff889241f95afc76f35" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:16.784415  3140 raft_consensus.cc:2393] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:16.784066  3213 raft_consensus.cc:3060] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:16.794605  3576 log.cc:927] Time spent T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:14:16.800853  3410 tablet_bootstrap.cc:654] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.829250  3578 raft_consensus.cc:3060] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.842777  3409 tablet_bootstrap.cc:654] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.835239  3180 leader_election.cc:304] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:16.861078  3440 raft_consensus.cc:515] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.863804  3440 leader_election.cc:290] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:16.866715  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302a732ff54a4673bd480a2aa501cfa1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:16.867776  3288 raft_consensus.cc:3060] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.873430  3414 tablet_bootstrap.cc:654] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.878037  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302a732ff54a4673bd480a2aa501cfa1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:16.879216  3139 raft_consensus.cc:3060] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.893309  3574 raft_consensus.cc:2749] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.894663  3410 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:16.894472  3462 consensus_queue.cc:1048] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.895637  3410 ts_tablet_manager.cc:1403] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.000s
I20260709 13:14:16.899947  3410 raft_consensus.cc:359] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.902652  3410 raft_consensus.cc:385] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.903147  3410 raft_consensus.cc:740] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.907367  3410 consensus_queue.cc:260] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.914517  3409 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:16.914664  3411 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:16.915200  3409 ts_tablet_manager.cc:1403] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.005s
I20260709 13:14:16.915359  3411 ts_tablet_manager.cc:1403] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.351s	user 0.022s	sys 0.011s
I20260709 13:14:16.918512  3409 raft_consensus.cc:359] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.919243  3411 raft_consensus.cc:359] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.920107  3411 raft_consensus.cc:385] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.920639  3411 raft_consensus.cc:740] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.921841  3410 ts_tablet_manager.cc:1434] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:14:16.922890  3410 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:16.919270  3409 raft_consensus.cc:385] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.925699  3409 raft_consensus.cc:740] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.926877  3578 raft_consensus.cc:2749] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:16.926587  3409 consensus_queue.cc:260] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.931340  3409 ts_tablet_manager.cc:1434] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:14:16.932324  3409 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:16.931937  3411 consensus_queue.cc:260] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.920053  3288 raft_consensus.cc:2468] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:16.934697  3411 ts_tablet_manager.cc:1434] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:14:16.935751  3411 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:16.935467  3181 leader_election.cc:304] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:16.937528  3467 raft_consensus.cc:2804] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.938372  3467 raft_consensus.cc:697] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:16.939587  3467 consensus_queue.cc:237] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:16.941236  3409 tablet_bootstrap.cc:654] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.949918  3411 tablet_bootstrap.cc:654] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.956573  3410 tablet_bootstrap.cc:654] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.957580  3541 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.958146  3541 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:16.960445  3541 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:16.969528  3548 consensus_queue.cc:1048] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:16.971133  3139 raft_consensus.cc:2468] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:16.981805  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:16.982710  3414 tablet_bootstrap.cc:492] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:16.987339  3414 ts_tablet_manager.cc:1403] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.260s	user 0.024s	sys 0.010s
I20260709 13:14:16.994380  3414 raft_consensus.cc:359] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:16.983108  3409 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:16.984277  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:16.982743  3288 raft_consensus.cc:2468] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
W20260709 13:14:16.997247  3106 leader_election.cc:343] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:16.998584  3414 raft_consensus.cc:385] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.999228  3414 raft_consensus.cc:740] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.997839  3409 ts_tablet_manager.cc:1403] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.013s
I20260709 13:14:17.008944  3414 consensus_queue.cc:260] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.012115  3106 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:17.015707  3414 ts_tablet_manager.cc:1434] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:14:17.017797  3541 raft_consensus.cc:2804] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.018404  3541 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.019070  3541 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.019166  3037 catalog_manager.cc:5697] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.024573  3414 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:17.025631  3411 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:17.026479  3411 ts_tablet_manager.cc:1403] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.091s	user 0.029s	sys 0.019s
I20260709 13:14:17.023622  3570 raft_consensus.cc:493] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.029579  3570 raft_consensus.cc:515] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.034386  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.036427  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:17.042968  3570 leader_election.cc:290] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:17.055092  3329 leader_election.cc:343] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.058576  3410 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.059151  3410 ts_tablet_manager.cc:1403] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.004s
I20260709 13:14:17.060350  3411 raft_consensus.cc:359] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.062582  3411 raft_consensus.cc:385] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.062978  3411 raft_consensus.cc:740] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.064020  3411 consensus_queue.cc:260] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.071130  3409 raft_consensus.cc:359] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:17.062767  3327 leader_election.cc:343] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.074160  3327 leader_election.cc:304] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:17.087646  3570 raft_consensus.cc:2749] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.089591  3410 raft_consensus.cc:359] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.090482  3410 raft_consensus.cc:385] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.091296  3410 raft_consensus.cc:740] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.092913  3410 consensus_queue.cc:260] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.072072  3409 raft_consensus.cc:385] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.094295  3409 raft_consensus.cc:740] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.096262  3409 consensus_queue.cc:260] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.097117  3410 ts_tablet_manager.cc:1434] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:14:17.098269  3411 ts_tablet_manager.cc:1434] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.003s
I20260709 13:14:17.098521  3410 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:17.100873  3409 ts_tablet_manager.cc:1434] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.001s
I20260709 13:14:17.102161  3411 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:17.105533  3539 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.084510  3414 tablet_bootstrap.cc:654] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.106673  3539 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.108179  3410 tablet_bootstrap.cc:654] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.113554  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.115064  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:17.115792  3104 leader_election.cc:343] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:17.117776  3106 leader_election.cc:343] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.118328  3106 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.121443  3544 raft_consensus.cc:2749] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.110486  3539 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:17.132548  3411 tablet_bootstrap.cc:654] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.139123  3409 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:17.142851  3467 raft_consensus.cc:493] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.143735  3467 raft_consensus.cc:515] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.148677  3467 leader_election.cc:290] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.152451  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:17.154219  3288 raft_consensus.cc:2468] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:17.159504  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:17.160501  3362 raft_consensus.cc:2468] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:17.162568  3181 leader_election.cc:304] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:17.164485  3574 raft_consensus.cc:2804] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.164896  3574 raft_consensus.cc:493] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.165223  3574 raft_consensus.cc:3060] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.162567  3409 tablet_bootstrap.cc:654] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.179850  3574 raft_consensus.cc:515] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.192992  3541 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.194150  3414 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:17.195174  3414 ts_tablet_manager.cc:1403] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.173s	user 0.023s	sys 0.011s
I20260709 13:14:17.195996  3541 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.196545  3539 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.197064  3539 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.194109  3410 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.201666  3410 ts_tablet_manager.cc:1403] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.103s	user 0.049s	sys 0.045s
I20260709 13:14:17.202881  3414 raft_consensus.cc:359] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.204051  3414 raft_consensus.cc:385] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.204464  3414 raft_consensus.cc:740] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.205633  3414 consensus_queue.cc:260] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.209712  3539 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:17.210726  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:17.212157  3362 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.216090  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.218209  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:17.216934  3215 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:17.219801  3288 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.221568  3525 consensus_queue.cc:1048] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.226051  3104 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:17.226534  3444 consensus_queue.cc:1048] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.227283  3539 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.227679  3539 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.225100  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:17.228557  3287 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:17.228057  3539 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.238535  3414 ts_tablet_manager.cc:1434] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:14:17.225104  3410 raft_consensus.cc:359] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.236982  3035 catalog_manager.cc:5697] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.239732  3410 raft_consensus.cc:385] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.245368  3410 raft_consensus.cc:740] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.246404  3410 consensus_queue.cc:260] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.249627  3410 ts_tablet_manager.cc:1434] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 13:14:17.250162  3409 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:17.250720  3409 ts_tablet_manager.cc:1403] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.012s
I20260709 13:14:17.250819  3410 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:17.252826  3414 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:17.254781  3288 raft_consensus.cc:2468] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:17.255950  3411 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:17.256264  3106 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:17.256572  3411 ts_tablet_manager.cc:1403] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.155s	user 0.030s	sys 0.011s
I20260709 13:14:17.257279  3541 raft_consensus.cc:2804] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.257869  3541 raft_consensus.cc:697] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:17.258795  3541 consensus_queue.cc:237] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.278811  3574 leader_election.cc:290] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.282809  3411 raft_consensus.cc:359] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.283806  3411 raft_consensus.cc:385] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.284498  3411 raft_consensus.cc:740] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.286608  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:17.287664  3361 raft_consensus.cc:3060] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.285423  3411 consensus_queue.cc:260] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.291091  3409 raft_consensus.cc:359] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.291801  3409 raft_consensus.cc:385] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.292052  3409 raft_consensus.cc:740] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.293533  3409 consensus_queue.cc:260] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.303364  3411 ts_tablet_manager.cc:1434] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:14:17.306717  3409 ts_tablet_manager.cc:1434] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:14:17.307463  3411 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:17.307904  3409 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:17.317198  3444 consensus_queue.cc:1048] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.318923  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:17.319612  3288 raft_consensus.cc:3060] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.333362  3410 tablet_bootstrap.cc:654] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.342278  3362 raft_consensus.cc:2468] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:17.346460  3570 consensus_queue.cc:1048] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.330039  3525 raft_consensus.cc:493] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.350919  3525 raft_consensus.cc:515] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.326887  3539 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.354929  3409 tablet_bootstrap.cc:654] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.355381  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161c10ebbba04c93bd1debaffb57b9f3" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:17.356582  3139 raft_consensus.cc:2468] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:17.355806  3539 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:17.358235  3328 leader_election.cc:304] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:17.363637  3414 tablet_bootstrap.cc:654] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.375247  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:17.375989  3216 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.359068  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:17.379303  3287 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.381567  3525 leader_election.cc:290] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:17.388882  3361 raft_consensus.cc:2468] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:17.400928  3288 raft_consensus.cc:2468] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:17.410710  3570 raft_consensus.cc:2804] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.412648  3570 raft_consensus.cc:493] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.420792  3570 raft_consensus.cc:3060] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.421370  3181 leader_election.cc:304] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:17.423032  3440 raft_consensus.cc:2804] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.424032  3410 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.424790  3410 ts_tablet_manager.cc:1403] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.000s
I20260709 13:14:17.423609  3440 raft_consensus.cc:697] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
W20260709 13:14:17.419413  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 61277.2us
W20260709 13:14:17.425966  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 69297.1us
I20260709 13:14:17.434897  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161c10ebbba04c93bd1debaffb57b9f3" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.435169  3440 consensus_queue.cc:237] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.439854  3216 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:17.447813  3039 catalog_manager.cc:5697] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.440335  3036 catalog_manager.cc:5697] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.453256  3104 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:17.454591  3539 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.455121  3539 raft_consensus.cc:697] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:17.456018  3539 consensus_queue.cc:237] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:17.459717  3327 leader_election.cc:343] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.466374  3410 raft_consensus.cc:359] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.467283  3410 raft_consensus.cc:385] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.467514  3410 raft_consensus.cc:740] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.468185  3410 consensus_queue.cc:260] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.478377  3410 ts_tablet_manager.cc:1434] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:14:17.480319  3410 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
W20260709 13:14:17.489727  3601 log.cc:927] Time spent T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:17.491391  3574 consensus_queue.cc:1048] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:17.489374  3604 log.cc:927] Time spent T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:17.493767  3411 tablet_bootstrap.cc:654] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.521883  3287 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:17.559998  3414 tablet_bootstrap.cc:492] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:17.559930  3574 consensus_queue.cc:1048] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.560777  3414 ts_tablet_manager.cc:1403] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.308s	user 0.013s	sys 0.021s
I20260709 13:14:17.568948  3410 tablet_bootstrap.cc:654] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.569262  3409 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:17.570622  3409 ts_tablet_manager.cc:1403] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.263s	user 0.010s	sys 0.014s
I20260709 13:14:17.573474  3409 raft_consensus.cc:359] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.574522  3409 raft_consensus.cc:385] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.574853  3409 raft_consensus.cc:740] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.580438  3409 consensus_queue.cc:260] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.583729  3409 ts_tablet_manager.cc:1434] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:17.585464  3409 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:17.589723  3444 raft_consensus.cc:493] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.590420  3444 raft_consensus.cc:515] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.599714  3444 leader_election.cc:290] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.604269  3411 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:17.604919  3411 ts_tablet_manager.cc:1403] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.298s	user 0.022s	sys 0.017s
I20260709 13:14:17.599323  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.613240  3410 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.613806  3410 ts_tablet_manager.cc:1403] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.000s
W20260709 13:14:17.615170  3253 leader_election.cc:343] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.607873  3411 raft_consensus.cc:359] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.616760  3411 raft_consensus.cc:385] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.619596  3411 raft_consensus.cc:740] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.617918  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:17.620675  3411 consensus_queue.cc:260] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.621712  3409 tablet_bootstrap.cc:654] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.622052  3360 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:17.623155  3410 raft_consensus.cc:359] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.623907  3410 raft_consensus.cc:385] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.624203  3410 raft_consensus.cc:740] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.624717  3255 leader_election.cc:304] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.612071  3414 raft_consensus.cc:359] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.625522  3414 raft_consensus.cc:385] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.625824  3414 raft_consensus.cc:740] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.626044  3444 raft_consensus.cc:2804] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.626555  3444 raft_consensus.cc:493] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.626998  3444 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.626639  3414 consensus_queue.cc:260] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.628923  3414 ts_tablet_manager.cc:1434] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:14:17.629983  3414 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:17.623538  3411 ts_tablet_manager.cc:1434] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.007s
I20260709 13:14:17.635742  3444 raft_consensus.cc:515] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.637102  3411 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:17.636930  3035 catalog_manager.cc:5697] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.645859  3411 tablet_bootstrap.cc:654] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.647795  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:17.624940  3410 consensus_queue.cc:260] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:17.649580  3253 leader_election.cc:343] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.650672  3535 raft_consensus.cc:493] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.651072  3410 ts_tablet_manager.cc:1434] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:14:17.652315  3410 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:17.655146  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:17.658502  3360 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.651221  3535 raft_consensus.cc:515] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.661844  3410 tablet_bootstrap.cc:654] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.666105  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:17.667671  3444 leader_election.cc:290] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:17.668028  3255 leader_election.cc:343] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.668792  3535 leader_election.cc:290] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:17.670732  3409 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:17.670574  3360 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:17.671442  3409 ts_tablet_manager.cc:1403] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.009s
I20260709 13:14:17.672389  3255 leader_election.cc:304] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.673296  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:17.646799  3036 catalog_manager.cc:5697] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:17.674711  3254 leader_election.cc:343] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.674558  3409 raft_consensus.cc:359] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.675428  3409 raft_consensus.cc:385] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.675355  3254 leader_election.cc:304] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:17.675843  3409 raft_consensus.cc:740] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.674552  3535 raft_consensus.cc:2804] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.677079  3444 raft_consensus.cc:2749] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.677590  3535 raft_consensus.cc:697] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:17.678733  3535 consensus_queue.cc:237] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.677613  3411 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:17.682413  3411 ts_tablet_manager.cc:1403] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260709 13:14:17.684906  3411 raft_consensus.cc:359] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.676751  3409 consensus_queue.cc:260] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.618568  3570 raft_consensus.cc:515] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.690716  3411 raft_consensus.cc:385] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.703964  3411 raft_consensus.cc:740] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.705174  3411 consensus_queue.cc:260] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.708259  3411 ts_tablet_manager.cc:1434] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:14:17.691272  3409 ts_tablet_manager.cc:1434] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:14:17.710739  3409 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:17.709446  3411 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:17.706169  3414 tablet_bootstrap.cc:654] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.719732  3409 tablet_bootstrap.cc:654] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.719835  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161c10ebbba04c93bd1debaffb57b9f3" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:17.688936  3410 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.725925  3410 ts_tablet_manager.cc:1403] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.005s
I20260709 13:14:17.733945  3570 leader_election.cc:290] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:17.734476  3410 raft_consensus.cc:359] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.726495  3137 raft_consensus.cc:3060] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.735977  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "161c10ebbba04c93bd1debaffb57b9f3" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:17.737789  3539 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:17.737950  3327 leader_election.cc:343] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.735208  3410 raft_consensus.cc:385] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.739259  3410 raft_consensus.cc:740] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.738866  3539 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.740648  3410 consensus_queue.cc:260] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.748251  3548 raft_consensus.cc:493] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.749919  3548 raft_consensus.cc:515] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.758363  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.759171  3216 raft_consensus.cc:2468] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:17.760414  3137 raft_consensus.cc:2468] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:17.761045  3253 leader_election.cc:304] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:17.760433  3411 tablet_bootstrap.cc:654] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.762073  3444 raft_consensus.cc:2804] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.762516  3444 raft_consensus.cc:493] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.762377  3328 leader_election.cc:304] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.763284  3444 raft_consensus.cc:3060] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.764832  3570 raft_consensus.cc:2804] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.765664  3570 raft_consensus.cc:697] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:17.766410  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:17.766455  3410 ts_tablet_manager.cc:1434] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:14:17.767041  3570 consensus_queue.cc:237] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.768482  3410 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:17.770215  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:17.771476  3546 raft_consensus.cc:493] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.771685  3360 raft_consensus.cc:2468] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:17.772167  3546 raft_consensus.cc:515] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.774955  3546 leader_election.cc:290] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:17.784034  3410 tablet_bootstrap.cc:654] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.783749  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:17.786859  3104 leader_election.cc:343] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:17.790424  3106 leader_election.cc:343] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.793370  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:17.800046  3104 leader_election.cc:343] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.801617  3104 leader_election.cc:304] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.802232  3548 leader_election.cc:290] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.803037  3539 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:17.804898  3444 raft_consensus.cc:515] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.811074  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:17.812402  3289 raft_consensus.cc:2468] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:17.822507  3414 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:17.822427  3106 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:17.837556  3541 raft_consensus.cc:2804] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.837667  3546 consensus_queue.cc:1048] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.838346  3541 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.838937  3541 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.810626  3539 raft_consensus.cc:2749] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.845337  3414 ts_tablet_manager.cc:1403] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.216s	user 0.015s	sys 0.000s
I20260709 13:14:17.848456  3409 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:17.849043  3409 ts_tablet_manager.cc:1403] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.139s	user 0.048s	sys 0.052s
I20260709 13:14:17.780970  3035 catalog_manager.cc:5697] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.857542  3546 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.859361  3541 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.862766  3409 raft_consensus.cc:359] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.863662  3409 raft_consensus.cc:385] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.864521  3409 raft_consensus.cc:740] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.865165  3409 consensus_queue.cc:260] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.866837  3409 ts_tablet_manager.cc:1434] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:17.870436  3409 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:17.877143  3539 consensus_queue.cc:1048] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.893611  3440 consensus_queue.cc:1048] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.902859  3414 raft_consensus.cc:359] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.905539  3414 raft_consensus.cc:385] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.906020  3414 raft_consensus.cc:740] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.906823  3414 consensus_queue.cc:260] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:17.905107  3444 leader_election.cc:290] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:17.914469  3411 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:17.914764  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:17.915140  3411 ts_tablet_manager.cc:1403] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.206s	user 0.036s	sys 0.010s
I20260709 13:14:17.915532  3216 raft_consensus.cc:3060] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.919860  3467 consensus_queue.cc:1048] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.920110  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:17.921703  3362 raft_consensus.cc:3060] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.930202  3409 tablet_bootstrap.cc:654] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.932485  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:17.934140  3539 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.934886  3414 ts_tablet_manager.cc:1434] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.089s	user 0.003s	sys 0.004s
I20260709 13:14:17.936048  3414 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:17.941854  3411 raft_consensus.cc:359] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.942754  3411 raft_consensus.cc:385] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.943107  3411 raft_consensus.cc:740] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.943970  3411 consensus_queue.cc:260] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:17.945638  3104 leader_election.cc:343] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.946832  3216 raft_consensus.cc:2468] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:17.948535  3253 leader_election.cc:304] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:17.951038  3410 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:17.951593  3410 ts_tablet_manager.cc:1403] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.015s
I20260709 13:14:17.949815  3548 raft_consensus.cc:2804] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.952512  3548 raft_consensus.cc:697] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:17.951972  3541 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:17.949747  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:17.953115  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:17.956364  3290 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.957134  3570 raft_consensus.cc:493] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.957731  3570 raft_consensus.cc:515] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:17.958465  3410 raft_consensus.cc:359] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.959141  3410 raft_consensus.cc:385] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.959947  3570 leader_election.cc:290] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:17.961208  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:17.959406  3410 raft_consensus.cc:740] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.967545  3411 ts_tablet_manager.cc:1434] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 13:14:17.969635  3411 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:17.965965  3410 consensus_queue.cc:260] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:17.965739  3140 raft_consensus.cc:2468] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:17.980090  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:17.980990  3286 raft_consensus.cc:2468] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:17.952713  3362 raft_consensus.cc:2468] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:17.989656  3410 ts_tablet_manager.cc:1434] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:14:17.992643  3328 leader_election.cc:304] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:17.953444  3548 consensus_queue.cc:237] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:17.995528  3410 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:17.997655  3570 raft_consensus.cc:2804] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.006803  3570 raft_consensus.cc:493] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.007236  3570 raft_consensus.cc:3060] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.012123  3411 tablet_bootstrap.cc:654] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.013643  3290 raft_consensus.cc:2468] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:18.023032  3106 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:18.023960  3544 raft_consensus.cc:2804] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.024523  3544 raft_consensus.cc:697] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:18.025384  3544 consensus_queue.cc:237] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.038251  3414 tablet_bootstrap.cc:654] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.051328  3410 tablet_bootstrap.cc:654] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.081725  3411 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.082482  3411 ts_tablet_manager.cc:1403] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.113s	user 0.025s	sys 0.000s
I20260709 13:14:18.094224  3409 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:18.095042  3409 ts_tablet_manager.cc:1403] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.227s	user 0.039s	sys 0.013s
I20260709 13:14:18.099668  3411 raft_consensus.cc:359] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.102654  3411 raft_consensus.cc:385] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.103200  3411 raft_consensus.cc:740] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.117350  3411 consensus_queue.cc:260] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.120371  3411 ts_tablet_manager.cc:1434] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.005s
I20260709 13:14:18.121539  3411 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.125962  3409 raft_consensus.cc:359] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.126848  3409 raft_consensus.cc:385] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.127132  3409 raft_consensus.cc:740] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.127846  3409 consensus_queue.cc:260] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.132146  3606 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.132965  3606 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.139245  3409 ts_tablet_manager.cc:1434] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:14:18.140772  3409 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:18.141918  3606 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:18.133306  3570 raft_consensus.cc:515] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.144886  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:18.147554  3327 leader_election.cc:343] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.147650  3570 leader_election.cc:290] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:18.147241  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:18.148981  3290 raft_consensus.cc:3060] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.159241  3290 raft_consensus.cc:2468] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:18.164675  3329 leader_election.cc:304] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:18.165856  3570 raft_consensus.cc:2804] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.166435  3570 raft_consensus.cc:697] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:18.165679  3039 catalog_manager.cc:5697] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.167415  3570 consensus_queue.cc:237] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.164732  3037 catalog_manager.cc:5697] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:18.183178  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 73166.3us
I20260709 13:14:18.186861  3414 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:18.187440  3414 ts_tablet_manager.cc:1403] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.252s	user 0.012s	sys 0.008s
I20260709 13:14:18.190083  3544 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.190707  3544 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.194481  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:18.195226  3288 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:18.196832  3106 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:18.198107  3546 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.198581  3546 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.198999  3546 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.204068  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:18.204896  3137 raft_consensus.cc:3060] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.209820  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:18.210940  3140 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:18.212111  3411 tablet_bootstrap.cc:654] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.213500  3328 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:18.215353  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:18.215848  3606 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.216312  3606 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.216701  3606 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.217893  3544 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:18.205449  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 56680.8us
I20260709 13:14:18.219336  3216 raft_consensus.cc:3060] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.221220  3039 catalog_manager.cc:5697] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:18.230089  3104 leader_election.cc:343] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.230468  3570 consensus_queue.cc:1048] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.230966  3137 raft_consensus.cc:2468] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
W20260709 13:14:18.237480  3253 consensus_peers.cc:597] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:18.240656  3606 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.232196  3414 raft_consensus.cc:359] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.246098  3639 consensus_queue.cc:1048] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.266026  3606 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:18.258663  3409 tablet_bootstrap.cc:654] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.249073  3410 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:18.269351  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:18.304936  3410 ts_tablet_manager.cc:1403] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.313s	user 0.016s	sys 0.013s
I20260709 13:14:18.269917  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:18.246618  3414 raft_consensus.cc:385] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:18.306280  3327 leader_election.cc:343] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.306840  3414 raft_consensus.cc:740] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.295744  3411 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.307885  3411 ts_tablet_manager.cc:1403] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.005s
I20260709 13:14:18.311050  3414 consensus_queue.cc:260] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.315032  3607 consensus_queue.cc:1048] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.310467  3410 raft_consensus.cc:359] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.316092  3410 raft_consensus.cc:385] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.316586  3410 raft_consensus.cc:740] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.250980  3037 catalog_manager.cc:5697] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.325644  3410 consensus_queue.cc:260] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.328289  3410 ts_tablet_manager.cc:1434] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:14:18.338735  3410 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:18.306277  3137 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.347558  3410 tablet_bootstrap.cc:654] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.246789  3546 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.355695  3414 ts_tablet_manager.cc:1434] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.168s	user 0.009s	sys 0.000s
I20260709 13:14:18.357455  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:18.361634  3546 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:18.362071  3414 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:18.363780  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:18.364619  3290 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.364766  3137 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
W20260709 13:14:18.365783  3104 leader_election.cc:343] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.366425  3328 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:18.360471  3411 raft_consensus.cc:359] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.367326  3606 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.371268  3411 raft_consensus.cc:385] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.371461  3606 raft_consensus.cc:697] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:18.371649  3411 raft_consensus.cc:740] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.372398  3411 consensus_queue.cc:260] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.372454  3606 consensus_queue.cc:237] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.375310  3411 ts_tablet_manager.cc:1434] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:14:18.376410  3411 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.384284  3414 tablet_bootstrap.cc:654] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.388042  3411 tablet_bootstrap.cc:654] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.393818  3607 raft_consensus.cc:493] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.394567  3607 raft_consensus.cc:515] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.400362  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:18.401306  3137 raft_consensus.cc:2468] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:18.403337  3607 leader_election.cc:290] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:18.404610  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:18.406739  3290 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:18.408249  3106 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:18.409235  3546 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.409762  3546 raft_consensus.cc:697] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:18.410604  3546 consensus_queue.cc:237] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.410627  3328 leader_election.cc:304] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:18.415789  3409 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:18.416366  3409 ts_tablet_manager.cc:1403] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.276s	user 0.009s	sys 0.027s
I20260709 13:14:18.416661  3607 raft_consensus.cc:2804] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.417064  3607 raft_consensus.cc:493] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.417444  3607 raft_consensus.cc:3060] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:18.418234  3327 leader_election.cc:343] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.419341  3409 raft_consensus.cc:359] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.424602  3410 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:18.420035  3409 raft_consensus.cc:385] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.429013  3409 raft_consensus.cc:740] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.429868  3409 consensus_queue.cc:260] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.426396  3607 raft_consensus.cc:515] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.427573  3411 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.432873  3411 ts_tablet_manager.cc:1403] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.005s
I20260709 13:14:18.435019  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:18.435724  3140 raft_consensus.cc:3060] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.441926  3036 catalog_manager.cc:5697] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.444065  3411 raft_consensus.cc:359] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.443250  3410 ts_tablet_manager.cc:1403] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.014s
I20260709 13:14:18.444861  3411 raft_consensus.cc:385] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.445238  3411 raft_consensus.cc:740] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.445948  3411 consensus_queue.cc:260] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.448381  3140 raft_consensus.cc:2468] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:18.448860  3037 catalog_manager.cc:5697] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.449523  3607 leader_election.cc:290] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:18.451704  3409 ts_tablet_manager.cc:1434] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:14:18.448899  3410 raft_consensus.cc:359] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.454250  3328 leader_election.cc:304] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:18.464387  3606 raft_consensus.cc:2804] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.465858  3606 raft_consensus.cc:697] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:18.467007  3410 raft_consensus.cc:385] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.467442  3410 raft_consensus.cc:740] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.466756  3606 consensus_queue.cc:237] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.468446  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba17a83551cc4376a2c46e57f9cf2ed1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:18.469089  3410 consensus_queue.cc:260] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:18.470367  3327 leader_election.cc:343] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.448230  3411 ts_tablet_manager.cc:1434] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:14:18.472925  3411 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.475673  3409 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:18.479811  3411 tablet_bootstrap.cc:654] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.459100  3414 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:18.481668  3535 raft_consensus.cc:493] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.484066  3409 tablet_bootstrap.cc:654] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.483961  3535 raft_consensus.cc:515] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.487654  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:18.489379  3414 ts_tablet_manager.cc:1403] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.128s	user 0.022s	sys 0.008s
I20260709 13:14:18.489501  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:18.490898  3253 leader_election.cc:343] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.488737  3535 leader_election.cc:290] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:18.495972  3414 raft_consensus.cc:359] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.496922  3414 raft_consensus.cc:385] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.497222  3414 raft_consensus.cc:740] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
W20260709 13:14:18.493091  3255 leader_election.cc:343] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.498034  3414 consensus_queue.cc:260] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.498432  3255 leader_election.cc:304] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:18.502475  3535 raft_consensus.cc:2749] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.493319  3410 ts_tablet_manager.cc:1434] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:14:18.494537  3036 catalog_manager.cc:5697] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.495972  3411 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.509543  3411 ts_tablet_manager.cc:1403] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.004s
I20260709 13:14:18.510464  3410 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:18.521292  3410 tablet_bootstrap.cc:654] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.513027  3411 raft_consensus.cc:359] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.524845  3411 raft_consensus.cc:385] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.525255  3411 raft_consensus.cc:740] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.526475  3409 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:18.526139  3411 consensus_queue.cc:260] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.527043  3409 ts_tablet_manager.cc:1403] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 13:14:18.528594  3411 ts_tablet_manager.cc:1434] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:14:18.530468  3535 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.531091  3535 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.532716  3414 ts_tablet_manager.cc:1434] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:14:18.535696  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:18.536662  3362 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:18.536948  3414 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:18.543741  3255 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:18.544826  3548 consensus_queue.cc:1048] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.545357  3414 tablet_bootstrap.cc:654] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.546602  3548 raft_consensus.cc:2804] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.547118  3548 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.547636  3548 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.557663  3411 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.558284  3535 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:18.566160  3411 tablet_bootstrap.cc:654] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.565927  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:18.569897  3140 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:18.570199  3409 raft_consensus.cc:359] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.571511  3409 raft_consensus.cc:385] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.571902  3409 raft_consensus.cc:740] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.576200  3215 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.575996  3548 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.572964  3409 consensus_queue.cc:260] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.584628  3409 ts_tablet_manager.cc:1434] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:14:18.587373  3409 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:18.605347  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:18.616701  3140 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.610772  3636 consensus_queue.cc:1048] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:14:18.623010  3541 consensus_queue.cc:1048] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.613929  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:18.626174  3362 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.614955  3641 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.630185  3641 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.614539  3639 consensus_queue.cc:1048] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:14:18.635082  3362 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:18.645695  3255 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:18.646780  3637 raft_consensus.cc:2804] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.647339  3637 raft_consensus.cc:697] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:18.648303  3641 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:18.649443  3607 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.648355  3637 consensus_queue.cc:237] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.651269  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:18.649326  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:18.653098  3641 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.650259  3607 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.655021  3641 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.663266  3140 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:18.656666  3180 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:18.660934  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:18.602743  3548 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:18.663769  3607 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:18.665334  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:18.669044  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:18.694149  3414 tablet_bootstrap.cc:492] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:18.695514  3414 ts_tablet_manager.cc:1403] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.031s
W20260709 13:14:18.691448  3327 leader_election.cc:343] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.695912  3578 raft_consensus.cc:2749] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:18.698165  3606 consensus_queue.cc:1048] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:14:18.704088  3329 leader_election.cc:343] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.711040  3410 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:18.711663  3410 ts_tablet_manager.cc:1403] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.000s
I20260709 13:14:18.715503  3410 raft_consensus.cc:359] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.716120  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:18.716751  3410 raft_consensus.cc:385] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.717134  3410 raft_consensus.cc:740] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.717746  3140 raft_consensus.cc:2393] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:18.719457  3414 raft_consensus.cc:359] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.720268  3414 raft_consensus.cc:385] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.720551  3414 raft_consensus.cc:740] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.723747  3329 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:18.721294  3414 consensus_queue.cc:260] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.729879  3181 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:18.730217  3607 raft_consensus.cc:2749] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.731681  3414 ts_tablet_manager.cc:1434] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:14:18.732777  3414 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:18.732048  3578 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.738557  3411 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.739171  3411 ts_tablet_manager.cc:1403] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.182s	user 0.038s	sys 0.052s
I20260709 13:14:18.748620  3410 consensus_queue.cc:260] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:18.706919  3641 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:18.758410  3414 tablet_bootstrap.cc:654] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.766113  3541 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.766422  3411 raft_consensus.cc:359] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.769039  3411 raft_consensus.cc:385] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.772274  3411 raft_consensus.cc:740] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.769284  3541 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.774760  3541 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:18.775476  3607 consensus_queue.cc:1048] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.776927  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:18.778852  3106 leader_election.cc:343] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.779186  3409 tablet_bootstrap.cc:654] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.780382  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:18.784168  3410 ts_tablet_manager.cc:1434] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.004s
I20260709 13:14:18.787060  3410 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
W20260709 13:14:18.790897  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 61127.4us
I20260709 13:14:18.803174  3036 catalog_manager.cc:5697] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.803915  3578 raft_consensus.cc:2749] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:18.775429  3411 consensus_queue.cc:260] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.816452  3411 ts_tablet_manager.cc:1434] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:14:18.817860  3411 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.817883  3409 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:18.820070  3409 ts_tablet_manager.cc:1403] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.234s	user 0.022s	sys 0.002s
I20260709 13:14:18.813776  3361 raft_consensus.cc:2468] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:18.826404  3409 raft_consensus.cc:359] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.827211  3409 raft_consensus.cc:385] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.827502  3409 raft_consensus.cc:740] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.828329  3409 consensus_queue.cc:260] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.832157  3414 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:18.832770  3414 ts_tablet_manager.cc:1403] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.000s
I20260709 13:14:18.840905  3411 tablet_bootstrap.cc:654] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.846225  3106 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:18.848186  3541 raft_consensus.cc:2804] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:18.848122  3607 consensus_queue.cc:1048] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.848917  3541 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.849494  3541 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.846642  3414 raft_consensus.cc:359] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.855499  3414 raft_consensus.cc:385] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.856422  3414 raft_consensus.cc:740] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.858788  3414 consensus_queue.cc:260] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:18.862282  3414 ts_tablet_manager.cc:1434] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:14:18.868875  3414 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:18.864471  3541 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.866226  3409 ts_tablet_manager.cc:1434] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:14:18.874228  3607 consensus_queue.cc:1048] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.879359  3414 tablet_bootstrap.cc:654] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.880133  3409 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:18.907334  3411 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:18.908033  3411 ts_tablet_manager.cc:1403] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.000s
I20260709 13:14:18.883903  3541 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:18.886507  3410 tablet_bootstrap.cc:654] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:18.887984  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:18.891726  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:18.915335  3361 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:18.892313  3104 consensus_peers.cc:597] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:18.918565  3106 leader_election.cc:343] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:18.894105  3606 consensus_queue.cc:1048] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:18.912216  3411 raft_consensus.cc:359] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.929917  3411 raft_consensus.cc:385] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:18.930354  3411 raft_consensus.cc:740] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:18.932003  3411 consensus_queue.cc:260] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.933938  3411 ts_tablet_manager.cc:1434] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:14:18.943295  3361 raft_consensus.cc:2468] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:18.951349  3411 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:18.953083  3106 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:18.962572  3636 raft_consensus.cc:2804] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:18.963168  3636 raft_consensus.cc:697] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:18.964793  3670 raft_consensus.cc:493] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.964315  3636 consensus_queue.cc:237] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:18.965487  3670 raft_consensus.cc:515] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:18.972734  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:18.973590  3670 leader_election.cc:290] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:18.975937  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:18.989434  3411 tablet_bootstrap.cc:654] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:18.974682  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 75637.1us
I20260709 13:14:18.991886  3215 raft_consensus.cc:3060] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:18.993714  3410 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:18.994496  3410 ts_tablet_manager.cc:1403] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.013s
I20260709 13:14:18.999284  3410 raft_consensus.cc:359] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.003501  3410 raft_consensus.cc:385] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.003839  3410 raft_consensus.cc:740] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.004983  3679 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.004683  3410 consensus_queue.cc:260] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.005952  3679 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.006579  3546 consensus_queue.cc:1048] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.011765  3181 leader_election.cc:304] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:19.013995  3578 raft_consensus.cc:2749] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.015069  3637 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.015797  3637 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.021832  3637 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:19.032622  3679 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.034076  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.037842  3361 raft_consensus.cc:2393] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:19.037658  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:19.049949  3327 leader_election.cc:343] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.052953  3414 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.054209  3414 ts_tablet_manager.cc:1403] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.186s	user 0.010s	sys 0.035s
I20260709 13:14:19.059748  3541 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.060767  3541 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.063257  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.064361  3410 ts_tablet_manager.cc:1434] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.001s
I20260709 13:14:19.065743  3254 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:19.063489  3679 consensus_queue.cc:1048] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.068866  3213 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.073159  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.073477  3541 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.074187  3362 raft_consensus.cc:2468] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:19.074187  3548 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.080701  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.084941  3414 raft_consensus.cc:359] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.086088  3414 raft_consensus.cc:385] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.086526  3414 raft_consensus.cc:740] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.087654  3414 consensus_queue.cc:260] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:19.088006  3104 leader_election.cc:343] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.039435  3409 tablet_bootstrap.cc:700] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Time spent opening tablet: real 0.135s	user 0.005s	sys 0.000s
I20260709 13:14:19.090421  3106 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:19.090858  3409 tablet_bootstrap.cc:654] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.091446  3541 raft_consensus.cc:2804] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.092074  3541 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.092510  3541 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.097167  3639 consensus_queue.cc:1048] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.100690  3410 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:19.101753  3679 raft_consensus.cc:493] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.102394  3679 raft_consensus.cc:515] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.103806  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.089067  3548 raft_consensus.cc:2749] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.114506  3414 ts_tablet_manager.cc:1434] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:14:19.115697  3444 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.115476  3679 leader_election.cc:290] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.118360  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.121001  3444 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.121851  3288 raft_consensus.cc:2468] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:19.118673  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.123324  3414 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.123629  3444 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.123787  3329 leader_election.cc:304] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:19.128670  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.132304  3541 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.125025  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.120059  3410 tablet_bootstrap.cc:654] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:19.133666  3254 leader_election.cc:343] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.132375  3679 raft_consensus.cc:2804] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:19.152369  3327 leader_election.cc:343] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.157166  3137 raft_consensus.cc:2393] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:19.166551  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:19.161525  3679 raft_consensus.cc:493] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.168236  3679 raft_consensus.cc:3060] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:19.168421  3104 leader_election.cc:343] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.163913  3253 leader_election.cc:343] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.170078  3253 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:19.160636  3038 catalog_manager.cc:5697] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.171587  3444 raft_consensus.cc:2749] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.175731  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:19.176532  3361 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.179031  3541 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.180136  3414 tablet_bootstrap.cc:654] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.190553  3548 consensus_queue.cc:1048] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.259670  3409 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:19.259338  3679 raft_consensus.cc:515] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.260294  3409 ts_tablet_manager.cc:1403] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.380s	user 0.030s	sys 0.018s
I20260709 13:14:19.264750  3411 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:19.265455  3411 ts_tablet_manager.cc:1403] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.330s	user 0.037s	sys 0.007s
I20260709 13:14:19.273191  3414 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.273955  3414 ts_tablet_manager.cc:1403] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.153s	user 0.036s	sys 0.003s
I20260709 13:14:19.278945  3679 leader_election.cc:290] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.279038  3414 raft_consensus.cc:359] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.279963  3414 raft_consensus.cc:385] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.280248  3414 raft_consensus.cc:740] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.280416  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:19.281090  3288 raft_consensus.cc:3060] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.281147  3414 consensus_queue.cc:260] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.286633  3409 raft_consensus.cc:359] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.287318  3409 raft_consensus.cc:385] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.287561  3409 raft_consensus.cc:740] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.288245  3409 consensus_queue.cc:260] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.288509  3414 ts_tablet_manager.cc:1434] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:19.289677  3414 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.290594  3409 ts_tablet_manager.cc:1434] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:14:19.291661  3409 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:19.252003  3328 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:19.293284  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 50073.2us
I20260709 13:14:19.284760  3411 raft_consensus.cc:359] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.294324  3411 raft_consensus.cc:385] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.294613  3411 raft_consensus.cc:740] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.298154  3414 tablet_bootstrap.cc:654] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.300115  3361 raft_consensus.cc:2468] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:19.312889  3409 tablet_bootstrap.cc:654] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.313686  3410 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:19.314260  3410 ts_tablet_manager.cc:1403] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.214s	user 0.035s	sys 0.020s
W20260709 13:14:19.312254  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:19.320695  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:19.321112  3106 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:19.322101  3411 consensus_queue.cc:260] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.323817  3541 raft_consensus.cc:2804] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.325685  3541 raft_consensus.cc:697] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:19.326646  3541 consensus_queue.cc:237] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:19.327975  3327 leader_election.cc:343] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.331579  3410 raft_consensus.cc:359] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.332444  3410 raft_consensus.cc:385] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.332760  3410 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.337069  3411 ts_tablet_manager.cc:1434] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.071s	user 0.010s	sys 0.000s
I20260709 13:14:19.340876  3411 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:19.309803  3679 raft_consensus.cc:2749] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.346232  3410 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.352890  3410 ts_tablet_manager.cc:1434] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:14:19.354079  3410 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:19.352241  3288 raft_consensus.cc:2468] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:19.377555  3329 leader_election.cc:304] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:19.377962  3670 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.378931  3607 raft_consensus.cc:2804] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.379563  3607 raft_consensus.cc:697] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:19.380424  3607 consensus_queue.cc:237] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.380865  3411 tablet_bootstrap.cc:654] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.378566  3670 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.380951  3410 tablet_bootstrap.cc:654] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.391804  3670 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.399250  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.399670  3213 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.401678  3637 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.402495  3637 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.406543  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.406973  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:19.408156  3254 leader_election.cc:343] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.417829  3181 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:19.420598  3037 catalog_manager.cc:5697] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.426698  3637 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.432170  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:19.441486  3253 leader_election.cc:343] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.453063  3541 consensus_queue.cc:1048] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.444577  3253 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:19.470709  3637 raft_consensus.cc:2749] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.476018  3414 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.476554  3414 ts_tablet_manager.cc:1403] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.187s	user 0.030s	sys 0.027s
I20260709 13:14:19.479799  3414 raft_consensus.cc:359] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.485767  3414 raft_consensus.cc:385] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.486614  3414 raft_consensus.cc:740] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.487577  3414 consensus_queue.cc:260] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.490003  3414 ts_tablet_manager.cc:1434] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:19.496282  3414 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.513414  3670 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.507496  3541 consensus_queue.cc:1048] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:19.530215  3440 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.530841  3440 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.537801  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.538628  3290 raft_consensus.cc:2468] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:19.540141  3181 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:19.542389  3578 raft_consensus.cc:2804] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.542927  3578 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.543363  3578 raft_consensus.cc:3060] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.544492  3410 tablet_bootstrap.cc:492] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:19.545092  3410 ts_tablet_manager.cc:1403] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.191s	user 0.036s	sys 0.029s
I20260709 13:14:19.545503  3411 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:19.546118  3411 ts_tablet_manager.cc:1403] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.052s
I20260709 13:14:19.546859  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.547688  3139 raft_consensus.cc:2468] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:19.548741  3410 raft_consensus.cc:359] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.549261  3411 raft_consensus.cc:359] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.550009  3410 raft_consensus.cc:385] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.550418  3410 raft_consensus.cc:740] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.550168  3411 raft_consensus.cc:385] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.551069  3411 raft_consensus.cc:740] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.554787  3411 consensus_queue.cc:260] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.557272  3414 tablet_bootstrap.cc:654] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.558212  3411 ts_tablet_manager.cc:1434] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:14:19.559403  3411 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:19.545456  3409 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:19.561982  3410 consensus_queue.cc:260] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.565367  3409 ts_tablet_manager.cc:1403] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.274s	user 0.021s	sys 0.019s
I20260709 13:14:19.567130  3410 ts_tablet_manager.cc:1434] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:14:19.569100  3410 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:19.573303  3409 raft_consensus.cc:359] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.574965  3409 raft_consensus.cc:385] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.575383  3409 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.576458  3409 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.537834  3038 catalog_manager.cc:5697] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.579919  3409 ts_tablet_manager.cc:1434] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 13:14:19.581615  3409 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:19.584522  3410 tablet_bootstrap.cc:654] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.592278  3411 tablet_bootstrap.cc:654] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.593175  3414 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.593708  3414 ts_tablet_manager.cc:1403] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.008s
I20260709 13:14:19.533268  3440 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.598313  3414 raft_consensus.cc:359] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.599026  3414 raft_consensus.cc:385] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.604266  3409 tablet_bootstrap.cc:654] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.599298  3414 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.606037  3414 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.608213  3414 ts_tablet_manager.cc:1434] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:14:19.609215  3414 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.613730  3411 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:19.617499  3411 ts_tablet_manager.cc:1403] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.005s
I20260709 13:14:19.621623  3411 raft_consensus.cc:359] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.622617  3411 raft_consensus.cc:385] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.622982  3411 raft_consensus.cc:740] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.623829  3411 consensus_queue.cc:260] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.624795  3414 tablet_bootstrap.cc:654] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.616571  3410 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:19.625559  3410 ts_tablet_manager.cc:1403] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260709 13:14:19.629290  3410 raft_consensus.cc:359] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.630661  3410 raft_consensus.cc:385] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.631282  3410 raft_consensus.cc:740] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.632270  3410 consensus_queue.cc:260] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.642596  3410 ts_tablet_manager.cc:1434] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:14:19.637162  3411 ts_tablet_manager.cc:1434] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:19.644824  3411 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:19.649880  3578 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.652069  3410 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:19.657951  3409 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:19.658763  3409 ts_tablet_manager.cc:1403] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.004s
I20260709 13:14:19.671226  3409 raft_consensus.cc:359] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.672384  3409 raft_consensus.cc:385] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.672739  3409 raft_consensus.cc:740] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.674350  3409 consensus_queue.cc:260] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.676847  3409 ts_tablet_manager.cc:1434] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:14:19.681115  3411 tablet_bootstrap.cc:654] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.686223  3410 tablet_bootstrap.cc:654] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.692046  3409 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:19.701484  3409 tablet_bootstrap.cc:654] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.702407  3411 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:19.703363  3411 ts_tablet_manager.cc:1403] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.002s
I20260709 13:14:19.714524  3578 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.715363  3410 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:19.715263  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:19.717317  3139 raft_consensus.cc:3060] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.718683  3410 ts_tablet_manager.cc:1403] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.001s
I20260709 13:14:19.723500  3411 raft_consensus.cc:359] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.723763  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:19.724378  3411 raft_consensus.cc:385] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.724701  3288 raft_consensus.cc:3060] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.727072  3607 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.728371  3607 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.730219  3410 raft_consensus.cc:359] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.730623  3139 raft_consensus.cc:2468] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:19.731171  3410 raft_consensus.cc:385] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.731511  3410 raft_consensus.cc:740] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.732867  3410 consensus_queue.cc:260] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.733194  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.733322  3180 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:19.735280  3607 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.735540  3440 raft_consensus.cc:2804] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.739439  3440 raft_consensus.cc:697] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:19.739769  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.740859  3440 consensus_queue.cc:237] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.735524  3410 ts_tablet_manager.cc:1434] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
W20260709 13:14:19.736526  3328 leader_election.cc:343] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:19.752887  3327 leader_election.cc:343] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.753916  3327 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:19.756870  3607 raft_consensus.cc:2749] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:19.759799  3410 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:19.765321  3414 tablet_bootstrap.cc:492] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.765969  3414 ts_tablet_manager.cc:1403] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.029s
I20260709 13:14:19.778970  3288 raft_consensus.cc:2468] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:19.780227  3607 consensus_queue.cc:1048] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:19.788642  3578 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.789299  3578 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.789727  3607 raft_consensus.cc:493] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.790546  3607 raft_consensus.cc:515] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.791749  3410 tablet_bootstrap.cc:654] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.794515  3637 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.795337  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.795229  3637 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.724712  3411 raft_consensus.cc:740] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.799826  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.815833  3139 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:19.815951  3411 consensus_queue.cc:260] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.800684  3414 raft_consensus.cc:359] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.817950  3414 raft_consensus.cc:385] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:19.802141  3329 leader_election.cc:343] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.804553  3409 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:19.818135  3180 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:19.819850  3409 ts_tablet_manager.cc:1403] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.128s	user 0.025s	sys 0.027s
I20260709 13:14:19.818549  3414 raft_consensus.cc:740] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.820899  3411 ts_tablet_manager.cc:1434] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 13:14:19.821265  3414 consensus_queue.cc:260] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.823494  3409 raft_consensus.cc:359] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.823935  3670 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.824397  3670 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.791908  3578 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:19.806308  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 64634.4us
I20260709 13:14:19.831048  3409 raft_consensus.cc:385] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.824920  3607 leader_election.cc:290] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:19.824920  3670 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.836020  3578 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.826342  3411 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:19.838339  3637 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.838250  3578 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.829500  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.840727  3361 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:19.826637  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.840488  3037 catalog_manager.cc:5697] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.831409  3409 raft_consensus.cc:740] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.841859  3215 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:19.842484  3578 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.824419  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.847973  3411 tablet_bootstrap.cc:654] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.842212  3409 consensus_queue.cc:260] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.830503  3636 consensus_queue.cc:1048] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:19.857481  3139 raft_consensus.cc:2468] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:19.842672  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.858734  3409 ts_tablet_manager.cc:1434] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:14:19.858652  3289 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:19.842267  3255 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:19.859854  3409 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:19.860662  3639 raft_consensus.cc:2804] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.861138  3639 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.838191  3440 raft_consensus.cc:493] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.861508  3639 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.862991  3444 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.863554  3444 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.864022  3328 leader_election.cc:304] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:19.865931  3444 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.866178  3525 raft_consensus.cc:2804] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.866591  3525 raft_consensus.cc:493] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.866966  3525 raft_consensus.cc:3060] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.867578  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.861718  3440 raft_consensus.cc:515] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.823432  3414 ts_tablet_manager.cc:1434] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 13:14:19.869933  3440 leader_election.cc:290] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.870087  3679 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.881687  3639 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.882057  3679 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.885030  3679 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:19.871551  3414 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.873920  3213 raft_consensus.cc:3060] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.875393  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.886528  3639 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.887055  3363 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:19.887650  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:19.888347  3362 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.891636  3525 raft_consensus.cc:515] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:19.895112  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.895962  3290 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:19.897336  3329 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:19.898749  3679 raft_consensus.cc:2804] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.899133  3679 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.899479  3679 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.904986  3414 tablet_bootstrap.cc:654] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:19.879774  3409 tablet_bootstrap.cc:654] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:19.870595  3253 leader_election.cc:343] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.910356  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.886349  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:19.910328  3255 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:19.911695  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:19.912909  3216 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.913774  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:19.915915  3327 leader_election.cc:343] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.916214  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:19.922080  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:19.912891  3639 raft_consensus.cc:2804] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:19.923249  3288 raft_consensus.cc:2393] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:19.923426  3639 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.924019  3639 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:19.925310  3414 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:19.925940  3414 ts_tablet_manager.cc:1403] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.000s
I20260709 13:14:19.926887  3362 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:19.937191  3216 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:19.937426  3670 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:19.935510  3414 raft_consensus.cc:359] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.941135  3414 raft_consensus.cc:385] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:19.941682  3414 raft_consensus.cc:740] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:19.942669  3414 consensus_queue.cc:260] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:19.947055  3104 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.949990  3253 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:19.953305  3637 raft_consensus.cc:2804] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:19.953878  3637 raft_consensus.cc:697] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:19.954566  3639 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.954692  3637 consensus_queue.cc:237] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.957051  3639 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:19.958949  3414 ts_tablet_manager.cc:1434] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:14:19.961546  3414 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:19.936806  3679 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:19.964244  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:19.959578  3544 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.959280  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:19.985601  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
W20260709 13:14:19.985061  3253 leader_election.cc:343] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.970788  3680 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.986981  3680 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:19.989532  3329 leader_election.cc:343] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:19.989101  3680 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:19.992352  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:19.993739  3361 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:19.997177  3544 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:19.972718  3181 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.018337  3139 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
W20260709 13:14:20.018484  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 50155.5us
I20260709 13:14:20.019788  3181 leader_election.cc:304] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.021281  3328 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:19.995725  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:20.024463  3678 raft_consensus.cc:2804] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.005241  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:20.026013  3678 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.025586  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.026686  3678 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.027453  3440 raft_consensus.cc:2749] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.028347  3440 raft_consensus.cc:2749] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:20.029340  3327 leader_election.cc:343] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.031003  3255 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:20.032905  3444 raft_consensus.cc:2749] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:14:20.034397  3327 leader_election.cc:343] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.036453  3140 raft_consensus.cc:3060] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.038887  3670 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:20.008085  3525 leader_election.cc:290] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:19.968482  3607 consensus_queue.cc:1048] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
I20260709 13:14:20.066342  3411 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:20.067992  3411 ts_tablet_manager.cc:1403] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.242s	user 0.013s	sys 0.010s
I20260709 13:14:20.069247  3414 tablet_bootstrap.cc:654] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.075380  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:20.050168  3679 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:20.083014  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:20.083827  3139 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.088603  3544 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:20.096635  3409 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:20.097872  3409 ts_tablet_manager.cc:1403] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.238s	user 0.029s	sys 0.051s
I20260709 13:14:20.102294  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:20.102993  3288 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.086742  3444 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.127372  3410 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:20.128026  3410 ts_tablet_manager.cc:1403] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.369s	user 0.022s	sys 0.028s
I20260709 13:14:20.117141  3140 raft_consensus.cc:2468] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:20.120872  3444 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.136251  3409 raft_consensus.cc:359] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.139019  3409 raft_consensus.cc:385] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.139355  3409 raft_consensus.cc:740] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.143953  3409 consensus_queue.cc:260] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.152815  3444 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:20.126902  3678 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.157019  3362 raft_consensus.cc:2393] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:20.157564  3411 raft_consensus.cc:359] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.147755  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.158056  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.160113  3678 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:20.160984  3253 leader_election.cc:343] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.158768  3411 raft_consensus.cc:385] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.162279  3411 raft_consensus.cc:740] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
W20260709 13:14:20.161607  3104 leader_election.cc:343] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.166900  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
W20260709 13:14:20.183656  3327 leader_election.cc:343] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.167564  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:20.185716  3409 ts_tablet_manager.cc:1434] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.001s
I20260709 13:14:20.189513  3409 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:20.191673  3411 consensus_queue.cc:260] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.192893  3137 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.199155  3410 raft_consensus.cc:359] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.201591  3410 raft_consensus.cc:385] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.202325  3410 raft_consensus.cc:740] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.208454  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:20.209491  3290 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:20.207098  3411 ts_tablet_manager.cc:1434] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.002s
I20260709 13:14:20.222693  3410 consensus_queue.cc:260] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.223654  3411 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:20.229278  3329 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.229996  3106 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:20.233510  3678 raft_consensus.cc:2749] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.238431  3544 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.239137  3544 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.243702  3678 raft_consensus.cc:493] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.244637  3678 raft_consensus.cc:515] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.247249  3328 leader_election.cc:304] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.251649  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:20.254103  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:20.254314  3678 leader_election.cc:290] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:20.262610  3718 raft_consensus.cc:2804] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.264279  3718 raft_consensus.cc:697] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:20.268504  3288 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:20.270045  3409 tablet_bootstrap.cc:654] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.265239  3718 consensus_queue.cc:237] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.277038  3410 ts_tablet_manager.cc:1434] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.003s
W20260709 13:14:20.261255  3329 leader_election.cc:343] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.288702  3544 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:20.290110  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.262523  3140 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:20.291997  3138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:20.294389  3254 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:20.296957  3440 consensus_queue.cc:1048] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.298393  3444 raft_consensus.cc:2804] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.284471  3039 catalog_manager.cc:5697] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:20.297232  3719 log.cc:927] Time spent T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.169s	user 0.000s	sys 0.010s
I20260709 13:14:20.299252  3444 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.311849  3444 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.320111  3414 tablet_bootstrap.cc:492] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:20.321244  3414 ts_tablet_manager.cc:1403] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.360s	user 0.036s	sys 0.013s
I20260709 13:14:20.308790  3139 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
W20260709 13:14:20.311849  3328 leader_election.cc:343] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.331137  3328 leader_election.cc:304] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:20.332748  3678 raft_consensus.cc:2749] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.340181  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:20.341563  3104 leader_election.cc:343] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.342715  3180 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:20.345868  3710 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.346465  3710 raft_consensus.cc:697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:20.347498  3710 consensus_queue.cc:237] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.350342  3411 tablet_bootstrap.cc:654] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.389546  3410 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:20.403374  3414 raft_consensus.cc:359] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.404747  3414 raft_consensus.cc:385] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.405190  3414 raft_consensus.cc:740] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.406183  3414 consensus_queue.cc:260] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.417800  3414 ts_tablet_manager.cc:1434] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.096s	user 0.011s	sys 0.000s
I20260709 13:14:20.419235  3414 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
W20260709 13:14:20.413544  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 68221.1us
I20260709 13:14:20.453809  3670 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.454756  3670 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.462565  3409 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:20.463462  3409 ts_tablet_manager.cc:1403] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.275s	user 0.050s	sys 0.070s
I20260709 13:14:20.487460  3216 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.495229  3411 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:20.495932  3411 ts_tablet_manager.cc:1403] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.273s	user 0.006s	sys 0.019s
I20260709 13:14:20.496150  3137 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:20.497555  3541 raft_consensus.cc:2749] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.507717  3720 consensus_queue.cc:1048] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.511632  3411 raft_consensus.cc:359] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.512637  3411 raft_consensus.cc:385] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.512931  3411 raft_consensus.cc:740] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.513088  3725 consensus_queue.cc:1048] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.514495  3411 consensus_queue.cc:260] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.517342  3411 ts_tablet_manager.cc:1434] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:14:20.518898  3411 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:20.522174  3328 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:20.525369  3410 tablet_bootstrap.cc:654] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.527406  3444 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.528568  3680 raft_consensus.cc:2804] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.529960  3680 raft_consensus.cc:697] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:20.530344  3290 raft_consensus.cc:2393] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:20.530884  3411 tablet_bootstrap.cc:654] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.530876  3680 consensus_queue.cc:237] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.534407  3106 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.535722  3541 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.537110  3670 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:20.538618  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:20.540797  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:20.541368  3409 raft_consensus.cc:359] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.621230  3409 raft_consensus.cc:385] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.621651  3409 raft_consensus.cc:740] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.622412  3409 consensus_queue.cc:260] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.625257  3541 raft_consensus.cc:2749] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.542764  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:20.549734  3670 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.559594  3444 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:20.597505  3036 catalog_manager.cc:5697] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.562362  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:20.630277  3670 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.626338  3180 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:20.624950  3409 ts_tablet_manager.cc:1434] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.000s
I20260709 13:14:20.632593  3670 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:20.633805  3409 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:20.635673  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:20.636581  3289 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:20.639349  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:20.640520  3362 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:20.641673  3141 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:20.642421  3181 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.643640  3725 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.644486  3254 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:20.644937  3409 tablet_bootstrap.cc:654] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.645535  3444 raft_consensus.cc:2804] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:20.646049  3444 raft_consensus.cc:697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:20.647311  3444 consensus_queue.cc:237] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.663897  3444 raft_consensus.cc:493] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.664556  3444 raft_consensus.cc:515] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.671561  3444 leader_election.cc:290] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:20.671764  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:20.672833  3141 raft_consensus.cc:2393] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:20.673161  3725 raft_consensus.cc:2749] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:20.679817  3253 leader_election.cc:343] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:20.684891  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:20.685384  3414 tablet_bootstrap.cc:700] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: Time spent opening tablet: real 0.168s	user 0.003s	sys 0.000s
I20260709 13:14:20.686373  3414 tablet_bootstrap.cc:654] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.687871  3637 consensus_queue.cc:1048] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:20.692607  3670 raft_consensus.cc:2749] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.709830  3409 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:20.710325  3409 ts_tablet_manager.cc:1403] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.003s
I20260709 13:14:20.718783  3411 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:20.713832  3035 catalog_manager.cc:5697] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.719441  3411 ts_tablet_manager.cc:1403] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.005s
I20260709 13:14:20.721539  3409 raft_consensus.cc:359] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.722391  3409 raft_consensus.cc:385] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.722692  3409 raft_consensus.cc:740] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.723057  3411 raft_consensus.cc:359] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.723841  3411 raft_consensus.cc:385] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.724337  3411 raft_consensus.cc:740] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.725274  3411 consensus_queue.cc:260] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.728138  3411 ts_tablet_manager.cc:1434] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:20.728346  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:20.729241  3411 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:20.736588  3409 consensus_queue.cc:260] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.740345  3409 ts_tablet_manager.cc:1434] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:14:20.737066  3411 tablet_bootstrap.cc:654] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.744653  3409 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:20.744586  3255 leader_election.cc:304] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:20.748662  3444 raft_consensus.cc:3060] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.754618  3411 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:20.755231  3411 ts_tablet_manager.cc:1403] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.004s
I20260709 13:14:20.760309  3409 tablet_bootstrap.cc:654] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.762517  3444 raft_consensus.cc:2749] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.758586  3411 raft_consensus.cc:359] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.765111  3411 raft_consensus.cc:385] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.765806  3411 raft_consensus.cc:740] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.766976  3411 consensus_queue.cc:260] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.767473  3409 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:20.768148  3409 ts_tablet_manager.cc:1403] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.003s
I20260709 13:14:20.770965  3411 ts_tablet_manager.cc:1434] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:14:20.772634  3411 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:20.776866  3680 consensus_queue.cc:1048] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.784580  3680 consensus_queue.cc:1048] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:20.791808  3409 raft_consensus.cc:359] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.797688  3718 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.802026  3718 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.804860  3718 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:20.807436  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.809513  3409 raft_consensus.cc:385] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.810199  3409 raft_consensus.cc:740] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.807281  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:20.809152  3327 leader_election.cc:343] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:20.817792  3328 leader_election.cc:343] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.821156  3328 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:20.822539  3718 raft_consensus.cc:2749] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.826246  3411 tablet_bootstrap.cc:654] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.813388  3409 consensus_queue.cc:260] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.838310  3409 ts_tablet_manager.cc:1434] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 13:14:20.839910  3409 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:20.849763  3411 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:20.850512  3411 ts_tablet_manager.cc:1403] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.019s
I20260709 13:14:20.853577  3411 raft_consensus.cc:359] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.854385  3411 raft_consensus.cc:385] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.854717  3411 raft_consensus.cc:740] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.857009  3409 tablet_bootstrap.cc:654] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.856907  3411 consensus_queue.cc:260] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.859081  3411 ts_tablet_manager.cc:1434] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:14:20.860266  3411 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:20.862003  3037 catalog_manager.cc:5697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.868450  3410 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:20.868654  3414 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:20.869055  3410 ts_tablet_manager.cc:1403] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.480s	user 0.079s	sys 0.050s
I20260709 13:14:20.869073  3414 ts_tablet_manager.cc:1403] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.450s	user 0.011s	sys 0.004s
I20260709 13:14:20.872180  3410 raft_consensus.cc:359] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.872967  3410 raft_consensus.cc:385] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.872598  3414 raft_consensus.cc:359] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.873224  3410 raft_consensus.cc:740] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.873299  3414 raft_consensus.cc:385] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.873705  3414 raft_consensus.cc:740] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.874082  3410 consensus_queue.cc:260] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.874716  3414 consensus_queue.cc:260] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:20.877120  3410 ts_tablet_manager.cc:1434] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:14:20.879024  3410 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:20.879179  3414 ts_tablet_manager.cc:1434] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:14:20.880198  3414 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:20.886019  3680 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.886633  3680 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.887202  3410 tablet_bootstrap.cc:654] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.887806  3414 tablet_bootstrap.cc:654] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.890391  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:20.892870  3328 leader_election.cc:343] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.893962  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:20.896417  3327 leader_election.cc:343] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.897465  3327 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:20.899181  3718 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.899470  3410 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:20.900175  3410 ts_tablet_manager.cc:1403] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:14:20.900655  3680 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:20.903198  3410 raft_consensus.cc:359] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.903986  3410 raft_consensus.cc:385] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.904268  3410 raft_consensus.cc:740] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.904966  3036 catalog_manager.cc:5697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.907725  3414 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:20.908290  3414 ts_tablet_manager.cc:1403] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 13:14:20.910408  3541 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.911001  3541 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.911626  3414 raft_consensus.cc:359] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.912490  3414 raft_consensus.cc:385] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.912787  3414 raft_consensus.cc:740] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.905005  3410 consensus_queue.cc:260] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:20.913589  3414 consensus_queue.cc:260] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.915390  3410 ts_tablet_manager.cc:1434] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:14:20.915457  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:20.915936  3414 ts_tablet_manager.cc:1434] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:20.916540  3410 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:20.916891  3414 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
W20260709 13:14:20.917098  3106 leader_election.cc:343] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.917992  3541 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:20.927199  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:20.929536  3410 tablet_bootstrap.cc:654] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.929379  3725 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:20.932613  3104 leader_election.cc:343] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.933238  3104 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:20.934305  3636 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.934826  3636 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:20.938768  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:20.939617  3409 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:20.939576  3289 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:20.940305  3409 ts_tablet_manager.cc:1403] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.101s	user 0.027s	sys 0.031s
I20260709 13:14:20.912928  3411 tablet_bootstrap.cc:654] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.941290  3106 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:20.942312  3544 raft_consensus.cc:2749] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:20.943068  3544 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:20.943475  3544 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.943889  3544 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:20.943673  3409 raft_consensus.cc:359] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.944594  3409 raft_consensus.cc:385] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:20.944942  3409 raft_consensus.cc:740] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:20.946259  3409 consensus_queue.cc:260] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:20.949038  3409 ts_tablet_manager.cc:1434] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:20.950165  3409 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:20.952404  3414 tablet_bootstrap.cc:654] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:20.937145  3636 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:20.972235  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:20.984702  3104 leader_election.cc:343] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:20.956322  3680 raft_consensus.cc:493] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.993907  3680 raft_consensus.cc:515] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.000494  3409 tablet_bootstrap.cc:654] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.011366  3680 leader_election.cc:290] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:21.030975  3410 tablet_bootstrap.cc:492] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:21.031540  3410 ts_tablet_manager.cc:1403] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.022s
I20260709 13:14:21.034210  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:21.034950  3215 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:21.038601  3546 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.041152  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:21.042795  3327 leader_election.cc:304] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:21.044239  3725 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.055456  3679 raft_consensus.cc:2804] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:21.056113  3732 raft_consensus.cc:493] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.056668  3732 raft_consensus.cc:515] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:21.061431  3329 leader_election.cc:343] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.056066  3679 raft_consensus.cc:493] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.062539  3679 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.069692  3410 raft_consensus.cc:359] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.070550  3410 raft_consensus.cc:385] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.070878  3410 raft_consensus.cc:740] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.071271  3546 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.071563  3410 consensus_queue.cc:260] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.073593  3546 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:21.073939  3410 ts_tablet_manager.cc:1434] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.017s
I20260709 13:14:21.074687  3411 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:21.081866  3411 ts_tablet_manager.cc:1403] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.027s
I20260709 13:14:21.083280  3410 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:21.099701  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:21.101694  3361 raft_consensus.cc:2468] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:21.103235  3411 raft_consensus.cc:359] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.103618  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:21.104048  3411 raft_consensus.cc:385] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.104401  3411 raft_consensus.cc:740] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
W20260709 13:14:21.105051  3106 leader_election.cc:343] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.105258  3544 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:21.107343  3106 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:21.107743  3544 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:21.108373  3544 raft_consensus.cc:2804] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:21.108762  3544 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.112664  3411 consensus_queue.cc:260] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.120059  3411 ts_tablet_manager.cc:1434] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:14:21.112250  3414 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:21.121976  3414 ts_tablet_manager.cc:1403] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.205s	user 0.034s	sys 0.033s
I20260709 13:14:21.111526  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:21.112380  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:21.123991  3288 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.125139  3414 raft_consensus.cc:359] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.137645  3414 raft_consensus.cc:385] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.112154  3732 leader_election.cc:290] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:21.129495  3327 consensus_peers.cc:597] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.132134  3607 consensus_queue.cc:1048] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.139937  3414 raft_consensus.cc:740] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.140379  3679 raft_consensus.cc:515] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.126332  3216 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.135828  3411 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:21.150389  3679 leader_election.cc:290] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:21.150907  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:21.151691  3409 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:21.142853  3607 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.146023  3410 tablet_bootstrap.cc:654] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.126178  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:21.152489  3607 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.153023  3361 raft_consensus.cc:2468] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:21.152369  3290 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.158437  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:21.134439  3104 leader_election.cc:343] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:21.160375  3329 leader_election.cc:343] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.160449  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:21.162950  3255 leader_election.cc:304] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:21.163702  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:21.164515  3215 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.167099  3732 raft_consensus.cc:2804] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:21.167697  3732 raft_consensus.cc:493] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.168107  3732 raft_consensus.cc:3060] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.140792  3414 consensus_queue.cc:260] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:21.171535  3254 leader_election.cc:343] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.172541  3414 ts_tablet_manager.cc:1434] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:14:21.173102  3607 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:21.174049  3414 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:21.113622  3544 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.185636  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:21.152446  3409 ts_tablet_manager.cc:1403] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.009s
I20260709 13:14:21.259802  3411 tablet_bootstrap.cc:654] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.261431  3215 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:21.263886  3414 tablet_bootstrap.cc:654] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.354404  3409 raft_consensus.cc:359] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.355208  3409 raft_consensus.cc:385] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.355491  3409 raft_consensus.cc:740] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.361316  3409 consensus_queue.cc:260] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.353645  3288 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:21.344540  3732 raft_consensus.cc:515] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.525784  3720 consensus_queue.cc:1048] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:21.529032  3732 leader_election.cc:290] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:21.540133  3541 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.582800  3409 ts_tablet_manager.cc:1434] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.396s	user 0.016s	sys 0.030s
I20260709 13:14:21.584439  3409 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:21.557199  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:21.542222  3290 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:21.574506  3541 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.603040  3410 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:21.603596  3410 ts_tablet_manager.cc:1403] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.521s	user 0.047s	sys 0.071s
I20260709 13:14:21.603259  3141 raft_consensus.cc:3060] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.613587  3544 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:21.624662  3764 log.cc:927] Time spent T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 13:14:21.625855  3544 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:21.626797  3762 log.cc:927] Time spent T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:14:21.620354  3725 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:21.637204  3327 leader_election.cc:343] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:21.640071  3327 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:21.636085  3725 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.644685  3680 raft_consensus.cc:2749] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:21.644685  3725 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:21.630746  3607 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.646209  3409 tablet_bootstrap.cc:654] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:21.647509  3410 raft_consensus.cc:359] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.663168  3410 raft_consensus.cc:385] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.663586  3327 leader_election.cc:304] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:21.663652  3410 raft_consensus.cc:740] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.666054  3607 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.681380  3541 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:21.686774  3772 raft_consensus.cc:2804] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:21.687744  3772 raft_consensus.cc:697] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:21.692766  3410 consensus_queue.cc:260] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:21.707644  3414 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:21.708186  3414 ts_tablet_manager.cc:1403] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.534s	user 0.020s	sys 0.020s
I20260709 13:14:21.714874  3411 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:21.715737  3411 ts_tablet_manager.cc:1403] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.580s	user 0.028s	sys 0.038s
I20260709 13:14:21.719208  3410 ts_tablet_manager.cc:1434] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.004s
I20260709 13:14:21.711447  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:21.720027  3363 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.720574  3607 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:21.726774  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:21.688983  3772 consensus_queue.cc:237] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.737649  3414 raft_consensus.cc:359] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.738312  3414 raft_consensus.cc:385] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.738544  3414 raft_consensus.cc:740] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.739348  3414 consensus_queue.cc:260] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.742329  3414 ts_tablet_manager.cc:1434] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:14:21.743736  3414 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:21.743410  3411 raft_consensus.cc:359] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.744678  3411 raft_consensus.cc:385] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:21.822923  3138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:21.833310  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:21.834834  3213 raft_consensus.cc:2468] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
W20260709 13:14:21.840013  3216 consensus_meta.cc:287] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: Time spent flushing consensus metadata: real 0.692s	user 0.015s	sys 0.003s
I20260709 13:14:21.845443  3106 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:21.855917  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:21.859205  3215 raft_consensus.cc:2468] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:21.857837  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63193ea538e42d1913abde82e22fbda" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:21.861285  3360 raft_consensus.cc:3060] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.866837  3214 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.745100  3411 raft_consensus.cc:740] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:21.873907  3440 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.873413  3411 consensus_queue.cc:260] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:21.874886  3440 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:21.876856  3411 ts_tablet_manager.cc:1434] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.161s	user 0.010s	sys 0.000s
I20260709 13:14:21.900321  3766 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:21.915967  3327 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:21.928879  3409 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:21.931588  3410 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:21.934850  3104 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:21.937613  3759 raft_consensus.cc:2804] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:21.938146  3759 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:21.938555  3759 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:21.940963  3767 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:21.941808  3767 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:21.944753  3767 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:21.964010  3363 raft_consensus.cc:2468] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:21.976668  3409 ts_tablet_manager.cc:1403] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.393s	user 0.015s	sys 0.017s
I20260709 13:14:21.901187  3766 raft_consensus.cc:697] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:21.983421  3766 consensus_queue.cc:237] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:21.986027  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:21.988054  3440 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:22.006309  3732 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.008111  3732 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.016036  3141 raft_consensus.cc:2468] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:22.019722  3444 consensus_queue.cc:1048] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:14:22.042192  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 79342.4us
I20260709 13:14:22.028189  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:22.044011  3409 raft_consensus.cc:359] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.045465  3409 raft_consensus.cc:385] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.045943  3409 raft_consensus.cc:740] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:22.046434  3286 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.050750  3732 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:22.051826  3409 consensus_queue.cc:260] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.064124  3409 ts_tablet_manager.cc:1434] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.004s
I20260709 13:14:22.063148  3037 catalog_manager.cc:5697] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.068037  3779 raft_consensus.cc:2804] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:22.068704  3607 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.069365  3607 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.068744  3779 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.071596  3410 tablet_bootstrap.cc:654] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:21.998304  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 82677.5us
I20260709 13:14:22.075942  3409 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:22.071605  3779 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.120683  3360 raft_consensus.cc:2468] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:22.120973  3607 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.121697  3411 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:22.106343  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:22.124442  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 65459.9us
I20260709 13:14:22.135934  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.153776  3212 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:22.139446  3414 tablet_bootstrap.cc:654] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:22.121918  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 144132us
W20260709 13:14:22.111320  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 141371us
I20260709 13:14:22.170898  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.172511  3214 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:22.179352  3180 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:22.180692  3253 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:22.154222  3636 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.181936  3784 raft_consensus.cc:2804] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:22.182698  3784 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.183123  3784 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.191249  3759 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.193288  3137 raft_consensus.cc:2393] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:22.195565  3106 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:22.183152  3710 raft_consensus.cc:2749] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:22.210327  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:22.217321  3106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 43510.3us
I20260709 13:14:22.219856  3544 raft_consensus.cc:2804] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:22.220531  3544 raft_consensus.cc:697] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:22.221743  3544 consensus_queue.cc:237] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:22.246392  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:22.247453  3362 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:22.181845  3636 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.258028  3636 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.264425  3254 leader_election.cc:304] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:22.266973  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:22.268198  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:22.272560  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.275960  3779 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.282104  3363 raft_consensus.cc:2393] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:22.249956  3286 raft_consensus.cc:2468] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
W20260709 13:14:22.293329  3328 leader_election.cc:343] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:22.301714  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 130471us
W20260709 13:14:22.320125  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 82211.8us
I20260709 13:14:22.321805  3327 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:22.320608  3732 raft_consensus.cc:2804] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:22.346568  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 82287.3us
I20260709 13:14:22.362658  3414 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:22.339901  3732 raft_consensus.cc:697] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:22.383308  3409 tablet_bootstrap.cc:654] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:22.390057  3414 ts_tablet_manager.cc:1403] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.647s	user 0.017s	sys 0.010s
I20260709 13:14:22.411221  3732 consensus_queue.cc:237] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:22.412204  3790 log.cc:927] Time spent T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:14:22.416738  3759 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.420840  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:22.385131  3411 tablet_bootstrap.cc:654] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:22.393008  3718 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.332537  3779 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.373181  3796 raft_consensus.cc:2804] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:22.456684  3796 raft_consensus.cc:493] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.458029  3796 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.438586  3718 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.476166  3784 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.481853  3287 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
W20260709 13:14:22.485587  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 163900us
W20260709 13:14:22.526180  3327 leader_election.cc:343] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:22.488799  3784 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:22.526723  3327 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:22.523533  3414 raft_consensus.cc:359] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.529546  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:22.533088  3414 raft_consensus.cc:385] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.534883  3414 raft_consensus.cc:740] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
W20260709 13:14:22.521576  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 226690us
I20260709 13:14:22.541901  3414 consensus_queue.cc:260] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.546943  3410 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:22.547561  3410 ts_tablet_manager.cc:1403] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.617s	user 0.019s	sys 0.024s
I20260709 13:14:22.548429  3800 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:22.536720  3212 raft_consensus.cc:3060] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.579249  3718 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.595158  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.596186  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:22.597231  3211 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.597904  3783 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.598886  3783 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.613838  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:22.616479  3180 leader_election.cc:343] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:22.620409  3211 raft_consensus.cc:2468] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:22.621592  3212 raft_consensus.cc:2468] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:22.633098  3181 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:22.622820  3414 ts_tablet_manager.cc:1434] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.232s	user 0.010s	sys 0.000s
W20260709 13:14:22.647294  3104 leader_election.cc:343] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:22.652488  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 126346us
I20260709 13:14:22.631515  3783 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:22.651975  3104 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:22.649899  3710 raft_consensus.cc:2749] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:22.666653  3774 raft_consensus.cc:2804] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:22.667323  3774 raft_consensus.cc:697] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:22.668459  3774 consensus_queue.cc:237] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.671221  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:22.676855  3769 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:22.698684  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:22.699823  3364 raft_consensus.cc:2468] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:22.701036  3411 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:22.701679  3411 ts_tablet_manager.cc:1403] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.604s	user 0.043s	sys 0.030s
I20260709 13:14:22.701587  3355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:22.702947  3355 raft_consensus.cc:2468] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:22.717295  3775 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.718858  3775 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:22.688128  3769 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:22.718145  3253 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:22.723781  3181 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:22.724288  3769 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:22.718973  3411 raft_consensus.cc:359] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.725172  3769 raft_consensus.cc:2804] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.729985  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.725307  3792 raft_consensus.cc:2804] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:22.762840  3411 raft_consensus.cc:385] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.757681  3410 raft_consensus.cc:359] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:22.765277  3411 raft_consensus.cc:740] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:22.765676  3410 raft_consensus.cc:385] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.765928  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:22.766149  3410 raft_consensus.cc:740] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:22.736152  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:22.767863  3213 raft_consensus.cc:2393] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:22.767434  3410 consensus_queue.cc:260] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:22.753731  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:22.744102  3414 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:22.721253  3775 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:22.764402  3792 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.766491  3411 consensus_queue.cc:260] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.774340  3792 raft_consensus.cc:3060] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:22.726610  3106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 66542.4us
W20260709 13:14:22.778589  3104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 126742us
I20260709 13:14:22.794436  3411 ts_tablet_manager.cc:1434] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.008s
I20260709 13:14:22.796108  3411 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:22.794564  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:22.802214  3636 consensus_queue.cc:1048] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:22.802623  3801 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:14:22.806108  3636 consensus_queue.cc:1048] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:22.809866  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:22.811224  3363 raft_consensus.cc:2393] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:22.815534  3414 tablet_bootstrap.cc:654] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:22.822957  3796 raft_consensus.cc:515] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.823949  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:22.828110  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:14:22.828708  3328 leader_election.cc:343] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:22.812585  3106 leader_election.cc:343] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:22.763768  3769 raft_consensus.cc:697] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:22.834863  3769 consensus_queue.cc:237] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:22.841487  3792 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.849303  3215 raft_consensus.cc:2393] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:22.844255  3796 leader_election.cc:290] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:22.859493  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:22.867069  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:22.907482  3410 ts_tablet_manager.cc:1434] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.359s	user 0.010s	sys 0.008s
I20260709 13:14:22.919392  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:22.920746  3358 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 2: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
W20260709 13:14:22.924940  3104 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:22.928434  3104 leader_election.cc:343] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:22.929852  3409 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:22.930474  3409 ts_tablet_manager.cc:1403] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.865s	user 0.015s	sys 0.033s
I20260709 13:14:22.937738  3792 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:22.939041  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:22.939759  3364 raft_consensus.cc:3060] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.939936  3409 raft_consensus.cc:359] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.944621  3409 raft_consensus.cc:385] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.945065  3409 raft_consensus.cc:740] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:22.945138  3811 log.cc:927] Time spent T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:14:22.945887  3409 consensus_queue.cc:260] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:22.951006  3769 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.951006  3364 raft_consensus.cc:2468] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:22.951864  3769 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:22.952853  3181 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:22.956138  3769 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:22.930474  3410 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:22.970796  3106 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:22.953873  3792 raft_consensus.cc:2804] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:22.974315  3792 raft_consensus.cc:697] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:22.974668  3808 raft_consensus.cc:2804] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:22.975430  3808 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:22.976020  3808 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.924855  3411 tablet_bootstrap.cc:654] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:22.928930  3104 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:22.991729  3760 raft_consensus.cc:2749] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:22.993306  3104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 64921.8us
I20260709 13:14:23.017084  3254 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:23.039485  3037 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58104 (request call id 70) took 1042 ms. Trace:
I20260709 13:14:23.049700  3414 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:23.050346  3414 ts_tablet_manager.cc:1403] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.307s	user 0.024s	sys 0.012s
I20260709 13:14:23.054845  3409 ts_tablet_manager.cc:1434] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.000s
I20260709 13:14:23.040921  3732 raft_consensus.cc:2749] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:23.054159  3327 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:23.061178  3138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:23.065021  3409 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:23.070837  3254 leader_election.cc:343] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.070953  3327 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:22.975548  3792 consensus_queue.cc:237] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:23.090339  3803 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:14:23.096549  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e5cb02e52a438e964626a80223bbf1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:23.074939  3607 raft_consensus.cc:2749] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:23.122438  3410 tablet_bootstrap.cc:654] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.124970  3414 raft_consensus.cc:359] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:23.128825  3414 raft_consensus.cc:385] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.129213  3414 raft_consensus.cc:740] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.097632  3211 raft_consensus.cc:2393] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:23.115020  3767 raft_consensus.cc:2749] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:23.082182  3769 consensus_queue.cc:1048] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 13:14:23.047120  3037 rpcz_store.cc:276] 0709 13:14:21.985777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.986286 (+   509us) service_pool.cc:224] Handling call
0709 13:14:23.028396 (+1042110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:22.188001 (+     0us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe2e6edb1 00007fcbe2f0cc85 00007fcbe2f0d6a2 00007fcbe5c7f1db 00007fcbe5c7aaaf 00007fcbe2fc90ac 00007fcbebe23ab9 00007fcbe2fe569b 00007fcbe2fe393f 00007fcbe2fe3455 00007fcbe9b0816c
0709 13:14:22.520530 (+332529us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:22.528954 (+  8424us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:22.529005 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:14:22.529040 (+    35us) tablet.cc:662] Decoding operations
0709 13:14:22.529571 (+   531us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:22.529687 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:22.529724 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:22.530086 (+   362us) tablet.cc:701] Row locks acquired
0709 13:14:22.530124 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:14:22.530278 (+   154us) write_op.cc:270] Start()
0709 13:14:22.530536 (+   258us) write_op.cc:276] Timestamp: P: 1783602862530218 usec, L: 0
0709 13:14:22.530572 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:14:22.531420 (+   848us) log.cc:844] Serialized 540 byte log entry
0709 13:14:22.820297 (+288877us) op_driver.cc:464] REPLICATION: finished
0709 13:14:22.912507 (+ 92210us) write_op.cc:301] APPLY: starting
0709 13:14:22.912843 (+   336us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:22.913038 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:22.913089 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:22.914542 (+  1453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:22.915273 (+   731us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:22.915381 (+   108us) write_op.cc:312] APPLY: finished
0709 13:14:22.915799 (+   418us) log.cc:844] Serialized 22 byte log entry
0709 13:14:22.916087 (+   288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:22.916227 (+   140us) write_op.cc:454] Released schema lock
0709 13:14:22.964464 (+ 48237us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:23.043503 (+ 79039us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:23.046343 (+  2840us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72088,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":91728,"apply.run_cpu_time_us":4962,"apply.run_wall_time_us":113262,"num_ops":1,"prepare.queue_time_us":262284,"prepare.run_cpu_time_us":46322,"prepare.run_wall_time_us":290377,"raft.queue_time_us":144051,"raft.run_cpu_time_us":15238,"raft.run_wall_time_us":52556,"replication_time_us":289552,"spinlock_wait_cycles":8527104,"thread_start_us":473071,"threads_started":4,"wal-append.queue_time_us":142217}]]}
I20260709 13:14:23.157483  3414 consensus_queue.cc:260] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:23.168578  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 84732.2us
I20260709 13:14:23.158739  3039 catalog_manager.cc:5697] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.179566  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:23.182349  3039 catalog_manager.cc:5697] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.190173  3327 leader_election.cc:304] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:23.194593  3414 ts_tablet_manager.cc:1434] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.000s
I20260709 13:14:23.197717  3607 raft_consensus.cc:2749] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:23.213940  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:23.214344  3821 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.219792  3139 raft_consensus.cc:3060] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.219930  3821 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:23.227056  3414 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:23.229137  3821 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:23.232224  3409 tablet_bootstrap.cc:654] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.244206  3808 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:23.253584  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 108544us
I20260709 13:14:23.257200  3211 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.205085  3766 consensus_queue.cc:1048] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:14:23.262641  3816 log.cc:927] Time spent T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.139s	user 0.003s	sys 0.002s
I20260709 13:14:23.278239  3411 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:23.292445  3411 ts_tablet_manager.cc:1403] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.497s	user 0.031s	sys 0.056s
W20260709 13:14:23.291462  3255 leader_election.cc:343] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.296602  3255 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:23.272428  3209 raft_consensus.cc:1275] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:23.331000  3414 tablet_bootstrap.cc:654] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.313383  3769 raft_consensus.cc:2749] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:23.302392  3732 consensus_queue.cc:1048] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:14:23.345522  3541 consensus_queue.cc:1048] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:14:23.358342  3808 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:23.358440  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:23.360296  3362 raft_consensus.cc:1275] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:23.370898  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:23.372123  3363 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.383028  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:23.380635  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:23.416849  3411 raft_consensus.cc:359] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.417797  3411 raft_consensus.cc:385] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.418144  3411 raft_consensus.cc:740] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.418841  3411 consensus_queue.cc:260] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.421804  3411 ts_tablet_manager.cc:1434] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.002s
I20260709 13:14:23.404865  3821 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.428084  3410 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:23.425696  3444 consensus_queue.cc:1048] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:23.428696  3410 ts_tablet_manager.cc:1403] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.499s	user 0.023s	sys 0.046s
I20260709 13:14:23.428314  3821 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:23.438434  3104 leader_election.cc:343] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.459229  3821 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:23.467823  3409 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:23.468401  3409 ts_tablet_manager.cc:1403] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.404s	user 0.009s	sys 0.045s
I20260709 13:14:23.472002  3139 raft_consensus.cc:2468] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:23.478591  3637 consensus_queue.cc:1048] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:23.507807  3808 consensus_queue.cc:1048] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:23.509807  3363 raft_consensus.cc:2468] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:23.515059  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:23.483217  3410 raft_consensus.cc:359] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:23.491367  3329 leader_election.cc:343] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.520428  3410 raft_consensus.cc:385] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.520902  3410 raft_consensus.cc:740] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.525174  3410 consensus_queue.cc:260] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:23.529714  3327 leader_election.cc:343] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.531905  3411 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
W20260709 13:14:23.551378  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 62328.5us
I20260709 13:14:23.558136  3409 raft_consensus.cc:359] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.560294  3409 raft_consensus.cc:385] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.582032  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:23.583050  3285 raft_consensus.cc:2468] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:23.564457  3409 raft_consensus.cc:740] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.615880  3409 consensus_queue.cc:260] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.632448  3329 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:23.634586  3801 raft_consensus.cc:2804] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.635882  3801 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.636551  3801 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.648262  3410 ts_tablet_manager.cc:1434] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.209s	user 0.009s	sys 0.000s
I20260709 13:14:23.651506  3409 ts_tablet_manager.cc:1434] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.183s	user 0.013s	sys 0.000s
I20260709 13:14:23.651244  3670 consensus_queue.cc:1048] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:23.662581  3411 tablet_bootstrap.cc:654] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.582547  3327 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:14:23.669241  3104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 113760us
W20260709 13:14:23.671844  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 167935us
I20260709 13:14:23.686439  3410 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:23.699911  3106 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:23.701561  3541 raft_consensus.cc:2804] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.702201  3541 raft_consensus.cc:697] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:23.703150  3541 consensus_queue.cc:237] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:23.673370  3607 raft_consensus.cc:2749] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:23.718786  3831 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.719453  3831 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.729746  3821 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.730352  3821 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:23.732620  3821 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:23.733505  3409 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:23.743011  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:23.744130  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:23.744994  3288 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
W20260709 13:14:23.747421  3327 leader_election.cc:343] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:23.749014  3329 leader_election.cc:343] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.753670  3831 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:23.760334  3414 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:23.761158  3414 ts_tablet_manager.cc:1403] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.534s	user 0.015s	sys 0.010s
I20260709 13:14:23.773145  3414 raft_consensus.cc:359] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:23.782858  3414 raft_consensus.cc:385] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.783313  3414 raft_consensus.cc:740] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.778548  3409 tablet_bootstrap.cc:654] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:23.781641  3104 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 53405.8us
I20260709 13:14:23.807107  3106 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:23.809612  3541 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.824244  3541 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.824710  3541 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.832456  3410 tablet_bootstrap.cc:654] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.846580  3414 consensus_queue.cc:260] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:23.809434  3136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:23.897571  3414 ts_tablet_manager.cc:1434] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.133s	user 0.011s	sys 0.000s
W20260709 13:14:23.944152  3842 log.cc:927] Time spent T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:14:23.948416  3801 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:23.954069  3801 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:23.955351  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:23.963066  3288 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:23.964202  3802 log.cc:927] Time spent T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:14:23.970655  3106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 123616us
W20260709 13:14:23.978979  3328 leader_election.cc:343] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.983235  3328 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:23.996070  3414 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:23.992636  3801 raft_consensus.cc:2749] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:24.045012  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 87022.7us
I20260709 13:14:24.058768  3288 raft_consensus.cc:2468] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:24.055723  3541 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.112529  3410 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:24.113340  3410 ts_tablet_manager.cc:1403] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.452s	user 0.018s	sys 0.017s
I20260709 13:14:24.086309  3209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:24.061218  3329 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:24.124711  3541 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:24.127805  3411 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:24.128450  3411 ts_tablet_manager.cc:1403] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.597s	user 0.021s	sys 0.023s
W20260709 13:14:24.135504  3841 log.cc:927] Time spent T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:14:24.129691  3851 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.138878  3409 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:24.155639  3409 ts_tablet_manager.cc:1403] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.460s	user 0.021s	sys 0.059s
W20260709 13:14:24.157755  3327 leader_election.cc:343] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.137305  3410 raft_consensus.cc:359] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.162292  3410 raft_consensus.cc:385] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.162951  3410 raft_consensus.cc:740] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.163723  3410 consensus_queue.cc:260] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.143692  3851 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:24.145277  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 84227.3us
W20260709 13:14:24.144766  3843 log.cc:927] Time spent T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 13:14:24.167034  3851 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:24.169173  3845 log.cc:927] Time spent T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:14:24.143606  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:24.146462  3767 raft_consensus.cc:2804] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.151547  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:24.171713  3767 raft_consensus.cc:697] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:24.172731  3767 consensus_queue.cc:237] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.179569  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:24.221544  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 122736us
I20260709 13:14:24.171156  3286 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:24.290647  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 56019.2us
W20260709 13:14:24.292289  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 62579.8us
W20260709 13:14:24.318009  3860 log.cc:927] Time spent T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:14:24.316874  3409 raft_consensus.cc:359] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.322453  3409 raft_consensus.cc:385] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.321970  3216 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.323202  3409 raft_consensus.cc:740] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:24.323354  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 136155us
I20260709 13:14:24.343529  3414 tablet_bootstrap.cc:654] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.345319  3410 ts_tablet_manager.cc:1434] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.228s	user 0.004s	sys 0.008s
I20260709 13:14:24.331722  3411 raft_consensus.cc:359] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.348949  3411 raft_consensus.cc:385] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.349413  3411 raft_consensus.cc:740] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.355839  3409 consensus_queue.cc:260] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:24.363224  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 128056us
I20260709 13:14:24.366616  3409 ts_tablet_manager.cc:1434] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.210s	user 0.006s	sys 0.002s
I20260709 13:14:24.371104  3410 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:24.373621  3411 consensus_queue.cc:260] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.375475  3765 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.376087  3765 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.376664  3411 ts_tablet_manager.cc:1434] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.248s	user 0.005s	sys 0.001s
I20260709 13:14:24.378350  3765 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:24.406260  3357 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:24.406407  3286 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:24.411669  3411 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:24.413033  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:24.426230  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:24.436328  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:24.439251  3039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58064 (request call id 79) took 1816 ms. Trace:
I20260709 13:14:24.439944  3359 raft_consensus.cc:2393] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate f15b6c3cd4774f618572acbd29feffa2 in this term.
I20260709 13:14:24.440464  3409 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:24.445192  3410 tablet_bootstrap.cc:654] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.446825  3411 tablet_bootstrap.cc:654] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.447310  3861 consensus_queue.cc:1048] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.447302  3037 catalog_manager.cc:5697] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:24.453485  3253 leader_election.cc:343] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.461525  3037 catalog_manager.cc:5697] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 2, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.470736  3760 consensus_queue.cc:1048] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.439992  3039 rpcz_store.cc:276] 0709 13:14:22.622612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.622911 (+   299us) service_pool.cc:224] Handling call
0709 13:14:22.758012 (+135101us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400501ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:14:24.439163 (+1681151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:23.361512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:23.432120 (+ 70608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:23.432157 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:14:23.432176 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:23.432912 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:23.433009 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:23.433039 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:23.433422 (+   383us) tablet.cc:701] Row locks acquired
0709 13:14:23.433443 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:14:23.433610 (+   167us) write_op.cc:270] Start()
0709 13:14:23.433745 (+   135us) write_op.cc:276] Timestamp: P: 1783602863433565 usec, L: 0
0709 13:14:23.433768 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:23.434516 (+   748us) log.cc:844] Serialized 928 byte log entry
0709 13:14:23.761001 (+326485us) op_driver.cc:464] REPLICATION: finished
0709 13:14:23.868373 (+107372us) write_op.cc:301] APPLY: starting
0709 13:14:23.868464 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:23.868593 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:23.868797 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:23.869191 (+   394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:23.869483 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:23.869553 (+    70us) write_op.cc:312] APPLY: finished
0709 13:14:23.870744 (+  1191us) log.cc:844] Serialized 28 byte log entry
0709 13:14:23.888150 (+ 17406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:23.898936 (+ 10786us) write_op.cc:454] Released schema lock
0709 13:14:23.905039 (+  6103us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:23.991666 (+ 86627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:23.994913 (+  3247us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":80805120,"child_traces":[["op",{"apply.queue_time_us":107045,"apply.run_cpu_time_us":2848,"apply.run_wall_time_us":113391,"num_ops":2,"prepare.queue_time_us":124847,"prepare.run_cpu_time_us":4215,"prepare.run_wall_time_us":92354,"replication_time_us":289234,"thread_start_us":187947,"threads_started":2}]]}
I20260709 13:14:24.480525  3106 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:24.481920  3409 tablet_bootstrap.cc:654] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.482618  3774 consensus_queue.cc:1048] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.483057  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:24.483649  3775 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.484287  3775 raft_consensus.cc:697] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:24.485275  3775 consensus_queue.cc:237] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.503763  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:24.504612  3134 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:24.507587  3867 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.508451  3867 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.511349  3356 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.512032  3867 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:24.533632  3180 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:24.540067  3254 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:24.546844  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:24.551395  3327 leader_election.cc:343] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.552770  3776 raft_consensus.cc:2804] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.563961  3776 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.564466  3776 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.591845  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:24.598381  3328 leader_election.cc:343] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.598927  3328 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:24.600847  3803 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.615896  3414 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:24.616755  3414 ts_tablet_manager.cc:1403] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.631s	user 0.012s	sys 0.010s
I20260709 13:14:24.627561  3411 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:24.628580  3411 ts_tablet_manager.cc:1403] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.220s	user 0.013s	sys 0.001s
I20260709 13:14:24.635938  3855 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.645531  3410 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:24.646116  3410 ts_tablet_manager.cc:1403] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.275s	user 0.025s	sys 0.025s
I20260709 13:14:24.650597  3414 raft_consensus.cc:359] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.651423  3414 raft_consensus.cc:385] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.651703  3414 raft_consensus.cc:740] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
W20260709 13:14:24.657184  3327 consensus_peers.cc:597] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:24.657753  3414 consensus_queue.cc:260] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.649287  3410 raft_consensus.cc:359] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.661259  3410 raft_consensus.cc:385] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.661623  3410 raft_consensus.cc:740] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.664569  3414 ts_tablet_manager.cc:1434] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:14:24.661389  3411 raft_consensus.cc:359] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.670364  3411 raft_consensus.cc:385] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.670661  3411 raft_consensus.cc:740] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.674968  3410 consensus_queue.cc:260] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.675889  3411 consensus_queue.cc:260] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.668111  3356 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:24.684789  3410 ts_tablet_manager.cc:1434] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:14:24.685004  3414 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:24.686444  3411 ts_tablet_manager.cc:1434] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:14:24.690891  3411 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:24.702732  3410 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:24.707614  3409 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:24.708290  3409 ts_tablet_manager.cc:1403] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.268s	user 0.021s	sys 0.024s
I20260709 13:14:24.712021  3409 raft_consensus.cc:359] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.712960  3409 raft_consensus.cc:385] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.713243  3409 raft_consensus.cc:740] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.707522  3776 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.714175  3409 consensus_queue.cc:260] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.721089  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:24.721874  3141 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.722719  3409 ts_tablet_manager.cc:1434] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:24.723809  3409 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:24.732218  3141 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:24.733884  3254 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:24.734724  3857 raft_consensus.cc:2804] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.735235  3857 raft_consensus.cc:697] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:24.736119  3857 consensus_queue.cc:237] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.739225  3410 tablet_bootstrap.cc:654] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.740744  3776 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:24.744300  3411 tablet_bootstrap.cc:654] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.748060  3414 tablet_bootstrap.cc:654] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.750020  3035 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58080 (request call id 65) took 2185 ms. Trace:
I20260709 13:14:24.750594  3035 rpcz_store.cc:276] 0709 13:14:22.564899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:22.565087 (+   188us) service_pool.cc:224] Handling call
0709 13:14:22.682672 (+117585us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b5400501ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:14:24.749803 (+2067131us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":214409472}
I20260709 13:14:24.754364  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:24.755158  3212 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.757189  3039 catalog_manager.cc:5697] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.762877  3803 consensus_queue.cc:1048] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.791096  3410 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:24.792109  3410 ts_tablet_manager.cc:1403] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.034s
I20260709 13:14:24.792662  3414 tablet_bootstrap.cc:492] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:24.793453  3414 ts_tablet_manager.cc:1403] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.005s
I20260709 13:14:24.776202  3037 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58092 (request call id 67) took 1313 ms. Trace:
I20260709 13:14:24.779299  3212 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:24.796324  3410 raft_consensus.cc:359] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.797467  3410 raft_consensus.cc:385] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.798460  3410 raft_consensus.cc:740] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.799528  3410 consensus_queue.cc:260] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.794345  3037 rpcz_store.cc:276] 0709 13:14:23.463031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.463222 (+   191us) service_pool.cc:224] Handling call
0709 13:14:24.776135 (+1312913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:24.584701 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:24.585428 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:24.585484 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:14:24.585514 (+    30us) tablet.cc:662] Decoding operations
0709 13:14:24.586084 (+   570us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:24.586215 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:24.586266 (+    51us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:24.586695 (+   429us) tablet.cc:701] Row locks acquired
0709 13:14:24.586719 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:14:24.586885 (+   166us) write_op.cc:270] Start()
0709 13:14:24.587014 (+   129us) write_op.cc:276] Timestamp: P: 1783602864586838 usec, L: 0
0709 13:14:24.587040 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:24.588050 (+  1010us) log.cc:844] Serialized 928 byte log entry
0709 13:14:24.688957 (+100907us) op_driver.cc:464] REPLICATION: finished
0709 13:14:24.731464 (+ 42507us) write_op.cc:301] APPLY: starting
0709 13:14:24.731529 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:24.731663 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:24.731830 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:24.732320 (+   490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:24.732485 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:24.732525 (+    40us) write_op.cc:312] APPLY: finished
0709 13:14:24.732847 (+   322us) log.cc:844] Serialized 28 byte log entry
0709 13:14:24.733024 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:24.733114 (+    90us) write_op.cc:454] Released schema lock
0709 13:14:24.733152 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:24.754746 (+ 21594us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:24.754790 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8409,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":42252,"apply.run_cpu_time_us":2076,"apply.run_wall_time_us":11997,"num_ops":2,"prepare.queue_time_us":102258,"prepare.run_cpu_time_us":3720,"prepare.run_wall_time_us":3720,"replication_time_us":101700,"thread_start_us":66853,"threads_started":2}]]}
I20260709 13:14:24.812279  3410 ts_tablet_manager.cc:1434] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 13:14:24.790032  3409 tablet_bootstrap.cc:654] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.795147  3636 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.818044  3410 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:24.825958  3636 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.828573  3636 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:24.829020  3414 raft_consensus.cc:359] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.829871  3414 raft_consensus.cc:385] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.830559  3414 raft_consensus.cc:740] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.831218  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:24.836463  3106 leader_election.cc:343] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.836755  3803 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.836366  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:24.837428  3803 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.832888  3414 consensus_queue.cc:260] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:24.839260  3104 leader_election.cc:343] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.839273  3411 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:24.840091  3104 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:24.840716  3411 ts_tablet_manager.cc:1403] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.003s
I20260709 13:14:24.840811  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:24.842525  3328 leader_election.cc:343] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.842382  3636 raft_consensus.cc:2749] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.840106  3803 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:24.845198  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:24.847898  3414 ts_tablet_manager.cc:1434] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:14:24.849093  3414 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:24.856370  3414 tablet_bootstrap.cc:654] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.865659  3411 raft_consensus.cc:359] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.868026  3410 tablet_bootstrap.cc:654] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.867825  3414 tablet_bootstrap.cc:492] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:24.869215  3414 ts_tablet_manager.cc:1403] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:14:24.866741  3411 raft_consensus.cc:385] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.870914  3411 raft_consensus.cc:740] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.877885  3414 raft_consensus.cc:359] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.878715  3414 raft_consensus.cc:385] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.878983  3414 raft_consensus.cc:740] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.879660  3414 consensus_queue.cc:260] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.882932  3414 ts_tablet_manager.cc:1434] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:24.884124  3414 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:24.872009  3411 consensus_queue.cc:260] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:24.890551  3327 leader_election.cc:343] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.891101  3327 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:24.893087  3036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58104 (request call id 71) took 1138 ms. Trace:
I20260709 13:14:24.895058  3039 catalog_manager.cc:5697] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.896870  3036 rpcz_store.cc:276] 0709 13:14:23.754468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.754647 (+   179us) service_pool.cc:224] Handling call
0709 13:14:23.885802 (+131155us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400501ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:14:24.892915 (+1007113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44099,"reported_tablets":10,"spinlock_wait_cycles":242009472}
I20260709 13:14:24.902654  3801 raft_consensus.cc:2749] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.903297  3411 ts_tablet_manager.cc:1434] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:14:24.909493  3039 catalog_manager.cc:5697] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.915292  3409 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:24.917589  3409 ts_tablet_manager.cc:1403] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.000s
I20260709 13:14:24.917953  3411 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: Bootstrap starting.
I20260709 13:14:24.921672  3409 raft_consensus.cc:359] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.922523  3409 raft_consensus.cc:385] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.922901  3409 raft_consensus.cc:740] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.924484  3670 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.925127  3670 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.927601  3670 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:24.930608  3411 tablet_bootstrap.cc:654] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.930455  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:24.931763  3358 raft_consensus.cc:2468] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:24.933624  3181 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:24.933852  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:24.934597  3290 raft_consensus.cc:2468] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:24.934610  3670 raft_consensus.cc:2804] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.935880  3670 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.936323  3670 raft_consensus.cc:3060] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.936718  3409 consensus_queue.cc:260] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.937988  3414 tablet_bootstrap.cc:654] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.938627  3410 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:24.939214  3410 ts_tablet_manager.cc:1403] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.007s
I20260709 13:14:24.941923  3409 ts_tablet_manager.cc:1434] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:14:24.943075  3409 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:24.949936  3410 raft_consensus.cc:359] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.950776  3410 raft_consensus.cc:385] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.951061  3410 raft_consensus.cc:740] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.951764  3410 consensus_queue.cc:260] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:24.954025  3410 ts_tablet_manager.cc:1434] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:14:24.955107  3410 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:24.966069  3411 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: No bootstrap required, opened a new log
I20260709 13:14:24.966683  3411 ts_tablet_manager.cc:1403] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:14:24.969959  3414 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:24.970592  3414 ts_tablet_manager.cc:1403] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.003s
I20260709 13:14:24.971462  3782 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.971267  3411 raft_consensus.cc:359] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.972141  3411 raft_consensus.cc:385] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.972047  3782 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:24.972494  3411 raft_consensus.cc:740] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.973272  3411 consensus_queue.cc:260] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.974435  3782 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:24.975090  3411 ts_tablet_manager.cc:1434] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:24.977674  3670 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:24.979058  3037 catalog_manager.cc:5697] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.980095  3670 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:24.982286  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:24.983057  3141 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:24.985936  3409 tablet_bootstrap.cc:654] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.986366  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:24.987571  3414 raft_consensus.cc:359] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.988354  3414 raft_consensus.cc:385] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.989130  3414 raft_consensus.cc:740] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.989991  3414 consensus_queue.cc:260] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:24.990489  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:24.992642  3290 raft_consensus.cc:3060] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.995401  3414 ts_tablet_manager.cc:1434] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 13:14:24.991029  3253 leader_election.cc:343] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.997565  3414 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:24.996932  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:24.998831  3359 raft_consensus.cc:3060] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.997949  3254 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:25.005290  3865 raft_consensus.cc:2804] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.005698  3865 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.006028  3865 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.012428  3414 tablet_bootstrap.cc:654] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.016963  3636 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.017668  3636 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.019232  3774 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.012506  3035 catalog_manager.cc:5697] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } }
I20260709 13:14:25.025921  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.027117  3358 raft_consensus.cc:2468] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 0.
I20260709 13:14:25.025821  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:25.029644  3106 leader_election.cc:343] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.030441  3106 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:25.031386  3774 raft_consensus.cc:2804] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.031824  3774 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.032182  3774 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.033031  3414 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:25.033592  3414 ts_tablet_manager.cc:1403] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:14:25.036798  3414 raft_consensus.cc:359] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.037653  3414 raft_consensus.cc:385] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.037940  3414 raft_consensus.cc:740] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.038756  3414 consensus_queue.cc:260] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.039247  3359 raft_consensus.cc:2468] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:25.040515  3181 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:25.041366  3670 raft_consensus.cc:2804] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.041935  3670 raft_consensus.cc:697] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:25.042762  3670 consensus_queue.cc:237] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.046980  3414 ts_tablet_manager.cc:1434] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:25.048458  3414 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:25.023131  3035 catalog_manager.cc:5697] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.996984  3410 tablet_bootstrap.cc:654] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.058228  3414 tablet_bootstrap.cc:654] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.059728  3290 raft_consensus.cc:2468] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:25.060662  3865 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.068387  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:25.069078  3141 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.080762  3636 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:25.084137  3803 raft_consensus.cc:493] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.084789  3803 raft_consensus.cc:515] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.086970  3803 leader_election.cc:290] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:25.091741  3414 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:25.092404  3414 ts_tablet_manager.cc:1403] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.001s
I20260709 13:14:25.092563  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:25.092872  3774 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:25.094439  3329 leader_election.cc:343] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.095034  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:25.097620  3414 raft_consensus.cc:359] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.110562  3414 raft_consensus.cc:385] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.106973  3141 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:25.110944  3414 raft_consensus.cc:740] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.122854  3414 consensus_queue.cc:260] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.130343  3211 raft_consensus.cc:2468] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 0.
I20260709 13:14:25.133010  3254 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:25.137441  3855 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.138949  3855 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.140664  3863 raft_consensus.cc:2804] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.146631  3414 ts_tablet_manager.cc:1434] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:14:25.154783  3414 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:25.159901  3410 tablet_bootstrap.cc:492] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:25.162317  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:25.163260  3216 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.164139  3765 consensus_queue.cc:1048] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.165623  3792 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.166376  3792 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.153326  3865 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:25.216755  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:25.168835  3792 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:25.217653  3410 ts_tablet_manager.cc:1403] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.263s	user 0.012s	sys 0.002s
W20260709 13:14:25.234298  3180 leader_election.cc:343] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.212474  3855 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:25.237285  3409 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:25.237887  3409 ts_tablet_manager.cc:1403] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.295s	user 0.028s	sys 0.016s
I20260709 13:14:25.238348  3774 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:25.187762  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:25.240890  3409 raft_consensus.cc:359] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.250010  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.253168  3410 raft_consensus.cc:359] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.255821  3409 raft_consensus.cc:385] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.256024  3410 raft_consensus.cc:385] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.256037  3363 raft_consensus.cc:2468] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:25.256578  3410 raft_consensus.cc:740] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.257738  3181 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:25.257575  3410 consensus_queue.cc:260] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.258541  3670 raft_consensus.cc:2804] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.258956  3670 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.259641  3410 ts_tablet_manager.cc:1434] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:14:25.191052  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.286446  3670 raft_consensus.cc:3060] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.265259  3327 leader_election.cc:304] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:25.273950  3414 tablet_bootstrap.cc:654] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:25.273008  3106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 47103.3us
I20260709 13:14:25.256269  3409 raft_consensus.cc:740] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.283308  3782 raft_consensus.cc:493] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.291684  3181 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:25.264958  3765 raft_consensus.cc:493] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.288662  3216 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:25.287613  3037 catalog_manager.cc:5697] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.295994  3803 raft_consensus.cc:2804] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.296614  3803 raft_consensus.cc:493] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.296331  3409 consensus_queue.cc:260] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.297070  3803 raft_consensus.cc:3060] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.298977  3765 raft_consensus.cc:515] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.302006  3782 raft_consensus.cc:515] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.298202  3409 ts_tablet_manager.cc:1434] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:14:25.305224  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.305510  3782 leader_election.cc:290] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:25.306013  3356 raft_consensus.cc:2468] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:25.306528  3409 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:25.308120  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:25.308893  3357 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.309113  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.309700  3255 leader_election.cc:304] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:25.311957  3776 raft_consensus.cc:2804] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.312384  3776 raft_consensus.cc:493] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.312747  3776 raft_consensus.cc:3060] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.314906  3765 leader_election.cc:290] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:25.187256  3808 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.129s
I20260709 13:14:25.320051  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:25.319285  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:25.321849  3106 leader_election.cc:343] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:25.326313  3254 leader_election.cc:343] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.337931  3410 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:25.326644  3792 raft_consensus.cc:2749] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:25.355441  3216 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.350191  3863 raft_consensus.cc:697] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:25.367489  3863 consensus_queue.cc:237] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.378023  3774 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.401038  3409 tablet_bootstrap.cc:654] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.373374  3357 raft_consensus.cc:2468] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:25.413340  3106 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:25.418815  3766 raft_consensus.cc:2804] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.419471  3766 raft_consensus.cc:697] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:25.405977  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:25.420425  3766 consensus_queue.cc:237] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.421056  3211 raft_consensus.cc:2468] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:25.423640  3414 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:25.424247  3414 ts_tablet_manager.cc:1403] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.270s	user 0.023s	sys 0.007s
I20260709 13:14:25.406749  3774 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.420830  3670 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.455199  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:25.455410  3776 raft_consensus.cc:515] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.456245  3363 raft_consensus.cc:3060] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.472329  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:25.473371  3357 raft_consensus.cc:3060] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.475435  3414 raft_consensus.cc:359] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:25.474406  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 54039.1us
I20260709 13:14:25.476342  3414 raft_consensus.cc:385] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.476722  3414 raft_consensus.cc:740] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.478816  3414 consensus_queue.cc:260] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.484396  3253 leader_election.cc:304] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:25.491794  3414 ts_tablet_manager.cc:1434] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:14:25.493153  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:25.494769  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:25.495572  3134 raft_consensus.cc:3060] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.477977  3857 consensus_queue.cc:1048] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:14:25.505697  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:25.480444  3670 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:25.508759  3254 leader_election.cc:343] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:25.514231  3414 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: Bootstrap starting.
I20260709 13:14:25.490958  3774 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:25.504643  3857 raft_consensus.cc:2804] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:25.503135  3776 leader_election.cc:290] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:25.540731  3410 tablet_bootstrap.cc:654] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.521871  3857 raft_consensus.cc:493] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.543176  3861 consensus_queue.cc:1048] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:25.530771  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:25.544023  3363 raft_consensus.cc:2468] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:25.548969  3857 raft_consensus.cc:3060] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.607005  3181 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:25.601688  3211 raft_consensus.cc:2393] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:25.615521  3357 raft_consensus.cc:2468] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:25.620959  3414 tablet_bootstrap.cc:654] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:25.626420  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 75862.2us
I20260709 13:14:25.569933  3803 raft_consensus.cc:515] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.639804  3410 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:25.640650  3410 ts_tablet_manager.cc:1403] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.303s	user 0.030s	sys 0.014s
I20260709 13:14:25.633581  3670 raft_consensus.cc:2804] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.669584  3670 raft_consensus.cc:697] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:25.670678  3356 raft_consensus.cc:2393] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:25.672461  3803 leader_election.cc:290] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:25.675570  3410 raft_consensus.cc:359] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.683295  3410 raft_consensus.cc:385] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.683912  3410 raft_consensus.cc:740] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.680112  3409 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:25.685961  3409 ts_tablet_manager.cc:1403] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.380s	user 0.024s	sys 0.044s
I20260709 13:14:25.678484  3670 consensus_queue.cc:237] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:25.685005  3410 consensus_queue.cc:260] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.696300  3134 raft_consensus.cc:2468] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
W20260709 13:14:25.702375  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 95442.4us
W20260709 13:14:25.736179  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:25.737185  3410 ts_tablet_manager.cc:1434] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 13:14:25.737680  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:25.742565  3255 leader_election.cc:304] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:25.743134  3106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 115806us
I20260709 13:14:25.754739  3409 raft_consensus.cc:359] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.755613  3409 raft_consensus.cc:385] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.755992  3409 raft_consensus.cc:740] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.760452  3409 consensus_queue.cc:260] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.753923  3214 raft_consensus.cc:3060] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.782863  3414 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: No bootstrap required, opened a new log
I20260709 13:14:25.783468  3414 ts_tablet_manager.cc:1403] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: Time spent bootstrapping tablet: real 0.275s	user 0.019s	sys 0.004s
I20260709 13:14:25.752562  3865 raft_consensus.cc:2804] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.789572  3104 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:25.786401  3414 raft_consensus.cc:359] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.794538  3414 raft_consensus.cc:385] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.795688  3414 raft_consensus.cc:740] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.796401  3414 consensus_queue.cc:260] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:25.802757  3214 raft_consensus.cc:2468] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:25.812220  3857 raft_consensus.cc:515] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.814813  3409 ts_tablet_manager.cc:1434] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.000s
I20260709 13:14:25.816480  3327 leader_election.cc:304] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:25.817063  3865 raft_consensus.cc:697] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:25.819056  3808 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:25.819970  3409 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:25.818151  3865 consensus_queue.cc:237] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:25.824393  3855 consensus_queue.cc:1048] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:25.825696  3867 raft_consensus.cc:2804] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.826314  3867 raft_consensus.cc:697] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:25.827205  3867 consensus_queue.cc:237] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:25.827811  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:25.828464  3857 leader_election.cc:290] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:25.828758  3208 raft_consensus.cc:2393] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:25.834532  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:25.833456  3035 catalog_manager.cc:5697] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.839159  3255 leader_election.cc:304] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:25.847506  3414 ts_tablet_manager.cc:1434] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:14:25.843408  3857 raft_consensus.cc:2749] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:14:25.936635  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 59093.3us
I20260709 13:14:25.842314  3863 consensus_queue.cc:1048] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:14:25.916936  3906 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.943563  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:25.942855  3855 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.971606  3857 consensus_queue.cc:1048] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:14:26.041796  3285 raft_consensus.cc:2393] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7210a87d254adba064447cda99b137 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:25.982995  3906 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:26.015057  3766 raft_consensus.cc:493] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.998113  3855 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:26.118088  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 139526us
W20260709 13:14:26.132382  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 189377us
I20260709 13:14:26.109495  3766 raft_consensus.cc:515] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:26.171139  3766 leader_election.cc:290] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:26.184715  3036 catalog_manager.cc:5697] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.198577  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:26.203086  3855 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:26.206171  3906 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:26.210491  3409 tablet_bootstrap.cc:654] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.254117  3410 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Bootstrap starting.
I20260709 13:14:26.216130  3792 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:26.332767  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 119343us
I20260709 13:14:26.337553  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:26.261977  3792 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:26.383836  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:26.388154  3792 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:26.394022  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:26.394922  3357 raft_consensus.cc:2393] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:26.394965  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:26.395781  3212 raft_consensus.cc:2468] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
W20260709 13:14:26.395486  3106 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.384872  3362 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:26.405467  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:26.406374  3288 raft_consensus.cc:2468] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:26.407786  3409 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: No bootstrap required, opened a new log
I20260709 13:14:26.408793  3409 ts_tablet_manager.cc:1403] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.589s	user 0.022s	sys 0.013s
I20260709 13:14:26.411566  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:26.412629  3139 raft_consensus.cc:2468] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 0.
I20260709 13:14:26.438050  3253 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:26.459674  3141 raft_consensus.cc:3060] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.456100  3181 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:26.465060  3180 leader_election.cc:343] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.475777  3792 consensus_queue.cc:1048] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:26.478323  3939 raft_consensus.cc:2804] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.478901  3939 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.479230  3939 raft_consensus.cc:3060] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.450621  3919 raft_consensus.cc:2804] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.485500  3919 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.485972  3919 raft_consensus.cc:3060] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.490279  3106 leader_election.cc:304] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:26.496343  3410 tablet_bootstrap.cc:654] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.498864  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:26.499605  3137 raft_consensus.cc:2468] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 0.
I20260709 13:14:26.507182  3181 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:26.518196  3409 raft_consensus.cc:359] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:26.520480  3409 raft_consensus.cc:385] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.520805  3409 raft_consensus.cc:740] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.517041  3938 raft_consensus.cc:2749] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:26.521814  3945 consensus_queue.cc:1048] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:26.521505  3409 consensus_queue.cc:260] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:26.546319  3409 ts_tablet_manager.cc:1434] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.137s	user 0.006s	sys 0.003s
I20260709 13:14:26.575258  3039 catalog_manager.cc:5697] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.587005  3924 consensus_queue.cc:1048] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:26.544350  3907 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:26.593459  3802 log.cc:927] Time spent T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:14:26.593968  3907 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.605082  3945 consensus_queue.cc:1048] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:26.594156  3902 consensus_queue.cc:1048] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:14:26.617059  3907 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.631861  3919 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:26.643741  3037 catalog_manager.cc:5697] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 1 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.695574  3410 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: No bootstrap required, opened a new log
I20260709 13:14:26.696462  3410 ts_tablet_manager.cc:1403] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent bootstrapping tablet: real 0.531s	user 0.015s	sys 0.030s
I20260709 13:14:26.717940  3410 raft_consensus.cc:359] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:26.718566  3410 raft_consensus.cc:385] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.718768  3410 raft_consensus.cc:740] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.719260  3410 consensus_queue.cc:260] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:26.692595  3803 consensus_queue.cc:1048] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:14:26.731053  3137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:26.732059  3137 raft_consensus.cc:3060] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.733176  3410 ts_tablet_manager.cc:1434] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:14:26.704990  3939 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:26.766812  3919 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:26.800812  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:26.805434  3216 raft_consensus.cc:2393] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 1: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
W20260709 13:14:26.819634  3087 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:26.820186  3907 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:26.829941  3137 raft_consensus.cc:2468] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:26.835780  3907 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:26.839941  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:26.840767  3356 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.896440  3254 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:26.911334  3865 raft_consensus.cc:2804] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.911921  3865 raft_consensus.cc:697] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:26.912796  3865 consensus_queue.cc:237] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:26.917771  3939 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:26.900383  3808 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.944092  3808 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:26.949746  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:26.959527  3808 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:26.962132  3140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:26.963220  3140 raft_consensus.cc:2393] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 1: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:26.971529  3356 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:26.983275  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:26.984583  3139 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.006526  3181 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:27.008001  3181 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:27.008713  3902 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:27.011809  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:27.021363  3288 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.029845  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:27.030786  3356 raft_consensus.cc:2393] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 1: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:27.030838  3792 raft_consensus.cc:2749] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:27.031729  3902 raft_consensus.cc:697] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:27.032646  3902 consensus_queue.cc:237] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:27.043570  3139 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:27.053927  3035 catalog_manager.cc:5697] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.071110  3941 consensus_queue.cc:1048] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.089015  3106 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:27.097432  3924 raft_consensus.cc:2749] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:27.098897  3919 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:27.100371  3919 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:27.105858  3919 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:27.106509  3139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:27.109088  3039 catalog_manager.cc:5697] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.125555  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:27.128871  3255 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:27.130785  3970 raft_consensus.cc:2749] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:27.148387  3035 catalog_manager.cc:5697] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.445333  3970 consensus_queue.cc:1048] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.464563  3970 consensus_queue.cc:1048] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.537941  3902 consensus_queue.cc:1048] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.552155  3975 consensus_queue.cc:1048] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:28.826756 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
W20260709 13:14:28.841763  3180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:28.850008  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:28.851080  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.884287 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:28.885604 28922 tablet_replica.cc:333] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.886803 28922 raft_consensus.cc:2243] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.887461 28922 raft_consensus.cc:2272] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.890033 28922 tablet_replica.cc:333] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
W20260709 13:14:28.890507  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.890887 28922 raft_consensus.cc:2243] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.891489 28922 raft_consensus.cc:2272] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.893654 28922 tablet_replica.cc:333] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.894343 28922 raft_consensus.cc:2243] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.894826 28922 raft_consensus.cc:2272] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.897257 28922 tablet_replica.cc:333] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.898695 28922 raft_consensus.cc:2243] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.899502 28922 raft_consensus.cc:2272] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.902302 28922 tablet_replica.cc:333] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.903266 28922 raft_consensus.cc:2243] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.904219 28922 raft_consensus.cc:2272] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.907014 28922 tablet_replica.cc:333] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.908041 28922 raft_consensus.cc:2243] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.909355 28922 raft_consensus.cc:2272] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.912415 28922 tablet_replica.cc:333] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.913216 28922 raft_consensus.cc:2243] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.914258 28922 raft_consensus.cc:2272] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.917518 28922 tablet_replica.cc:333] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.918483 28922 raft_consensus.cc:2243] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.919437 28922 raft_consensus.cc:2272] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.922077 28922 tablet_replica.cc:333] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.923034 28922 raft_consensus.cc:2243] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.923615 28922 raft_consensus.cc:2272] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.926496 28922 tablet_replica.cc:333] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.927352 28922 raft_consensus.cc:2243] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.928404 28922 raft_consensus.cc:2272] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.931046 28922 tablet_replica.cc:333] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.932124 28922 raft_consensus.cc:2243] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:28.933106  3328 consensus_peers.cc:597] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.933113 28922 raft_consensus.cc:2272] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.937007 28922 tablet_replica.cc:333] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.938356 28922 raft_consensus.cc:2243] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.938994 28922 raft_consensus.cc:2272] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.941926 28922 tablet_replica.cc:333] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.942797 28922 raft_consensus.cc:2243] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.943331 28922 raft_consensus.cc:2272] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.945961 28922 tablet_replica.cc:333] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.948336 28922 raft_consensus.cc:2243] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.948945 28922 raft_consensus.cc:2272] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.952036 28922 tablet_replica.cc:333] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.953094 28922 raft_consensus.cc:2243] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.953749 28922 raft_consensus.cc:2272] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.958964 28922 tablet_replica.cc:333] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.959834 28922 raft_consensus.cc:2243] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.960434 28922 raft_consensus.cc:2272] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:28.960601  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.963311 28922 tablet_replica.cc:333] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.964274 28922 raft_consensus.cc:2243] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.964892 28922 raft_consensus.cc:2272] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.967900 28922 tablet_replica.cc:333] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.968897 28922 raft_consensus.cc:2243] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.969955 28922 raft_consensus.cc:2272] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:28.972292  3328 consensus_peers.cc:597] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.972532 28922 tablet_replica.cc:333] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
W20260709 13:14:28.974488  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.974697 28922 raft_consensus.cc:2243] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.975801 28922 raft_consensus.cc:2272] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.981093 28922 tablet_replica.cc:333] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.982539 28922 raft_consensus.cc:2243] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.983145 28922 raft_consensus.cc:2272] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.986013 28922 tablet_replica.cc:333] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.986853 28922 raft_consensus.cc:2243] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.987990 28922 raft_consensus.cc:2272] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:28.990306  3180 consensus_peers.cc:597] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:28.992223 28922 tablet_replica.cc:333] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.993727 28922 raft_consensus.cc:2243] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.994303 28922 raft_consensus.cc:2272] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.998049 28922 tablet_replica.cc:333] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:28.999625 28922 raft_consensus.cc:2243] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.001039 28922 raft_consensus.cc:2272] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.014658 28922 tablet_replica.cc:333] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
W20260709 13:14:29.014245  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.015908 28922 raft_consensus.cc:2243] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:29.015952  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.016610 28922 raft_consensus.cc:2272] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:29.018702  3254 consensus_peers.cc:597] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.024585 28922 tablet_replica.cc:333] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.025557 28922 raft_consensus.cc:2243] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.026162 28922 raft_consensus.cc:2272] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:29.027619  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.027562  3254 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.029989 28922 tablet_replica.cc:333] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.030855 28922 raft_consensus.cc:2243] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.031425 28922 raft_consensus.cc:2272] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.034072 28922 tablet_replica.cc:333] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.034785 28922 raft_consensus.cc:2243] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.035334 28922 raft_consensus.cc:2272] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.037858 28922 tablet_replica.cc:333] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.038429 28922 raft_consensus.cc:2243] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.038966 28922 raft_consensus.cc:2272] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.041285 28922 tablet_replica.cc:333] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.041879 28922 raft_consensus.cc:2243] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.042668 28922 raft_consensus.cc:2272] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.044914 28922 tablet_replica.cc:333] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.045558 28922 raft_consensus.cc:2243] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.046029 28922 raft_consensus.cc:2272] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.048511 28922 tablet_replica.cc:333] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.049080 28922 raft_consensus.cc:2243] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.049566 28922 raft_consensus.cc:2272] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.051812 28922 tablet_replica.cc:333] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.052448 28922 raft_consensus.cc:2243] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.053275 28922 raft_consensus.cc:2272] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.056176 28922 tablet_replica.cc:333] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.057085 28922 raft_consensus.cc:2243] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.057741 28922 raft_consensus.cc:2272] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.060218 28922 tablet_replica.cc:333] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.060961 28922 raft_consensus.cc:2243] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.061470 28922 raft_consensus.cc:2272] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.063676 28922 tablet_replica.cc:333] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.064428 28922 raft_consensus.cc:2243] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.064864 28922 raft_consensus.cc:2272] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.067287 28922 tablet_replica.cc:333] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.068010 28922 raft_consensus.cc:2243] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.068940 28922 raft_consensus.cc:2272] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.071578 28922 tablet_replica.cc:333] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.072217 28922 raft_consensus.cc:2243] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.072798 28922 raft_consensus.cc:2272] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.074947 28922 tablet_replica.cc:333] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.075513 28922 raft_consensus.cc:2243] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.075980 28922 raft_consensus.cc:2272] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.078902 28922 tablet_replica.cc:333] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.079542 28922 raft_consensus.cc:2243] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.080382 28922 raft_consensus.cc:2272] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.082881 28922 tablet_replica.cc:333] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.083384 28922 raft_consensus.cc:2243] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.083779 28922 raft_consensus.cc:2272] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.085871 28922 tablet_replica.cc:333] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.086345 28922 raft_consensus.cc:2243] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.087520 28922 raft_consensus.cc:2272] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.089764 28922 tablet_replica.cc:333] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.090293 28922 raft_consensus.cc:2243] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.091056 28922 raft_consensus.cc:2272] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.093502 28922 tablet_replica.cc:333] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.094187 28922 raft_consensus.cc:2243] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.094765 28922 raft_consensus.cc:2272] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.097378 28922 tablet_replica.cc:333] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.098256 28922 raft_consensus.cc:2243] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:29.098778 28922 raft_consensus.cc:2272] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.100696 28922 tablet_replica.cc:333] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: stopping tablet replica
I20260709 13:14:29.101120 28922 raft_consensus.cc:2243] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.101956 28922 raft_consensus.cc:2272] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:29.107651  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.119314  3180 consensus_peers.cc:597] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.123180  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.145346  3254 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.150707  3180 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.179162 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:14:29.180413  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.184924  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.189325  3180 consensus_peers.cc:597] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.198647  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.213806  3180 consensus_peers.cc:597] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.231210  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.231832  3328 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.249765  3180 consensus_peers.cc:597] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.275964 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:29.278479  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:29.289551  3996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.291914  3995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.297082  3998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:29.297981 28922 server_base.cc:1061] running on GCE node
I20260709 13:14:29.301779 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:29.302018 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:29.302290 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602869302259 us; error 0 us; skew 500 ppm
I20260709 13:14:29.303073 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:29.306414 28922 webserver.cc:533] Webserver started at http://127.28.62.129:35937/ using document root <none> and password file <none>
I20260709 13:14:29.306955 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:29.307138 28922 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:29.312259 28922 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:29.328881  4004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:29.330195 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:14:29.330662 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "f15b6c3cd4774f618572acbd29feffa2"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-50cs"
I20260709 13:14:29.331339 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:14:29.338534  3254 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.346870 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:29.349334 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:29.352654 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:14:29.355506  3254 consensus_peers.cc:597] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:29.361146  4011 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:14:29.698288 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:14:29.698704 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.340s	user 0.008s	sys 0.003s
I20260709 13:14:29.699087 28922 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:14:29.707974  4011 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.726848  4011 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.727944  4011 tablet_bootstrap.cc:492] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.728704  4011 ts_tablet_manager.cc:1403] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:14:29.731217  4011 raft_consensus.cc:359] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.731942  4011 raft_consensus.cc:740] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.732681  4011 consensus_queue.cc:260] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.749603  4011 ts_tablet_manager.cc:1434] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.008s
I20260709 13:14:29.750435  4011 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.767190  4011 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.768116  4011 tablet_bootstrap.cc:492] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.768734  4011 ts_tablet_manager.cc:1403] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:14:29.771579  4011 raft_consensus.cc:359] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.772392  4011 raft_consensus.cc:740] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.773046  4011 consensus_queue.cc:260] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.774873  4011 ts_tablet_manager.cc:1434] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:29.775655  4011 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.795971  4011 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.796972  4011 tablet_bootstrap.cc:492] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.797654  4011 ts_tablet_manager.cc:1403] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 13:14:29.800017  4011 raft_consensus.cc:359] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.800688  4011 raft_consensus.cc:740] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.801344  4011 consensus_queue.cc:260] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.803169  4011 ts_tablet_manager.cc:1434] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:29.803931  4011 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.820034  4011 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.821002  4011 tablet_bootstrap.cc:492] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.821681  4011 ts_tablet_manager.cc:1403] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:14:29.824172  4011 raft_consensus.cc:359] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.824891  4011 raft_consensus.cc:740] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.825729  4011 consensus_queue.cc:260] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.827932  4011 ts_tablet_manager.cc:1434] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:29.828761  4011 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.844750  4011 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.845788  4011 tablet_bootstrap.cc:492] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.846448  4011 ts_tablet_manager.cc:1403] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:14:29.848675  4011 raft_consensus.cc:359] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.849367  4011 raft_consensus.cc:740] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.850214  4011 consensus_queue.cc:260] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.852021  4011 ts_tablet_manager.cc:1434] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:14:29.852761  4011 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.865481  4011 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.866251  4011 tablet_bootstrap.cc:492] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.866815  4011 ts_tablet_manager.cc:1403] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:14:29.868849  4011 raft_consensus.cc:359] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.869638  4011 raft_consensus.cc:740] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.870419  4011 consensus_queue.cc:260] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.872602  4011 ts_tablet_manager.cc:1434] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:29.873545  4011 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.915788  4011 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.916888  4011 tablet_bootstrap.cc:492] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.917840  4011 ts_tablet_manager.cc:1403] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.019s
I20260709 13:14:29.918682  3951 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:29.919237  3951 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.921520  4011 raft_consensus.cc:359] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.922528  4011 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.923381  4011 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:29.926632  4011 ts_tablet_manager.cc:1434] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:29.927847  4011 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.928771  3951 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:29.930328  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:29.935335  3180 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:29.935808  3180 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:29.936882  3975 raft_consensus.cc:2749] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.946177  4011 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.947180  4011 tablet_bootstrap.cc:492] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.947808  4011 ts_tablet_manager.cc:1403] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:14:29.950814  4014 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:29.950753  4011 raft_consensus.cc:359] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.951565  4011 raft_consensus.cc:740] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.951455  4014 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.952504  4011 consensus_queue.cc:260] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:29.954285  4014 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:29.954644  4011 ts_tablet_manager.cc:1434] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:29.955495  4011 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.955919  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:29.959671  3254 leader_election.cc:336] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:29.960201  3254 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:29.960904  4014 raft_consensus.cc:2749] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:29.970907  4011 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:29.972321  4011 tablet_bootstrap.cc:492] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:29.972962  4011 ts_tablet_manager.cc:1403] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:14:29.976054  4011 raft_consensus.cc:359] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.977017  4011 raft_consensus.cc:740] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.977846  4011 consensus_queue.cc:260] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:29.980726  4011 ts_tablet_manager.cc:1434] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:29.981918  4011 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:29.990178 28922 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:14:29.990711 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.292s	user 0.271s	sys 0.012s
I20260709 13:14:30.006335  4011 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:30.007616  4011 tablet_bootstrap.cc:492] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:30.008387  4011 ts_tablet_manager.cc:1403] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:14:30.023132  4011 raft_consensus.cc:359] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.023928  4011 raft_consensus.cc:740] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.024730  4011 consensus_queue.cc:260] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.032094  4012 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.032817  4011 ts_tablet_manager.cc:1434] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:14:30.033901  4011 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:30.032786  4012 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.046012  3941 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.046897  3941 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:30.051496  3328 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.053067  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.057854  3975 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.058326  4003 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.058492  3975 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.058895  4003 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.061014  3975 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:30.061985  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.064030  4012 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.064574  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.066327  3327 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.067509  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.051326  3941 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.069559  4012 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.081686  3975 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.082571  3975 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.083957  4003 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.094609  4012 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.086872  3975 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.095772  4012 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.105257  4011 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:30.106594  4011 tablet_bootstrap.cc:492] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:30.107293  4011 ts_tablet_manager.cc:1403] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.015s
W20260709 13:14:30.112574  3180 leader_election.cc:336] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.120618  3180 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.121837  3975 raft_consensus.cc:2749] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.120435  4011 raft_consensus.cc:359] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.123018  4011 raft_consensus.cc:740] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.123863  4012 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.125842  4011 consensus_queue.cc:260] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:30.123129  3180 leader_election.cc:336] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.131234  4011 ts_tablet_manager.cc:1434] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:14:30.132598  4011 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:30.134330  3328 leader_election.cc:336] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.134953  3328 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.137682  3941 raft_consensus.cc:2749] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.138407  3941 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.138865  3941 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.140936  3941 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.131368  3180 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.141973  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:30.143244  3180 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.145125  3975 raft_consensus.cc:2749] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.147495  4012 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.148783  4012 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.153949  4012 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:30.154664  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 82853.2us
I20260709 13:14:30.158125  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.158561  3951 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.158941  3216 raft_consensus.cc:2468] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.159281  3951 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.160228  4014 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.160904  4014 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.161245  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.161883  3951 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:30.162115  3357 raft_consensus.cc:2468] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:30.164399  4014 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.164876  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.165812  3357 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.169844  3255 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.170364  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.171064  3216 raft_consensus.cc:2468] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.172381  4014 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.172802  4014 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.172984  3941 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.173213  4014 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.174365  3180 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.171870  3327 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.174955  4013 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.175372  3927 raft_consensus.cc:2804] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.175802  3927 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.175487  4013 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.176209  3927 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.173629  3941 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.180712  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.181387  3327 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.181494  3290 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:30.190243  3181 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.199018  3975 raft_consensus.cc:2804] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.199645  3975 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.200187  3975 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.201982  3941 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.202355  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.202610  3941 raft_consensus.cc:2804] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.202987  3941 raft_consensus.cc:493] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.203374  3941 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.207662  3328 leader_election.cc:336] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.208631  3328 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.209007  3328 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.188376  4036 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.209914  3970 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.185281  4033 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:30.211830  3254 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.200311  4013 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.203016  3216 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.231685  3253 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.233922  4036 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.235249  3971 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.235728  3971 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.236130  3971 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.238051  3970 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.241668  4033 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.245059  4033 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:30.246275  4031 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.249848  4031 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.250352  4012 raft_consensus.cc:2749] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.253060  4031 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.247511  3970 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.248973  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.225560  4011 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:30.254761  4013 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.259203  3216 raft_consensus.cc:2468] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.259488  4013 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.260645  3253 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.261543  3970 raft_consensus.cc:2804] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.261955  3970 raft_consensus.cc:493] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.262323  3970 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.263746  4013 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.246961  4036 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:30.258082  3254 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.255618  3180 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.266417  4011 tablet_bootstrap.cc:492] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:30.267478  4011 ts_tablet_manager.cc:1403] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.004s
W20260709 13:14:30.269949  3254 leader_election.cc:336] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.264827  3927 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.282269  3181 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.284403  3927 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.268144  4014 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.286543  4033 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.287052  4033 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.287456  4033 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.289722  3254 leader_election.cc:336] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.275399  3328 leader_election.cc:336] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.299141  3328 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.281544  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 100238us
I20260709 13:14:30.289237  4014 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.302248  4014 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.302825  4014 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:30.278337  3180 leader_election.cc:336] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.306466  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.307227  3216 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.308538  3253 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.275149  3941 raft_consensus.cc:515] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.311053  3941 leader_election.cc:290] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.299165  3927 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.311950  3927 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.313355  4013 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.313887  4013 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.314265  3927 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.314779  4014 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.314293  4013 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.325033  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.329260  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.330785  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc82eb45cde416fa64698383ea73ce1" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.292920  4011 raft_consensus.cc:359] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.331476  3211 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.337999  4011 raft_consensus.cc:740] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:30.340799  3254 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.332706  4014 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.345811  4014 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.347884  3927 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.348191  4014 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.348605  3927 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.325152  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
W20260709 13:14:30.349105  3328 leader_election.cc:336] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.349671  3216 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.333156  3971 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.331982  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.350364  3358 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.350803  3927 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.352140  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.352527  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.332190  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.353827  3213 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.355537  3253 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.356355  3970 raft_consensus.cc:515] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.358438  4014 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.358958  4014 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.359373  4014 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.360132  3358 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.361096  3216 raft_consensus.cc:2468] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.364463  3181 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.341794  4011 consensus_queue.cc:260] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.334362  3975 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.365340  3951 raft_consensus.cc:2749] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.367513  3975 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.345112  3211 raft_consensus.cc:2468] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.368487  4014 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.370399  3327 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.373036  4037 raft_consensus.cc:2804] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.374405  4037 raft_consensus.cc:697] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.375348  4037 consensus_queue.cc:237] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.377772  4011 ts_tablet_manager.cc:1434] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:14:30.379189  4011 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:30.380520  3327 leader_election.cc:304] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.382035  3971 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.390322  4039 raft_consensus.cc:2804] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.390877  4039 raft_consensus.cc:697] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.391781  4039 consensus_queue.cc:237] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.392683  4033 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.383466  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa5d68f72ea43e8973ceedb1ddfcb4c" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.393684  3213 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.394999  3970 leader_election.cc:290] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.383466  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.397233  3211 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 2: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
W20260709 13:14:30.384723  3180 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.387032  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.387796  3927 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:30.405237  3328 leader_election.cc:336] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.408502  3328 leader_election.cc:336] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.409358  3328 leader_election.cc:336] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.410123  3328 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.414659  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:30.414489  4013 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.416985  3286 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:30.409955  3927 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.420887  3927 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.404174  4033 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:30.423763  3328 leader_election.cc:336] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.410871  3358 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.426438  3290 raft_consensus.cc:2393] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:30.408334  4037 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.429549  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.431878  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.432294  3181 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.436007  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.436658  3211 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.433765  4013 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.425215  3036 catalog_manager.cc:5697] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.434389  3213 raft_consensus.cc:2468] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.417873  4039 raft_consensus.cc:2749] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.443882  3211 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.446964  4014 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.450207  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.450841  3216 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.450815  3253 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.436071  3285 raft_consensus.cc:2468] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.459355  3253 leader_election.cc:304] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.449712  3975 raft_consensus.cc:2749] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.440979  4037 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.466032  4037 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.467686  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.468689  3216 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.470165  3253 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.471407  3213 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.471624  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.473441  3327 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.474251  4042 raft_consensus.cc:2804] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.474843  4042 raft_consensus.cc:697] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.476965  3941 raft_consensus.cc:2804] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.477456  3941 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.477841  3941 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.479208  3975 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.481176  3975 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.475694  4042 consensus_queue.cc:237] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.484447  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.485160  3361 raft_consensus.cc:2468] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:30.486570  3181 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
W20260709 13:14:30.487984  3328 leader_election.cc:336] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.488795  4033 raft_consensus.cc:2804] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.489218  4033 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.489625  4033 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.490146  3971 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.490701  3971 raft_consensus.cc:697] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.491572  3971 consensus_queue.cc:237] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.493095  3358 raft_consensus.cc:2468] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:30.494081  4043 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.499873  3181 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.499583  4043 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.488332  4013 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.501878  3951 raft_consensus.cc:2804] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.509757  4043 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.511584  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:30.512355  3285 raft_consensus.cc:2468] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.513633  4013 raft_consensus.cc:697] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.514652  4013 consensus_queue.cc:237] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:30.522341  3941 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.524487  3951 raft_consensus.cc:697] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:30.524773  3941 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:30.525590  3951 consensus_queue.cc:237] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.526474  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.527316  3213 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.527907  4031 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.528455  4031 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:30.530215  3328 leader_election.cc:336] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.531599  4031 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.533465  3975 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.536432  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:30.539597  3328 leader_election.cc:336] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.580736  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 172671us
I20260709 13:14:30.582481  3255 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.583976  4050 raft_consensus.cc:2749] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.584167  3255 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.585510  4050 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.586072  4050 raft_consensus.cc:697] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.587001  4050 consensus_queue.cc:237] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.594120  3329 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.598512  3329 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.602291  4039 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.602897  4039 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.597916  3927 raft_consensus.cc:2749] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.605250  3329 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.608489  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:30.609555  3211 raft_consensus.cc:2468] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 1.
I20260709 13:14:30.612126  3327 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.614378  3213 raft_consensus.cc:2468] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.617942  4037 raft_consensus.cc:2804] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.618907  4037 raft_consensus.cc:493] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.619414  4037 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.605362  4039 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.628211  4038 raft_consensus.cc:2804] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.628978  4038 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.629521  4038 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.616164  4036 raft_consensus.cc:2749] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.640615  3328 leader_election.cc:336] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.641714  4033 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:30.647321  3180 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.647933  3180 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.648633  3951 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.650430  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 58570.6us
W20260709 13:14:30.652874  3254 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.655328  3327 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.663659  3927 raft_consensus.cc:2804] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.665252  3927 raft_consensus.cc:697] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.666445  3927 consensus_queue.cc:237] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:30.671988  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 66821.3us
I20260709 13:14:30.674042  4033 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.673944  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d533b92378e42ffb969e732f2b89ea5" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.674675  3361 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.675571  4038 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.682580  3361 raft_consensus.cc:2468] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:30.680701  3035 catalog_manager.cc:5697] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.686911  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.693043  3361 raft_consensus.cc:2468] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
W20260709 13:14:30.688409  3180 leader_election.cc:336] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.688547  3971 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.690168  3970 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.698421  3970 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.703421  4011 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:30.685117  3329 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.694522  3971 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.704967  4011 tablet_bootstrap.cc:492] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:30.705878  4011 ts_tablet_manager.cc:1403] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.327s	user 0.025s	sys 0.004s
I20260709 13:14:30.707827  4056 raft_consensus.cc:2804] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.708333  4056 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.708689  4056 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.710356  3970 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.693946  3180 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.726176  3181 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:30.722124  4011 raft_consensus.cc:359] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.729092  4011 raft_consensus.cc:740] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.734117  4011 consensus_queue.cc:260] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:30.735394  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 46995.4us
I20260709 13:14:30.717294  3039 catalog_manager.cc:5697] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.743933  4011 ts_tablet_manager.cc:1434] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:14:30.745455  4011 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:30.746254  3254 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.742003  3255 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.721635  3971 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:30.750203  3254 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.739514  4033 raft_consensus.cc:2804] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.739271  3951 raft_consensus.cc:2749] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:30.753875  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.754647  3356 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.760134  4033 raft_consensus.cc:697] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:30.761078  4033 consensus_queue.cc:237] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:30.752399  3254 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.761369  4038 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.763922  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:30.766613  3357 raft_consensus.cc:2468] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:30.767279  4037 raft_consensus.cc:515] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.769500  4037 leader_election.cc:290] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.771267  4043 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:30.772432  3254 leader_election.cc:336] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.773137  3254 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.773973  3328 leader_election.cc:336] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.774485  3254 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.775199  3254 leader_election.cc:336] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.776391  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94672ea4db5244b9ac8b5046a0149fec" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:30.776999  3211 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.778139  3255 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.751924  3970 raft_consensus.cc:2804] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.783965  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
W20260709 13:14:30.800738  3254 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.778630  4056 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.801369  3290 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.803258  3328 leader_election.cc:336] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.782160  3216 raft_consensus.cc:1275] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:30.804435  3970 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.807471  3970 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.810359  3180 leader_election.cc:336] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.810961  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:30.811662  3285 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.812976  3180 leader_election.cc:336] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:30.813665  3254 leader_election.cc:336] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.814585  4043 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.815058  4043 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.815450  4043 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.818318  3255 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.819280  4042 raft_consensus.cc:2804] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:30.819761  4042 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:30.820151  4042 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.820421  4038 consensus_queue.cc:1048] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:30.829555  3970 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.831766  3970 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.832868  3290 raft_consensus.cc:2468] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.834539  3211 raft_consensus.cc:2468] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.836578  3327 leader_election.cc:304] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.840139  3329 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:30.841437  4037 raft_consensus.cc:2804] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.842252  4037 raft_consensus.cc:697] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.842963  4036 raft_consensus.cc:2804] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.843878  4036 raft_consensus.cc:697] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.847878  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.848592  3356 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.844918  4036 consensus_queue.cc:237] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.848116  4037 consensus_queue.cc:237] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.854943  4043 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.851984  3285 raft_consensus.cc:2468] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:30.857878  4042 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.865146  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.865178  3329 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:30.866101  3357 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.863332  4042 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.871300  3356 raft_consensus.cc:2468] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.869251  4012 raft_consensus.cc:2804] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.877333  4012 raft_consensus.cc:697] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:30.878286  4012 consensus_queue.cc:237] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.858121  4056 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:30.880806  3255 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:30.887660  3254 leader_election.cc:336] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.888602  3357 raft_consensus.cc:2468] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
W20260709 13:14:30.890429  3328 leader_election.cc:336] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.891705  3970 raft_consensus.cc:2804] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.892416  3970 raft_consensus.cc:697] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
W20260709 13:14:30.896054  3328 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:30.899582  3970 consensus_queue.cc:237] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.901289  3211 raft_consensus.cc:1275] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:30.893642  3255 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:30.903693  3254 leader_election.cc:336] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:30.909580  4041 raft_consensus.cc:2804] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.904484  4036 consensus_queue.cc:1048] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:14:30.914219  4041 raft_consensus.cc:697] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.921978  4041 consensus_queue.cc:237] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:30.924561  3254 consensus_peers.cc:597] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:30.929421  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:30.930136  3357 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.936559  3357 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:30.938520  3255 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:30.942723  4062 log.cc:927] Time spent T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:14:30.945845  4013 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.946447  4013 raft_consensus.cc:697] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:30.962029  4013 consensus_queue.cc:237] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:30.977574  4043 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:31.003963  3213 raft_consensus.cc:1275] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.007686  4014 consensus_queue.cc:1048] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:31.013866  3328 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:31.016327  3254 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:31.022140  3211 raft_consensus.cc:1275] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.028185  3211 raft_consensus.cc:1275] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.029002  4014 consensus_queue.cc:1048] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.031242  4014 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:31.116597  3216 raft_consensus.cc:1275] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.121640  4017 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.123018  4017 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:31.125880  3357 raft_consensus.cc:1275] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.131489  3357 raft_consensus.cc:1275] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.136260  3970 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:31.142102  3254 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:31.142860  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.126899  4037 consensus_queue.cc:1048] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:14:31.212069  4017 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:31.212252  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.212711  4017 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.213227  4017 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.215369  3036 catalog_manager.cc:5697] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.222328  3036 catalog_manager.cc:5697] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:31.232443  3180 consensus_peers.cc:597] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.234493  3036 catalog_manager.cc:5697] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.241490  3036 catalog_manager.cc:5697] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:31.243213  3254 consensus_peers.cc:597] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.246773  3036 catalog_manager.cc:5697] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 2 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.238173  4082 consensus_queue.cc:1048] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 13:14:31.300268  4090 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.300885  4090 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.303119  4090 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:31.304847  4011 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:14:31.308338  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.292223  4017 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:31.342675  3180 consensus_peers.cc:597] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.346123  4011 tablet_bootstrap.cc:492] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:31.346975  4011 ts_tablet_manager.cc:1403] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.602s	user 0.025s	sys 0.012s
I20260709 13:14:31.352589  4011 raft_consensus.cc:359] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.354141  4011 raft_consensus.cc:740] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.354861  4011 consensus_queue.cc:260] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.340830  3039 catalog_manager.cc:5697] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.359119  4011 ts_tablet_manager.cc:1434] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:31.360136  4011 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:31.363044  4017 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.363785  4017 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:31.367064  4017 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:31.362003  3039 catalog_manager.cc:5697] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:31.381668  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 66239.9us
I20260709 13:14:31.388317  3039 catalog_manager.cc:5697] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.392208  3039 catalog_manager.cc:5697] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.396816  3039 catalog_manager.cc:5697] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:31.397742  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.398770  3039 catalog_manager.cc:5697] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.408406  4017 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.409294  4017 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:31.412348  4017 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:31.431239  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 46314.4us
I20260709 13:14:31.439561  4017 raft_consensus.cc:493] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.440271  3358 raft_consensus.cc:1275] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.440188  4017 raft_consensus.cc:515] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:31.442556  4017 leader_election.cc:290] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:31.458225  3213 raft_consensus.cc:1275] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:31.464466  3180 consensus_peers.cc:597] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.474431  4050 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:31.477932  3254 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.501982  3356 raft_consensus.cc:1275] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.505985  3358 raft_consensus.cc:1275] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.490667  4012 consensus_queue.cc:1048] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:14:31.507120  3328 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.508457  3035 catalog_manager.cc:5697] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 2, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:31.511569  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.561266  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:31.562493  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:31.527565  4017 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:31.573611  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 143115us
I20260709 13:14:31.577414  4104 consensus_queue.cc:1048] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:14:31.578155  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:31.594980  3288 raft_consensus.cc:1275] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:31.601441  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.586277  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:31.606150  3286 raft_consensus.cc:2393] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:31.570475  4017 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.568945  4090 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.609136  4090 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:31.623044  4090 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:31.626577  3290 raft_consensus.cc:1275] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.570510  4050 consensus_queue.cc:1048] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:14:31.660686  4090 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.687110  4118 raft_consensus.cc:493] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.733999  3359 raft_consensus.cc:1275] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.737062  4017 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:31.737910  4017 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.738482  4017 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:31.739871  4111 log.cc:927] Time spent T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:31.695679  4012 consensus_queue.cc:1048] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:14:31.689316  4090 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:31.741247  4017 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:31.742861  4037 consensus_queue.cc:1048] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:14:31.788973  4119 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:31.798422  4114 log.cc:927] Time spent T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:31.798159  4119 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:31.806409  3328 consensus_peers.cc:597] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:31.846896  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 152668us
I20260709 13:14:31.849586  4011 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:31.853256  4011 tablet_bootstrap.cc:492] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
W20260709 13:14:31.853956  3328 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:31.854581  3328 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:31.855010  3328 consensus_peers.cc:597] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:31.855487  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:31.807367  4119 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:31.856004  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 174688us
I20260709 13:14:31.854038  4011 ts_tablet_manager.cc:1403] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.494s	user 0.028s	sys 0.003s
W20260709 13:14:31.855893  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:31.857565  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:31.745152  4118 raft_consensus.cc:515] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:31.903035  4011 raft_consensus.cc:359] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:31.904732  4011 raft_consensus.cc:740] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.905925  4011 consensus_queue.cc:260] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:32.017032  4011 ts_tablet_manager.cc:1434] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.160s	user 0.003s	sys 0.004s
I20260709 13:14:32.120771  4090 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:32.155382  4118 leader_election.cc:290] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:32.158008  4127 log.cc:927] Time spent T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 13:14:32.213004  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:32.214071  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:32.250111  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:32.252036  3290 raft_consensus.cc:2393] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate 0d7210a87d254adba064447cda99b137 in this term.
I20260709 13:14:32.253494  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:32.254868  3288 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
W20260709 13:14:32.297672  3180 consensus_peers.cc:597] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.309049  3180 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.309760  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.310729  3180 consensus_peers.cc:597] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.312812  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 441405us
I20260709 13:14:32.318059  4084 consensus_queue.cc:1048] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:14:32.325073  3180 consensus_peers.cc:597] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.326683  3180 consensus_peers.cc:597] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:32.326746  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 462243us
I20260709 13:14:32.343843  4011 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:32.440307  4088 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:32.450435  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.441224  4088 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:32.509102  4088 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:32.511189  4103 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.512081  4103 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:32.521454  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.525490  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.533663  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.538712  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.541932  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.544968  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:32.548833  4118 raft_consensus.cc:493] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.549860  4118 raft_consensus.cc:515] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:32.554556  4118 leader_election.cc:290] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:32.559208  4103 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:32.567466  3941 raft_consensus.cc:493] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:32.568849  3941 raft_consensus.cc:515] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:32.577519  3941 leader_election.cc:290] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:33.019709  4050 raft_consensus.cc:493] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.021257  4050 raft_consensus.cc:515] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.025195  4050 leader_election.cc:290] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.027480  4050 raft_consensus.cc:493] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.028606  4050 raft_consensus.cc:515] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.047039  4050 leader_election.cc:290] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:33.047657  4050 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.048360  4050 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.054342  4050 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.056504  4050 raft_consensus.cc:493] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.057214  4050 raft_consensus.cc:515] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.061051  4050 leader_election.cc:290] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:33.149542 28922 thread.cc:641] rpc worker (service pool kudu.tserver.TabletServerAdminService) Time spent creating pthread: real 0.843s	user 0.015s	sys 0.004s
W20260709 13:14:33.149971 28922 thread.cc:608] rpc worker (service pool kudu.tserver.TabletServerAdminService) Time spent starting thread: real 0.846s	user 0.015s	sys 0.004s
I20260709 13:14:33.165786  4011 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.169862  4011 tablet_bootstrap.cc:492] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:33.170888  4011 ts_tablet_manager.cc:1403] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.837s	user 0.027s	sys 0.010s
I20260709 13:14:33.174520  4011 raft_consensus.cc:359] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.175406  4011 raft_consensus.cc:740] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.176307  4011 consensus_queue.cc:260] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.187841  4118 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.188966  4118 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.192443  4118 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.192720  4003 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.193841  4003 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.228648  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:33.229854  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 620176us
I20260709 13:14:33.230041  3213 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:33.233347  3253 leader_election.cc:304] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:33.238277  4041 raft_consensus.cc:2804] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.239043  4041 raft_consensus.cc:493] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.239698  4041 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.251542  4147 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.251571  4036 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.253829  4036 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.197183  4003 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:33.256661  4036 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:33.253230  4105 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.253839  4147 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.276643  4147 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:33.279897  4118 raft_consensus.cc:493] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.281019  4118 raft_consensus.cc:515] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.283476  4105 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.291204  4105 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.292824  4003 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.293897  4003 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.297035  4003 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.285034  4118 leader_election.cc:290] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.304314  4128 raft_consensus.cc:493] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.305258  4128 raft_consensus.cc:515] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:33.307476  4144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.045s	sys 0.065s
W20260709 13:14:33.307931  4144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.045s	sys 0.065s
I20260709 13:14:33.308676  4128 leader_election.cc:290] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:33.311412  3290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.016s	sys 0.031s
W20260709 13:14:33.311894  3290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.016s	sys 0.031s
W20260709 13:14:33.317853  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:33.318823  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:33.319975  4011 ts_tablet_manager.cc:1434] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.149s	user 0.039s	sys 0.033s
I20260709 13:14:33.321453  4011 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:33.322083  4041 raft_consensus.cc:515] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.324404  4041 leader_election.cc:290] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:33.325330  3328 leader_election.cc:336] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.330730  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.335016  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:33.335804  3211 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:33.340818  3328 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.346825  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.349916  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.356590  3211 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:33.359266  3253 leader_election.cc:304] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:33.360711  4108 raft_consensus.cc:2804] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.361502  4108 raft_consensus.cc:697] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:33.363258  4108 consensus_queue.cc:237] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.374949  4144 raft_consensus.cc:493] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.375972  4144 raft_consensus.cc:515] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.376626  4011 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.378288  4011 tablet_bootstrap.cc:492] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:33.379254  4011 ts_tablet_manager.cc:1403] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.007s
I20260709 13:14:33.385435  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.388051  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.391551  3213 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:33.393046  4144 leader_election.cc:290] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.402578  4011 raft_consensus.cc:359] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.403534  4011 raft_consensus.cc:740] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.404371  4011 consensus_queue.cc:260] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.405561  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.407096  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.407785  3213 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:33.407949  4011 ts_tablet_manager.cc:1434] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:14:33.409360  4011 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:33.412364  4013 raft_consensus.cc:493] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
W20260709 13:14:33.417882  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 72579.9us
W20260709 13:14:33.413014  4097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.017s	sys 0.027s
I20260709 13:14:33.439706  3211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:33.439707  4097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.018s	sys 0.030s
I20260709 13:14:33.417338  4005 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.446312  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b9bc7bb2494d188055fd77fbdd0c93" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.446543  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.441161  4084 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:33.449231  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.450135  4084 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.451439  4118 raft_consensus.cc:2749] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.452716  4084 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.453613  4110 raft_consensus.cc:493] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.418377  4036 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.454417  4110 raft_consensus.cc:515] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.455458  4036 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.418500  4105 raft_consensus.cc:493] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:33.458098  4105 raft_consensus.cc:515] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.458974  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:33.460458  4105 leader_election.cc:290] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:33.413551  4103 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.462880  4103 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:33.464910  3328 leader_election.cc:336] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.468688  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.473057  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f56cff7d5e42d1828255add82ab240" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.471987  4110 leader_election.cc:290] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:33.448851  4005 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.475797  4097 raft_consensus.cc:493] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.476506  4005 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.477047  4118 raft_consensus.cc:2749] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.476670  4097 raft_consensus.cc:515] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.477644  4103 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.477860  4075 raft_consensus.cc:493] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.478583  4075 raft_consensus.cc:515] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.479655  4097 leader_election.cc:290] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:33.480302  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac2abd7128a46079164d4d9c65c09af" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.483687  4041 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.484555  4041 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.485656  3327 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:33.486191  4036 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.487142  4041 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.488466  4118 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.489568  4005 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:33.491364  3210 raft_consensus.cc:1240] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Rejecting Update request from peer 0d7210a87d254adba064447cda99b137 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.493906  4176 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.494459  4176 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.494832  4176 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.498071  4005 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.413798  4121 raft_consensus.cc:493] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.499173  4121 raft_consensus.cc:515] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.413115  4013 raft_consensus.cc:515] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.503855  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.506181  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.506961  3216 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
W20260709 13:14:33.509649  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 57528.6us
I20260709 13:14:33.514415  4118 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.516052  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.481173  4075 leader_election.cc:290] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:33.520484  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.502750  4013 leader_election.cc:290] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.531839  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.541010  3288 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:33.536697  4118 raft_consensus.cc:2749] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.536968  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.540238  3253 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:33.521087  4176 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:33.557752  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 59921.1us
I20260709 13:14:33.557891  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.558744  3941 consensus_queue.cc:1059] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:33.559052  3358 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:33.546351  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302a732ff54a4673bd480a2aa501cfa1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.551735  4075 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:33.561740  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 57777.5us
I20260709 13:14:33.570078  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.577447  3286 raft_consensus.cc:2468] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:33.567149  4075 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.591149  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.591702  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.575121  4121 leader_election.cc:290] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.592711  4056 raft_consensus.cc:493] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:33.582068  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.594576  4176 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.594739  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbc30fbceeb4d5089322bab45cb7e92" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.598402  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:33.599445  3214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.609138  3208 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.600338  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.601318  3363 raft_consensus.cc:2468] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 1.
I20260709 13:14:33.601356  3255 leader_election.cc:304] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.615382  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.587167  4075 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:33.617925  4007 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.006s	sys 0.000s
I20260709 13:14:33.618973  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9436ea12f5e14810aef6c3bb3c5e4f3a" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.621347  4121 raft_consensus.cc:2749] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.622371  4147 raft_consensus.cc:3055] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.630486  3181 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:33.636758  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec41f0b588b54cef878b9f2521faccf2" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.620931  4056 raft_consensus.cc:515] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:33.656390  3181 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
W20260709 13:14:33.639277  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 43709.1us
I20260709 13:14:33.647608  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d9a2a7adeb4cec89a15b5825dd2b84" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:33.660759  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:33.661008  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbc57c19cbf45639b5504d44069ba50" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:33.661373  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:33.650732  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.662137  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.662864  3364 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:33.637599  4105 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:33.663434  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.651891  4003 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:33.664191  4003 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.664609  4003 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:33.664803  4084 raft_consensus.cc:2804] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.647101  4147 raft_consensus.cc:740] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:33.665277  4084 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.665843  4084 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.666450  4147 consensus_queue.cc:260] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.667877  4147 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:33.649052  4007 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.008s	sys 0.000s
I20260709 13:14:33.656422  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.670303  3035 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58080 (request call id 87) took 2667 ms. Trace:
I20260709 13:14:33.671924  4082 raft_consensus.cc:493] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:33.654160  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.655331  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e914af73c7464c8a474702750e862f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.654644  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.672735  4082 raft_consensus.cc:515] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.658248  4056 leader_election.cc:290] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:33.670037  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 710549us
W20260709 13:14:33.681751  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 87378.5us
I20260709 13:14:33.687573  3255 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
W20260709 13:14:33.690989  3327 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.694069  4082 leader_election.cc:290] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.706283  3327 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:33.709522  3255 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.696364  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.723878  4121 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.719439  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d121904185e8450abb721293cc7b640f" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.670827  3035 rpcz_store.cc:276] 0709 13:14:31.002803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.002980 (+   177us) service_pool.cc:224] Handling call
0709 13:14:31.098746 (+ 95766us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5400501ed4. stack: 00007fcbe2fb4343 00007fcbe2fb4240 00007fcbe29431d4 00007fcbec681304 00007fcbec681299 00007fcbe603d090 00007fcbe60dbf3a 00007fcbebe921cc 00007fcbebf9037e 00007fcbea4512a4 00007fcbea451232 00007fcbea451161 00007fcbea4510dc 00007fcbea450392 00007fcbe440e48c 00007fcbe440d8c6
0709 13:14:33.670031 (+2571285us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:31.555297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:31.570134 (+ 14837us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:31.570170 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:14:31.576085 (+  5915us) tablet.cc:662] Decoding operations
0709 13:14:31.576589 (+   504us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:31.576648 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:31.576682 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:31.576900 (+   218us) tablet.cc:701] Row locks acquired
0709 13:14:31.576918 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:31.577057 (+   139us) write_op.cc:270] Start()
0709 13:14:31.577178 (+   121us) write_op.cc:276] Timestamp: P: 1783602871577019 usec, L: 0
0709 13:14:31.577203 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:31.577869 (+   666us) log.cc:844] Serialized 540 byte log entry
0709 13:14:31.717586 (+139717us) op_driver.cc:464] REPLICATION: finished
0709 13:14:31.733454 (+ 15868us) write_op.cc:301] APPLY: starting
0709 13:14:31.733556 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:31.733672 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:31.733778 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:31.733980 (+   202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:31.734153 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:31.734199 (+    46us) write_op.cc:312] APPLY: finished
0709 13:14:31.734391 (+   192us) log.cc:844] Serialized 22 byte log entry
0709 13:14:31.734560 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:31.734687 (+   127us) write_op.cc:454] Released schema lock
0709 13:14:31.734729 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:31.735110 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:31.735150 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":712907,"reported_tablets":3,"spinlock_wait_cycles":25693440,"child_traces":[["op",{"apply.queue_time_us":10474,"apply.run_cpu_time_us":1673,"apply.run_wall_time_us":1672,"num_ops":1,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":2888,"prepare.run_wall_time_us":47646,"replication_time_us":134442}]]}
I20260709 13:14:33.696288  4007 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.721143  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.723397  3290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.729022  3255 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.732244  3364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1ead8560d7474aa8151592a32d2504" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.734959  4013 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.742233  4013 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.742731  4013 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:33.748406  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 52238.6us
I20260709 13:14:33.750344  4176 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:33.751145  4176 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.751664  4176 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.708899  4136 raft_consensus.cc:2749] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.754289  4012 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.756259  4041 raft_consensus.cc:2749] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.756225  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c4d51b5f734584ad6775456f893f3f" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.758209  3362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:33.767640  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.765105  4084 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.772261  4084 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.772615  3208 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:33.735940  4121 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.773768  3215 raft_consensus.cc:1240] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Rejecting Update request from peer 0d7210a87d254adba064447cda99b137 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.774717  3039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58092 (request call id 89) took 2207 ms. Trace:
I20260709 13:14:33.775138  3039 rpcz_store.cc:276] 0709 13:14:31.585635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.630280 (+ 44645us) service_pool.cc:224] Handling call
0709 13:14:33.774519 (+2144239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":640513,"reported_tablets":2}
I20260709 13:14:33.775712  4121 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.756050  4007 leader_election.cc:304] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.778497  4191 raft_consensus.cc:2749] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.786888  3036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58104 (request call id 93) took 2157 ms. Trace:
I20260709 13:14:33.787405  3036 rpcz_store.cc:276] 0709 13:14:31.659403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.669608 (+ 10205us) service_pool.cc:224] Handling call
0709 13:14:33.786683 (+2117075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328271,"reported_tablets":4}
I20260709 13:14:33.789597  4007 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:14:33.790236  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 81034.6us
I20260709 13:14:33.791747  4191 raft_consensus.cc:3060] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:33.794344  3328 leader_election.cc:336] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.795893  3215 raft_consensus.cc:1240] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Rejecting Update request from peer 0d7210a87d254adba064447cda99b137 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.798455  4011 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.799611  4011 tablet_bootstrap.cc:492] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:33.800454  4011 ts_tablet_manager.cc:1403] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.391s	user 0.008s	sys 0.018s
I20260709 13:14:33.691820  4003 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.812469  3355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:33.820575  4120 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.821379  4120 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.825537  3941 consensus_queue.cc:1059] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.826783  3941 raft_consensus.cc:3055] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.827159  3941 raft_consensus.cc:740] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:33.828241  3941 consensus_queue.cc:260] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.833053  4196 consensus_queue.cc:1059] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:33.833998  3941 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.834919  4196 raft_consensus.cc:3055] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.835572  4196 raft_consensus.cc:740] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:33.824962  4120 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.847510  3286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c04ed8911404c8d0a9c6aecbf3f71" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:33.848240  3286 raft_consensus.cc:3060] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.811372  4007 leader_election.cc:304] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.850482  4118 raft_consensus.cc:2749] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:33.851962  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 53329.2us
I20260709 13:14:33.852926  4003 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:33.858042  4176 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.837337  4196 consensus_queue.cc:260] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.855269  4007 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.863494  4118 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.863597  4196 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:33.867627  3180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111) [suppressed 278 similar messages]
I20260709 13:14:33.877480  4103 raft_consensus.cc:493] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:33.878517  4103 raft_consensus.cc:515] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.884429  4103 leader_election.cc:290] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
W20260709 13:14:33.895105  3180 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.895849  3180 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:33.903447  3180 leader_election.cc:336] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.903976  3180 leader_election.cc:304] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:33.906634  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.911129  4128 raft_consensus.cc:2749] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.912410  4176 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.911255  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:33.913698  4005 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:33.865188  4007 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.921319  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:33.925922  4011 raft_consensus.cc:359] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.843406  4075 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:33.930364  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.931679  4147 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:33.937011  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e1a9ca444a4778b0939095c9d3b4b9" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:33.937816  3180 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:33.939088  4011 raft_consensus.cc:740] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.941058  4128 raft_consensus.cc:2749] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:33.944825  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.944896  3356 raft_consensus.cc:1275] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.938701  4176 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.948144  4118 raft_consensus.cc:3060] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.947490  4147 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:33.941074  4191 raft_consensus.cc:2749] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.951234  4147 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:33.951900  4011 consensus_queue.cc:260] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:33.953871  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 88802.9us
I20260709 13:14:33.954841  4007 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.955637  3181 leader_election.cc:304] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.956367  4007 leader_election.cc:304] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:33.956656  4082 raft_consensus.cc:2749] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.955754  4191 raft_consensus.cc:2749] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.958680  4191 raft_consensus.cc:2749] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:33.959052  4011 ts_tablet_manager.cc:1434] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.152s	user 0.006s	sys 0.001s
I20260709 13:14:33.958824  3181 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:33.960184  4011 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:33.960775  4084 raft_consensus.cc:2749] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:33.963424  3070 debug-util.cc:398] Leaking SignalData structure 0x7b080005d020 after lost signal to thread 28925
W20260709 13:14:33.963917  3180 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:33.964697  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08002420c0 after lost signal to thread 3073
W20260709 13:14:33.966401  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08001f20e0 after lost signal to thread 3240
I20260709 13:14:33.966905  4075 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:33.967785  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca5e0 after lost signal to thread 3314
I20260709 13:14:33.968952  4118 raft_consensus.cc:2749] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:33.968139  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca980 after lost signal to thread 3315
I20260709 13:14:33.972486  3208 raft_consensus.cc:1275] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.973104  3286 raft_consensus.cc:2468] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:33.973706  3283 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 3: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:33.917078  4013 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:33.979827  3288 raft_consensus.cc:1240] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Rejecting Update request from peer 445754f29ffe4648a57f8124ddf8be20 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:33.975404  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:33.975983  4075 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.978333  3255 leader_election.cc:304] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
W20260709 13:14:33.974265  3070 debug-util.cc:398] Leaking SignalData structure 0x7b080029eea0 after lost signal to thread 3388
I20260709 13:14:33.982890  3215 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 3: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:33.983924  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:33.986579  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acc30d61f594798856e57196b3f0490" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:33.992563  4013 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:33.984481  4103 raft_consensus.cc:2749] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.005288  3181 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:34.006438  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:34.006934  3285 raft_consensus.cc:1240] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Rejecting Update request from peer 0d7210a87d254adba064447cda99b137 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:34.015036  3216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:34.015436  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:33.997697  4144 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:14:34.016961  4007 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:34.017542  4128 raft_consensus.cc:2804] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:34.025660  4128 raft_consensus.cc:697] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:34.026063  3255 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:34.027041  4136 raft_consensus.cc:2749] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.026827  4128 consensus_queue.cc:237] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:34.033471  4209 raft_consensus.cc:493] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:34.034483  4209 raft_consensus.cc:515] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:34.036669  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1752bd797b664bdc8cbfe571234287b7" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.039095  4082 raft_consensus.cc:493] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:34.041003  3181 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.043041  4176 raft_consensus.cc:697] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
W20260709 13:14:34.042393  3328 leader_election.cc:336] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.048748  3328 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.051434  3941 raft_consensus.cc:2749] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.054678  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.056186  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90595259a0e645f18c3ca5eafdf245f2" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.046283  4088 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:34.042695  4084 consensus_queue.cc:1059] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:14:34.057775  3283 raft_consensus.cc:1240] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Rejecting Update request from peer 0d7210a87d254adba064447cda99b137 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:34.042992  4082 raft_consensus.cc:515] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:34.059324  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a549cce7b7f418eb35ed1c1251524b9" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.040011  4118 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.061796  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0125b77760be464886c1533e8749b934" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.070199  4007 leader_election.cc:304] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:34.071336  4209 leader_election.cc:290] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:34.072553  3356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:34.073256  4118 raft_consensus.cc:2749] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.059700  4082 leader_election.cc:290] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:34.080385  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5ca5ebd2fd460db5be94489079d53d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.086555  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:34.076292  4041 raft_consensus.cc:493] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0d7210a87d254adba064447cda99b137)
I20260709 13:14:34.087764  4007 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:34.088155  4041 raft_consensus.cc:515] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:34.090505  4118 raft_consensus.cc:2749] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.091192  4041 leader_election.cc:290] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:34.093926  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
W20260709 13:14:34.097414  3180 leader_election.cc:336] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.097987  3180 leader_election.cc:304] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.098692  4209 raft_consensus.cc:2749] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:34.106176  3254 consensus_peers.cc:597] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:34.114678  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd79b371bd37425ca172f8db6667a9ce" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.103983  4176 consensus_queue.cc:237] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:34.116425  4088 raft_consensus.cc:3055] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:34.129621  3181 leader_election.cc:304] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:14:34.132985  3327 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:34.108912  3254 consensus_peers.cc:597] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:34.138665  3254 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:34.117125  4088 raft_consensus.cc:740] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
W20260709 13:14:34.140370  3254 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:34.149864  4084 raft_consensus.cc:2749] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:34.153759  3254 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:34.168733  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:34.169371  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:34.169926  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:34.192353  4110 raft_consensus.cc:493] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:34.194916  4110 raft_consensus.cc:515] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:34.195828  4088 consensus_queue.cc:260] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:34.197345  4088 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.197315  4110 leader_election.cc:290] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:34.210083  3328 leader_election.cc:336] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.204367  3941 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cae46c9c1d449fb2da72ce640e9ee4)
I20260709 13:14:34.213585  3941 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:34.215857  3941 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:34.231932  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 44505.4us
I20260709 13:14:34.233853  3036 catalog_manager.cc:5697] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 2, leader changed from 0d7210a87d254adba064447cda99b137 (127.28.62.132) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.203783  3039 catalog_manager.cc:5697] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from 0d7210a87d254adba064447cda99b137 (127.28.62.132) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } }
W20260709 13:14:34.259621  3328 leader_election.cc:336] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.298260  4011 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:34.299356  4011 tablet_bootstrap.cc:492] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:34.300000  4011 ts_tablet_manager.cc:1403] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.340s	user 0.028s	sys 0.000s
I20260709 13:14:34.318431  3329 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:34.319787  4110 raft_consensus.cc:2749] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.332623  3329 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:34.333550  3941 raft_consensus.cc:2749] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.333513  4011 raft_consensus.cc:359] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:34.334815  4011 raft_consensus.cc:740] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.335781  3329 leader_election.cc:304] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:34.337846  4011 consensus_queue.cc:260] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:34.366708  4011 ts_tablet_manager.cc:1434] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:14:34.367928  4011 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:34.370461  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:34.374732  4147 raft_consensus.cc:2749] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:34.378695  3254 leader_election.cc:336] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:34.379703  3254 leader_election.cc:336] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.380146  3329 leader_election.cc:304] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:34.382169  4147 raft_consensus.cc:2749] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.380151  3254 leader_election.cc:304] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.389626  4120 raft_consensus.cc:2749] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.386169  3329 leader_election.cc:304] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:34.391923  3254 leader_election.cc:336] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.401942  3941 raft_consensus.cc:2749] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:34.404453  3329 leader_election.cc:304] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.406105  4147 raft_consensus.cc:2749] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.395361  3254 leader_election.cc:304] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.410012  4041 raft_consensus.cc:2749] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:34.416798  3254 leader_election.cc:336] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.417656  3254 leader_election.cc:304] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:34.419538  3254 leader_election.cc:336] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.420287  3254 leader_election.cc:304] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:34.422271  3254 leader_election.cc:336] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.423040  3254 leader_election.cc:304] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:34.431376  3254 leader_election.cc:336] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:34.430233  3356 raft_consensus.cc:1275] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.438421  4011 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:34.441504  3254 leader_election.cc:304] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.429427 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:39973
I20260709 13:14:34.446022  4121 raft_consensus.cc:2749] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.440721  4242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:39973 every 8 connection(s)
I20260709 13:14:34.453944  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1f2f8cedde4cd3b992d015ba644252" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.430027  4097 raft_consensus.cc:2749] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.429826  4120 raft_consensus.cc:2749] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.464124  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:34.436587  4075 raft_consensus.cc:2749] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.483294  4011 tablet_bootstrap.cc:492] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:34.484599  4011 ts_tablet_manager.cc:1403] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.007s
I20260709 13:14:34.488224  4011 raft_consensus.cc:359] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:34.488925  4011 raft_consensus.cc:740] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.501374  4011 consensus_queue.cc:260] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:34.458235  4088 consensus_queue.cc:1048] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:14:34.520167  3329 leader_election.cc:304] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.537879  3329 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:34.524014  4147 raft_consensus.cc:2749] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.542984  4105 raft_consensus.cc:2749] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:34.572017  3359 raft_consensus.cc:1275] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.575206  4176 consensus_queue.cc:1048] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.583406  4011 ts_tablet_manager.cc:1434] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.003s
I20260709 13:14:34.585922  4011 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:34.659963  3208 raft_consensus.cc:1275] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.673707  4176 consensus_queue.cc:1048] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.679054  4180 raft_consensus.cc:3060] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.755065  4011 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:34.762159  4011 tablet_bootstrap.cc:492] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:34.763093  4011 ts_tablet_manager.cc:1403] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.179s	user 0.033s	sys 0.003s
I20260709 13:14:34.774276  3284 raft_consensus.cc:1275] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:34.773109  4011 raft_consensus.cc:359] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:34.778584  4011 raft_consensus.cc:740] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.779515  4011 consensus_queue.cc:260] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:34.795254  4126 consensus_queue.cc:1048] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.870384  4011 ts_tablet_manager.cc:1434] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.107s	user 0.012s	sys 0.024s
I20260709 13:14:34.871554  4011 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:34.866286  4176 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:34.899497  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 70177.9us
I20260709 13:14:34.909688  4176 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:34.958353  4263 raft_consensus.cc:493] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.968407  4263 raft_consensus.cc:515] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:34.975257  4257 log.cc:927] Time spent T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:14:34.975646  4263 leader_election.cc:290] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:34.976303  4263 raft_consensus.cc:493] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.985359  4263 raft_consensus.cc:515] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:35.000685  4244 heartbeater.cc:344] Connected to a master server at 127.28.62.190:41111
I20260709 13:14:35.001390  4244 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:35.002535  4244 heartbeater.cc:507] Master 127.28.62.190:41111 requested a full tablet report, sending...
I20260709 13:14:35.008486  4176 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:35.011405  4175 raft_consensus.cc:3060] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.013515  3039 catalog_manager.cc:5697] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 1 to 2, leader changed from 0d7210a87d254adba064447cda99b137 (127.28.62.132) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } }
I20260709 13:14:35.024782  4263 leader_election.cc:290] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:35.028987  3207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:35.030851  3215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:35.040618  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:35.040596  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.042457  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.043838  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.044238  4169 raft_consensus.cc:3060] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.094512  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecb53642c2843ecaa6e646c37b94237" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:35.128943  4007 leader_election.cc:304] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:14:35.135681  4261 log.cc:927] Time spent T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.200s	user 0.005s	sys 0.000s
I20260709 13:14:35.148674  4271 raft_consensus.cc:2749] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:35.177191  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 80222us
I20260709 13:14:35.213191  4011 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.254586  4173 raft_consensus.cc:3060] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.256843  4011 tablet_bootstrap.cc:492] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:35.257882  4011 ts_tablet_manager.cc:1403] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.387s	user 0.028s	sys 0.005s
I20260709 13:14:35.241927  4174 raft_consensus.cc:3060] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.264205  4258 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.264926  4258 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:35.252022  4263 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.268115  4180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:35.268041  4263 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:35.268697  4180 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.264936  4172 raft_consensus.cc:1240] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Rejecting Update request from peer 445754f29ffe4648a57f8124ddf8be20 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:35.285526  4172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:35.286242  4172 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
I20260709 13:14:35.301118  4172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "543ba4118aea4f4a896a49c4a10875e5" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
W20260709 13:14:35.302279  4273 log.cc:927] Time spent T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:35.321182  4005 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:35.343083  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.336781  4179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd631ae86be54b36b7ed84e2b1b50a68" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:35.361366  4179 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.423944  4011 raft_consensus.cc:359] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:35.429025  4011 raft_consensus.cc:740] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.431403  4011 consensus_queue.cc:260] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:35.364423  4180 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:35.430274  4259 raft_consensus.cc:2749] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:35.428403  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 107343us
I20260709 13:14:35.514199  4263 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:35.553745  4126 consensus_queue.cc:1059] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:35.556429  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.557457  3288 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 3: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:35.546605  4005 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:35.560607  4258 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:35.547327  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:35.598963  4011 ts_tablet_manager.cc:1434] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.341s	user 0.046s	sys 0.047s
I20260709 13:14:35.600281  4011 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:35.621160  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 123403us
W20260709 13:14:35.606596  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 78341.5us
I20260709 13:14:35.644018  4274 raft_consensus.cc:2749] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:35.676600  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 88604.7us
W20260709 13:14:35.712790  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 115141us
W20260709 13:14:35.729295  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 61803.8us
W20260709 13:14:35.714462  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:35.761727  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 47426.3us
I20260709 13:14:35.771253  4120 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.772502  4262 raft_consensus.cc:3055] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.789652  4294 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.790491  4294 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:35.792905  4294 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:35.801241  3254 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:35.803579  3254 leader_election.cc:304] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:35.804037  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:35.805102  4250 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:35.805639  4250 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:35.805369  3363 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 1.
I20260709 13:14:35.806195  4250 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.809707  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:35.809772  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:35.811772  3208 raft_consensus.cc:2393] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 3: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:35.810803  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:35.811837  3181 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:35.815886  3254 leader_election.cc:304] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:35.817648  3254 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:35.812849  4278 raft_consensus.cc:2749] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:35.787335  4262 raft_consensus.cc:740] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:35.828917  3039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58104 (request call id 98) took 1004 ms. Trace:
I20260709 13:14:35.829391  3039 rpcz_store.cc:276] 0709 13:14:34.831256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.836631 (+  5375us) service_pool.cc:224] Handling call
0709 13:14:35.828819 (+992188us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:35.259859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:35.263910 (+  4051us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:35.263940 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:14:35.263964 (+    24us) tablet.cc:662] Decoding operations
0709 13:14:35.264364 (+   400us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:35.264421 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:35.264446 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:35.264635 (+   189us) tablet.cc:701] Row locks acquired
0709 13:14:35.264653 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:35.264893 (+   240us) write_op.cc:270] Start()
0709 13:14:35.265006 (+   113us) write_op.cc:276] Timestamp: P: 1783602875264843 usec, L: 0
0709 13:14:35.265038 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:14:35.265836 (+   798us) log.cc:844] Serialized 540 byte log entry
0709 13:14:35.556685 (+290849us) op_driver.cc:464] REPLICATION: finished
0709 13:14:35.736793 (+180108us) write_op.cc:301] APPLY: starting
0709 13:14:35.736883 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:35.736988 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:35.737105 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:35.737351 (+   246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:35.747145 (+  9794us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:35.753658 (+  6513us) write_op.cc:312] APPLY: finished
0709 13:14:35.756368 (+  2710us) log.cc:844] Serialized 22 byte log entry
0709 13:14:35.756593 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.756702 (+   109us) write_op.cc:454] Released schema lock
0709 13:14:35.756743 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:35.757268 (+   525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:35.757305 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":170961,"apply.run_cpu_time_us":2161,"apply.run_wall_time_us":20480,"num_ops":1,"prepare.queue_time_us":225570,"prepare.run_cpu_time_us":2920,"prepare.run_wall_time_us":15192,"replication_time_us":268182,"thread_start_us":229571,"threads_started":2}]]}
W20260709 13:14:35.834714  4297 log.cc:927] Time spent T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:35.847577  4262 consensus_queue.cc:260] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:35.848851  4263 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.849476  4263 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:35.824729  4278 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:35.850739  4278 raft_consensus.cc:697] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:35.851781  4263 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:35.851714  4278 consensus_queue.cc:237] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:35.852597  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:35.854851  3363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:35.822407  4084 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:35.821909  4121 raft_consensus.cc:2749] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:35.787258  4120 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:35.849160  4262 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:35.864360  4120 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:35.864982  3285 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:35.857023  4084 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.868062  4084 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.872045  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:35.872454  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:35.877358  4005 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:35.878324  4263 raft_consensus.cc:2749] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:35.882810  4005 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15b6c3cd4774f618572acbd29feffa2; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:14:35.887068  3328 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:35.890141  4084 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:35.891016  4274 raft_consensus.cc:2749] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:35.891438  3208 raft_consensus.cc:2393] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 3: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
I20260709 13:14:35.897853  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:35.899663  3358 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 1.
W20260709 13:14:35.906247  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:35.921831  3255 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:35.923343  4120 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:35.923774  4120 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.924139  4120 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.884943  4250 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:35.930783  3288 raft_consensus.cc:1240] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Rejecting Update request from peer 445754f29ffe4648a57f8124ddf8be20 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:35.935292  4294 consensus_queue.cc:1059] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:35.935843  4250 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:35.936826  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:35.938839  4120 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:35.943394  4011 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:35.944473  4011 tablet_bootstrap.cc:492] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:35.945195  4011 ts_tablet_manager.cc:1403] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.345s	user 0.020s	sys 0.012s
I20260709 13:14:35.945372  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:35.946316  3208 raft_consensus.cc:2393] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d3cae46c9c1d449fb2da72ce640e9ee4 in current term 3: Already voted for candidate 445754f29ffe4648a57f8124ddf8be20 in this term.
W20260709 13:14:35.939417  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 79627.3us
I20260709 13:14:35.941669  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
W20260709 13:14:35.948025  3254 consensus_peers.cc:597] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:35.948256  3288 raft_consensus.cc:2393] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 445754f29ffe4648a57f8124ddf8be20 in current term 3: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:35.948618  4011 raft_consensus.cc:359] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:35.949461  4011 raft_consensus.cc:740] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.942759  4084 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:35.950248  4011 consensus_queue.cc:260] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:35.951122  3036 ts_manager.cc:194] Re-registered known tserver with Master: f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:35.956472  4174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:35.956772  4011 ts_tablet_manager.cc:1434] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:14:35.957851  4011 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:35.964663  4120 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:35.971835  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:35.980137  3358 raft_consensus.cc:3060] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.973814  3254 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:35.974490  4293 raft_consensus.cc:3055] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:35.985939  4293 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:35.986055  4120 raft_consensus.cc:2749] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:35.992719  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 64685.2us
W20260709 13:14:35.993657  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 44403.7us
W20260709 13:14:36.000000  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:36.002272  3212 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:36.006840  4005 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:36.010285  3360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f650af1337541488d26f54b98a050df" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:36.010908  4263 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:36.011372  4263 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.011730  4263 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.020784  3358 raft_consensus.cc:2468] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:36.025225  3181 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:36.026453  4128 raft_consensus.cc:2804] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:36.028183  4293 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.029768  4293 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.029925  3255 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:36.031790  4278 raft_consensus.cc:2749] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:36.027244  4128 raft_consensus.cc:697] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:36.040380  4128 consensus_queue.cc:237] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:36.038151  4263 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.047829  3358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:36.052035  4263 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:36.052647  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:36.053359  3212 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.063915  3212 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:36.065009  4005 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 0d7210a87d254adba064447cda99b137
I20260709 13:14:36.066043  4011 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.067035  4263 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:36.067062  4011 tablet_bootstrap.cc:492] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.069088  4011 ts_tablet_manager.cc:1403] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.111s	user 0.044s	sys 0.026s
I20260709 13:14:36.072057  4011 raft_consensus.cc:359] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.072844  4011 raft_consensus.cc:740] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.073324  3039 catalog_manager.cc:5697] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 1 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.073740  4011 consensus_queue.cc:260] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.076391  4011 ts_tablet_manager.cc:1434] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:36.077482  4011 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:36.081725  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:36.067827  4263 raft_consensus.cc:697] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:36.083294  4263 consensus_queue.cc:237] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.094058  3035 catalog_manager.cc:5697] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.103717  4011 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.105026  4011 tablet_bootstrap.cc:492] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.105783  4011 ts_tablet_manager.cc:1403] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 13:14:36.109192  4011 raft_consensus.cc:359] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.110086  4011 raft_consensus.cc:740] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.110859  4011 consensus_queue.cc:260] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.113427  4011 ts_tablet_manager.cc:1434] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:36.114478  4011 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.142508  3036 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39788
I20260709 13:14:36.149016  4244 heartbeater.cc:499] Master 127.28.62.190:41111 was elected leader, sending a full tablet report...
I20260709 13:14:36.150831  4011 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.151981  4011 tablet_bootstrap.cc:492] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.152704  4011 ts_tablet_manager.cc:1403] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.004s
I20260709 13:14:36.155737  4011 raft_consensus.cc:359] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.156577  4011 raft_consensus.cc:740] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.157354  4011 consensus_queue.cc:260] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.163868  4011 ts_tablet_manager.cc:1434] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
W20260709 13:14:36.163878  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:36.165262  4011 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.197558  4011 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.198572  4011 tablet_bootstrap.cc:492] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.199381  4011 ts_tablet_manager.cc:1403] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.013s
I20260709 13:14:36.203073  4011 raft_consensus.cc:359] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.203812  4011 raft_consensus.cc:740] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.204532  4011 consensus_queue.cc:260] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:36.207012  4011 ts_tablet_manager.cc:1434] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:14:36.208971  4011 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.248096  4011 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.249187  4011 tablet_bootstrap.cc:492] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.250092  4011 ts_tablet_manager.cc:1403] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.020s
I20260709 13:14:36.249650  3036 catalog_manager.cc:5697] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 3, leader changed from 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.253084  4011 raft_consensus.cc:359] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.253877  4011 raft_consensus.cc:740] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.254655  4011 consensus_queue.cc:260] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.257040  4011 ts_tablet_manager.cc:1434] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:36.258002  4011 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.270928  4293 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.271570  4293 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.274052  4293 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:36.277029  4174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:36.277351  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:36.278317  4174 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:36.280452  3180 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:36.283111  4293 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:36.284438  4293 raft_consensus.cc:493] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.285089  4293 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:36.309670  4293 raft_consensus.cc:515] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.316260  4293 leader_election.cc:290] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:36.317725  3288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:36.318689  4174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04212fef1d744adb9d0591162c6db6b6" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:36.337023  4174 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:36.409780  4011 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.410899  4011 tablet_bootstrap.cc:492] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.411504  4011 ts_tablet_manager.cc:1403] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.154s	user 0.040s	sys 0.047s
I20260709 13:14:36.415795  4011 raft_consensus.cc:359] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.416615  4011 raft_consensus.cc:740] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.417418  4011 consensus_queue.cc:260] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.424638  4174 raft_consensus.cc:2468] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 4.
I20260709 13:14:36.425525  4173 raft_consensus.cc:1240] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Rejecting Update request from peer d3cae46c9c1d449fb2da72ce640e9ee4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:36.426352  4179 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.429742  4011 ts_tablet_manager.cc:1434] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:14:36.434456  3180 leader_election.cc:304] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:36.435295  4293 raft_consensus.cc:2804] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:36.435843  4293 raft_consensus.cc:697] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:36.436676  4293 consensus_queue.cc:237] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.442519  4246 consensus_queue.cc:1059] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:36.443589  4250 raft_consensus.cc:3055] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:36.444135  4250 raft_consensus.cc:740] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:36.445210  4250 consensus_queue.cc:260] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:36.446231  4011 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.446909  4250 raft_consensus.cc:3060] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:36.449702  3358 raft_consensus.cc:1275] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:36.453652  4128 consensus_queue.cc:1048] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.481798  3360 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.483590  3036 catalog_manager.cc:5697] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 3 to 4, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.494534  4011 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.495657  3285 raft_consensus.cc:1275] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:36.495832  4011 tablet_bootstrap.cc:492] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.496892  4011 ts_tablet_manager.cc:1403] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.005s
I20260709 13:14:36.493172  3360 raft_consensus.cc:1275] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:36.499572  4294 consensus_queue.cc:1048] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:36.500401  4011 raft_consensus.cc:359] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.502449  4263 consensus_queue.cc:1048] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:36.512791  4011 raft_consensus.cc:740] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:36.513170  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:36.514055  4011 consensus_queue.cc:260] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.516925  4011 ts_tablet_manager.cc:1434] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:14:36.517990  4011 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:36.552601  3212 raft_consensus.cc:1275] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:36.554380  4263 consensus_queue.cc:1048] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:36.907545  4011 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:36.908967  4011 tablet_bootstrap.cc:492] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:36.909682  4011 ts_tablet_manager.cc:1403] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.392s	user 0.025s	sys 0.004s
I20260709 13:14:36.912518  4011 raft_consensus.cc:359] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.913266  4011 raft_consensus.cc:740] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.915038  4180 raft_consensus.cc:3060] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.914036  4011 consensus_queue.cc:260] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:36.927349  4011 ts_tablet_manager.cc:1434] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:14:36.928411  4011 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:36.993628  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 51723.3us
I20260709 13:14:37.047979  4011 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.049014  4011 tablet_bootstrap.cc:492] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:37.049752  4011 ts_tablet_manager.cc:1403] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.010s
I20260709 13:14:37.060890  4011 raft_consensus.cc:359] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:37.061686  4011 raft_consensus.cc:740] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.062484  4011 consensus_queue.cc:260] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:37.074410  4171 raft_consensus.cc:1275] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:14:37.076838  4128 consensus_queue.cc:1048] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:37.146073  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 52674.5us
W20260709 13:14:37.146294  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 77112.8us
W20260709 13:14:37.160578  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 91479.8us
W20260709 13:14:37.168754  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 75390.3us
I20260709 13:14:37.176790  4011 ts_tablet_manager.cc:1434] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.127s	user 0.043s	sys 0.035s
I20260709 13:14:37.181092  4011 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:37.166847  3254 consensus_peers.cc:597] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:37.184882  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:37.255322  3285 raft_consensus.cc:1275] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:14:37.255831  3285 pending_rounds.cc:85] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Aborting all ops after (but not including) 1
I20260709 13:14:37.256142  3285 pending_rounds.cc:107] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:14:37.256453  3285 raft_consensus.cc:2889] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:37.284145  3254 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:37.319828  4293 consensus_queue.cc:1048] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:37.327925  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:37.433780  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 47313.2us
I20260709 13:14:37.440369  4337 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:37.441061  4337 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:37.443373  4337 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:37.448186  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:37.449218  3284 raft_consensus.cc:2393] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
W20260709 13:14:37.456914  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 299967us
I20260709 13:14:37.511706  4011 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.514124  4011 tablet_bootstrap.cc:492] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:37.514958  4011 ts_tablet_manager.cc:1403] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.335s	user 0.043s	sys 0.016s
I20260709 13:14:37.519204  4011 raft_consensus.cc:359] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:37.519634  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:37.520068  4011 raft_consensus.cc:740] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.520412  3208 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:37.521258  4011 consensus_queue.cc:260] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:37.522980  4005 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:37.530867  4337 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:37.533839  4337 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:37.534204  4337 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.725620  4337 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:37.728266  4337 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:37.863020  4011 ts_tablet_manager.cc:1434] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.348s	user 0.008s	sys 0.000s
I20260709 13:14:37.864059  4011 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:37.908871  3971 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.915949  3971 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:37.918881  3971 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:37.938413  4180 raft_consensus.cc:3060] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:37.951185  4173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2" is_pre_election: true
I20260709 13:14:37.951274  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
W20260709 13:14:37.955399  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 443208us
I20260709 13:14:37.952625  4173 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:37.972481  3254 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:37.974663  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:37.975570  3284 raft_consensus.cc:2393] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f15b6c3cd4774f618572acbd29feffa2 in current term 2: Already voted for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in this term.
I20260709 13:14:37.986311  4339 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:37.986790  4339 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.987133  4339 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:37.990921  4238 debug-util.cc:398] Leaking SignalData structure 0x7b0800015640 after lost signal to thread 28925
W20260709 13:14:37.992120  4238 debug-util.cc:398] Leaking SignalData structure 0x7b08002a85a0 after lost signal to thread 3073
I20260709 13:14:37.996621  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:38.001854  4238 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd240 after lost signal to thread 3240
W20260709 13:14:38.003218  4238 debug-util.cc:398] Leaking SignalData structure 0x7b080038e0e0 after lost signal to thread 3314
W20260709 13:14:38.007601  4238 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0000 after lost signal to thread 3388
W20260709 13:14:38.009035  4238 debug-util.cc:398] Leaking SignalData structure 0x7b080038a720 after lost signal to thread 4242
I20260709 13:14:38.010722  4339 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.052740  3208 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:38.059374  4339 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:38.118949  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:38.119807  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:38.120959  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:38.135975  4005 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:38.139149  4011 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.142905  4337 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.143324  4011 tablet_bootstrap.cc:492] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.143522  4337 raft_consensus.cc:697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:38.144244  4011 ts_tablet_manager.cc:1403] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.281s	user 0.062s	sys 0.063s
I20260709 13:14:38.144721  4337 consensus_queue.cc:237] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.147387  4011 raft_consensus.cc:359] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.154107  4175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
I20260709 13:14:38.156471  4011 raft_consensus.cc:740] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.157531  4011 consensus_queue.cc:260] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.159683  4011 ts_tablet_manager.cc:1434] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:14:38.160926  4011 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:38.174297  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 120388us
I20260709 13:14:38.186726  3208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:38.187780  3208 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.199802  3208 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:38.204437  4011 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.232599  4011 tablet_bootstrap.cc:492] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.233377  4011 ts_tablet_manager.cc:1403] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.004s
I20260709 13:14:38.236145  4011 raft_consensus.cc:359] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:38.236848  4011 raft_consensus.cc:740] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
W20260709 13:14:38.210095  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:38.225281  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:38.239528  4011 consensus_queue.cc:260] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:38.241981  4011 ts_tablet_manager.cc:1434] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:38.242933  4011 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.257284  3253 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:38.259270  4340 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:38.259886  4340 raft_consensus.cc:697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:38.261020  4340 consensus_queue.cc:237] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.282963  3036 catalog_manager.cc:5697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.288523  4011 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.292671  4011 tablet_bootstrap.cc:492] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.296554  4011 ts_tablet_manager.cc:1403] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.005s
I20260709 13:14:38.299577  4011 raft_consensus.cc:359] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.309554  4011 raft_consensus.cc:740] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.310385  4011 consensus_queue.cc:260] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.312752  4011 ts_tablet_manager.cc:1434] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:14:38.313697  4011 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.392809  3038 catalog_manager.cc:5697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:38.412511  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:38.436771  4180 raft_consensus.cc:3060] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.465960  4011 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.475507  4011 tablet_bootstrap.cc:492] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.495302  4011 ts_tablet_manager.cc:1403] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.013s
I20260709 13:14:38.500185  4011 raft_consensus.cc:359] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.501103  4011 raft_consensus.cc:740] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.502081  4011 consensus_queue.cc:260] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.504812  4011 ts_tablet_manager.cc:1434] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:38.576457  3283 raft_consensus.cc:1240] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Rejecting Update request from peer f15b6c3cd4774f618572acbd29feffa2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:38.579043  4263 consensus_queue.cc:1059] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.580375  4263 consensus_queue.cc:1243] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Peer d3cae46c9c1d449fb2da72ce640e9ee4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:14:38.581012  4366 raft_consensus.cc:3055] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:38.581473  4366 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:38.582504  4366 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.583840  4366 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:38.597033  4011 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.645123  4011 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.646900  4011 tablet_bootstrap.cc:492] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.647784  4011 ts_tablet_manager.cc:1403] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.012s
I20260709 13:14:38.652930  4011 raft_consensus.cc:359] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.655400  4011 raft_consensus.cc:740] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.656318  4011 consensus_queue.cc:260] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.658591  4011 ts_tablet_manager.cc:1434] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:38.666221  4011 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.685456  4011 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.686547  4011 tablet_bootstrap.cc:492] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.687322  4011 ts_tablet_manager.cc:1403] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:14:38.690521  4011 raft_consensus.cc:359] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.691042  4180 raft_consensus.cc:1275] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:14:38.691296  4011 raft_consensus.cc:740] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.691589  4180 pending_rounds.cc:85] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Aborting all ops after (but not including) 1
I20260709 13:14:38.691942  4180 pending_rounds.cc:107] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:14:38.692220  4180 raft_consensus.cc:2889] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:38.692124  4011 consensus_queue.cc:260] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.695152  4011 ts_tablet_manager.cc:1434] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:38.705767  4103 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.716503  4011 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.745253  3208 raft_consensus.cc:1275] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:38.746729  3237 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2800 after lost signal to thread 28925
W20260709 13:14:38.748235  3237 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc4a0 after lost signal to thread 3073
W20260709 13:14:38.749804  3237 debug-util.cc:398] Leaking SignalData structure 0x7b080021a6e0 after lost signal to thread 3240
W20260709 13:14:38.751183  3237 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea720 after lost signal to thread 3314
W20260709 13:14:38.752672  3237 debug-util.cc:398] Leaking SignalData structure 0x7b080030c500 after lost signal to thread 3388
W20260709 13:14:38.754781  3237 debug-util.cc:398] Leaking SignalData structure 0x7b080008c3a0 after lost signal to thread 4242
I20260709 13:14:38.758607  4375 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:38.819159  4011 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.820363  4011 tablet_bootstrap.cc:492] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.821377  4011 ts_tablet_manager.cc:1403] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.025s
I20260709 13:14:38.825280  4011 raft_consensus.cc:359] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:38.826305  4011 raft_consensus.cc:740] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.827546  4011 consensus_queue.cc:260] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:38.845533  4011 ts_tablet_manager.cc:1434] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:14:38.846434  4011 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
W20260709 13:14:38.886574  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:38.901793  4011 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.903354  4011 tablet_bootstrap.cc:492] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.904197  4011 ts_tablet_manager.cc:1403] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.003s
I20260709 13:14:38.907756  4011 raft_consensus.cc:359] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:38.908799  4011 raft_consensus.cc:740] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.909780  4011 consensus_queue.cc:260] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:38.942950  4011 ts_tablet_manager.cc:1434] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:14:38.944447  4011 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:38.986133  4011 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:38.987331  4011 tablet_bootstrap.cc:492] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:38.988577  4011 ts_tablet_manager.cc:1403] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.009s
I20260709 13:14:38.992108  4011 raft_consensus.cc:359] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:38.993027  4011 raft_consensus.cc:740] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.994014  4011 consensus_queue.cc:260] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:39.013460  4011 ts_tablet_manager.cc:1434] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:14:39.025141  4011 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:39.070842  4180 raft_consensus.cc:3060] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.093679  4172 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.154881  4011 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.169297  4011 tablet_bootstrap.cc:492] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:39.170140  4011 ts_tablet_manager.cc:1403] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.145s	user 0.025s	sys 0.002s
I20260709 13:14:39.176044  4011 raft_consensus.cc:359] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:39.176911  4011 raft_consensus.cc:740] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.179005  4011 consensus_queue.cc:260] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:39.182169  4011 ts_tablet_manager.cc:1434] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:39.183122  4011 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:39.208598  4179 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:39.251442  4011 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.252588  4011 tablet_bootstrap.cc:492] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:39.253352  4011 ts_tablet_manager.cc:1403] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.008s
I20260709 13:14:39.255956  4011 raft_consensus.cc:359] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:39.256651  4011 raft_consensus.cc:740] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.257454  4011 consensus_queue.cc:260] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:39.260808  4011 ts_tablet_manager.cc:1434] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:39.262274  4011 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap starting.
I20260709 13:14:39.331841  4011 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:39.332887  4011 tablet_bootstrap.cc:492] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Bootstrap complete.
I20260709 13:14:39.333621  4011 ts_tablet_manager.cc:1403] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.011s
I20260709 13:14:39.336369  4011 raft_consensus.cc:359] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:39.337323  4011 raft_consensus.cc:740] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.338078  4011 consensus_queue.cc:260] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:39.340636  4011 ts_tablet_manager.cc:1434] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
W20260709 13:14:39.810439  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 112361us
W20260709 13:14:40.991904  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 60378.7us
W20260709 13:14:41.027880  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 105349us
W20260709 13:14:41.136485  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 60432.8us
W20260709 13:14:41.137665  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 70276.1us
W20260709 13:14:41.439551  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 51750us
W20260709 13:14:41.530640  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 54691.1us
W20260709 13:14:42.156406  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 89942.7us
W20260709 13:14:42.192322  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 79026.5us
W20260709 13:14:42.312979  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 83236.2us
W20260709 13:14:42.387858  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 48622.4us
W20260709 13:14:42.406975  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 74141.8us
W20260709 13:14:42.578781  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 51205.5us
W20260709 13:14:42.679392  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 65315.5us
W20260709 13:14:43.463964  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 43775.2us
I20260709 13:14:44.850646 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:45.441231  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 52986.5us
I20260709 13:14:45.534010  3357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a"
dest_uuid: "0d7210a87d254adba064447cda99b137"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:45176
I20260709 13:14:45.535269  3357 raft_consensus.cc:606] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:45.578197  3289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:45.578938  3289 raft_consensus.cc:606] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:45.584800  3289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:45.585536  3289 raft_consensus.cc:606] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:45.593145  3289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:45.602059  3289 raft_consensus.cc:606] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:45.605666  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:45.606443  3283 raft_consensus.cc:606] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:45.607923 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:45.609794 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:45.854439  4426 raft_consensus.cc:993] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.855110  4426 raft_consensus.cc:1081] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.888515  4174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:14:45.889289  4174 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:45.889918  4174 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.950332  4422 raft_consensus.cc:993] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.954814  4437 raft_consensus.cc:1081] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.957890  4172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:45.958786  4172 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:45.959190  4172 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.957103  4174 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:45.963013  4174 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:45.964022  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
W20260709 13:14:45.964818  3311 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3140 after lost signal to thread 28925
I20260709 13:14:45.965004  3361 raft_consensus.cc:3055] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.965359  3361 raft_consensus.cc:740] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
W20260709 13:14:45.966055  3311 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac440 after lost signal to thread 3073
I20260709 13:14:45.966197  3361 consensus_queue.cc:260] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:45.967510  3311 debug-util.cc:398] Leaking SignalData structure 0x7b08001112a0 after lost signal to thread 3240
I20260709 13:14:45.967646  3361 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:45.968755  3311 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1900 after lost signal to thread 3314
I20260709 13:14:45.964105  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
W20260709 13:14:45.970049  3311 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0e20 after lost signal to thread 3388
I20260709 13:14:45.970156  3210 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:45.971549  3311 debug-util.cc:398] Leaking SignalData structure 0x7b080038b560 after lost signal to thread 4242
I20260709 13:14:45.979441  3210 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:45.986132  4444 raft_consensus.cc:993] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.994693  4444 raft_consensus.cc:1081] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.994810  4005 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:45.995990  4449 raft_consensus.cc:2804] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.987928  4454 raft_consensus.cc:993] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:45.994854  3361 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.000252  4179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:46.001065  4179 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.001536  4179 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.998162  4172 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.010501  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:46.011126  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:46.011955  3284 raft_consensus.cc:3055] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.012295  3284 raft_consensus.cc:740] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:46.014592  4172 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:46.011186  3210 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.013301  3284 consensus_queue.cc:260] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.040247  4444 raft_consensus.cc:1081] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:46.048646  3284 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.047000  4179 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.072815  4172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:46.073582  4172 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.073943  4172 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.046482  4449 raft_consensus.cc:697] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:46.075057  3210 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.080677  4005 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:46.081502  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:46.083894  3210 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.084553  4179 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:46.090356  4172 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:46.089385  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:46.093580  3289 raft_consensus.cc:3055] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.093946  3289 raft_consensus.cc:740] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:46.094872  3289 consensus_queue.cc:260] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.095811  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:46.096390  3361 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.096292  3289 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.096942  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:46.097623  3283 raft_consensus.cc:3055] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.097915  3283 raft_consensus.cc:740] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:46.095255  4172 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:46.101166  3283 consensus_queue.cc:260] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:46.104667  3284 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.105201  4449 consensus_queue.cc:237] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:46.109386  3361 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.110021  3283 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.113888  4456 raft_consensus.cc:2804] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.114023  4007 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:46.115854  4455 raft_consensus.cc:2804] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.116330  4455 raft_consensus.cc:697] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:46.117287  4455 consensus_queue.cc:237] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:46.124676  3289 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.130079  4007 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:46.131628  4458 raft_consensus.cc:2804] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.132553  4458 raft_consensus.cc:697] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:46.134291  3210 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.135002  4458 consensus_queue.cc:237] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.137529  4444 raft_consensus.cc:993] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:46.144470  4444 raft_consensus.cc:1081] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:46.147117  4179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:46.147692  4179 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.149199  4179 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.167949  4179 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.170197  4179 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:46.172194  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:46.173213  3289 raft_consensus.cc:3055] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.174510  3289 raft_consensus.cc:740] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:46.175129  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:46.175969  3210 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.164222  4456 raft_consensus.cc:697] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:46.180474  3289 consensus_queue.cc:260] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.182122  3289 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.186128  4456 consensus_queue.cc:237] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.203087  3210 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:46.204281  4005 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:46.168190  3283 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:46.206881  3289 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:46.209059  4449 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:46.215373  4449 raft_consensus.cc:697] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:46.216435  4449 consensus_queue.cc:237] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:46.223554  3036 catalog_manager.cc:5697] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from 0d7210a87d254adba064447cda99b137 (127.28.62.132) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.324503  3036 catalog_manager.cc:5697] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:46.326428  3036 catalog_manager.cc:5697] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.328110  3036 catalog_manager.cc:5697] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.334630  3036 catalog_manager.cc:5697] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 2 to 3, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.525029  3289 raft_consensus.cc:1275] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.529567  4449 consensus_queue.cc:1048] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.541457  3361 raft_consensus.cc:1275] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.545146  4456 consensus_queue.cc:1048] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.610993 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:46.612788  3214 raft_consensus.cc:1275] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.613528  3210 raft_consensus.cc:1275] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.613687  3208 raft_consensus.cc:1275] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:46.616299  4458 consensus_queue.cc:1048] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.616425  4456 consensus_queue.cc:1048] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.618156  4458 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:46.694883  3362 raft_consensus.cc:1275] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.703788  4449 consensus_queue.cc:1048] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.716174  3284 raft_consensus.cc:1275] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:46.723074  4449 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:46.731977  3289 raft_consensus.cc:1275] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.735064  4458 consensus_queue.cc:1048] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:46.742635 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:46.760358  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 134266us
I20260709 13:14:46.808365  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12d502876a864c95a9caf2957c69812b"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "445754f29ffe4648a57f8124ddf8be20"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:46.809195  3285 raft_consensus.cc:606] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:46.821811  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:46.822927  3285 raft_consensus.cc:606] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:46.833200  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:46.833987  3285 raft_consensus.cc:606] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:46.849073  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:46.849686  3285 raft_consensus.cc:606] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
W20260709 13:14:46.852603  4476 log.cc:927] Time spent T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:14:46.855034  3285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:46.855857  3285 raft_consensus.cc:606] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:46.858963 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:46.865978 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.883257  3214 raft_consensus.cc:1275] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.900743  4455 consensus_queue.cc:1048] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:46.906934  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 93106.3us
I20260709 13:14:46.934336  3283 raft_consensus.cc:1275] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.943711  4484 consensus_queue.cc:1048] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:46.982358  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 46296.5us
I20260709 13:14:47.039186  4422 raft_consensus.cc:993] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.057462  4444 raft_consensus.cc:1081] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.059947  4172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:47.060819  4172 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.061275  4172 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.073804  4172 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:47.083478  4172 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 4 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:47.094193  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:47.095117  3213 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.157056  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:47.157855  3284 raft_consensus.cc:3055] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:47.158198  3284 raft_consensus.cc:740] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:47.159240  3284 consensus_queue.cc:260] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:47.229560  3213 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 4.
I20260709 13:14:47.227742  3284 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:47.255010  4472 log.cc:927] Time spent T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:14:47.261976  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 106581us
W20260709 13:14:47.287400  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 59582.8us
I20260709 13:14:47.300923  3284 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 4.
W20260709 13:14:47.345435  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 101221us
W20260709 13:14:47.358246  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 114938us
W20260709 13:14:47.343255  3327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 52456.6us
W20260709 13:14:47.363035  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 50967.1us
I20260709 13:14:47.357627  4005 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
W20260709 13:14:47.409677  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 120841us
W20260709 13:14:47.419179  4005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 61642.7us
I20260709 13:14:47.423913  4484 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:47.458107  4484 raft_consensus.cc:697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 4 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:47.459143  4484 consensus_queue.cc:237] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:47.528270  4422 raft_consensus.cc:993] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.528836  4422 raft_consensus.cc:1081] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.547693  4516 raft_consensus.cc:993] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower 445754f29ffe4648a57f8124ddf8be20 to start an election
I20260709 13:14:47.548301  4516 raft_consensus.cc:1081] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer 445754f29ffe4648a57f8124ddf8be20 to start an election
I20260709 13:14:47.550246  3216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12d502876a864c95a9caf2957c69812b"
dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
 from {username='slave'} at 127.0.0.1:53428
I20260709 13:14:47.550868  3216 raft_consensus.cc:493] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.551312  3216 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:47.578078  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 213274us
W20260709 13:14:47.594753  3328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 182160us
W20260709 13:14:47.625710  4007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 66474.4us
I20260709 13:14:47.637765  3216 raft_consensus.cc:515] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:47.638839  3253 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:46533, user_credentials={real_user=slave}} blocked reactor thread for 77957.9us
I20260709 13:14:47.653362  3036 catalog_manager.cc:5697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 3 to 4, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 4 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.659678  3216 leader_election.cc:290] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:47.663308  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:47.664002  3361 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.666260  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:47.667028  3284 raft_consensus.cc:3055] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.667387  3284 raft_consensus.cc:740] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:47.668450  3284 consensus_queue.cc:260] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:47.669868  3284 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.672603  3361 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:47.690861  4179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:47.691452  4179 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.691807  4179 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.709734  3181 leader_election.cc:304] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:47.713737  4499 raft_consensus.cc:2804] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.714360  4499 raft_consensus.cc:697] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:47.715497  4499 consensus_queue.cc:237] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:47.718604  4179 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.722769  4174 raft_consensus.cc:1240] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Rejecting Update request from peer d3cae46c9c1d449fb2da72ce640e9ee4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.720778  3284 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:47.724479  3361 raft_consensus.cc:1240] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Rejecting Update request from peer d3cae46c9c1d449fb2da72ce640e9ee4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.747052  4517 raft_consensus.cc:993] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.747795  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:47.748481  3287 raft_consensus.cc:3055] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.748929  3287 raft_consensus.cc:740] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:47.748533  4179 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:47.751570  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:47.754086  3357 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.754917  4501 raft_consensus.cc:1081] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.757826  3287 consensus_queue.cc:260] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.758850  3287 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.762751  3357 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:47.772562  4007 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:47.785318  4484 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.785969  4484 raft_consensus.cc:697] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:47.787081  4484 consensus_queue.cc:237] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.805099  4518 raft_consensus.cc:993] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.806250  4502 raft_consensus.cc:1081] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:47.811132  3287 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:47.819684  4179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:47.820341  4179 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.820709  4179 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.856043  4179 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.859637  4174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:47.863904  4179 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:47.866143  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:47.890539  3361 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.866179  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:47.873006 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.877014  4169 raft_consensus.cc:1240] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Rejecting Update request from peer d3cae46c9c1d449fb2da72ce640e9ee4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.861186  4174 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.894336  4174 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.894793  3287 raft_consensus.cc:3055] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.895156  3287 raft_consensus.cc:740] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:47.899814  3287 consensus_queue.cc:260] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.900956  3287 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.905016  3361 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:47.905488  4174 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:47.906495  4007 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:47.909807  4174 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:47.911878  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:47.912487  3283 raft_consensus.cc:3055] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.912781  3283 raft_consensus.cc:740] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:47.913586  3283 consensus_queue.cc:260] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:47.914678  3283 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.930568  3283 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:47.930677  4455 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.931541  4455 raft_consensus.cc:697] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:47.932476  4455 consensus_queue.cc:237] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:47.948521  3287 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:47.953264  4007 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:47.955282  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:47.955905  3210 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.959400  4484 raft_consensus.cc:2804] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.962903  3038 catalog_manager.cc:5697] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.965982  4484 raft_consensus.cc:697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:47.982306  4484 consensus_queue.cc:237] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:48.010144  3210 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:48.014506  3212 raft_consensus.cc:1275] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:48.017616  3287 raft_consensus.cc:1275] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:48.022538  3036 catalog_manager.cc:5697] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 2 to 3, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.026666  3036 catalog_manager.cc:5697] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 2 to 3, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.030642  4458 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.032101  4458 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.088339 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:48.136142  3036 catalog_manager.cc:5697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.164853  3283 raft_consensus.cc:1275] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.166977  4473 consensus_queue.cc:1048] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.180696  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c68824dda743d8b97417c774968f45"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "445754f29ffe4648a57f8124ddf8be20"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:48.184408  3283 raft_consensus.cc:606] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS 445754f29ffe4648a57f8124ddf8be20
I20260709 13:14:48.189599  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:48.190193  3283 raft_consensus.cc:606] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:48.201040  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:48.201776  3283 raft_consensus.cc:606] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:48.209990  3283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
mode: GRACEFUL
new_leader_uuid: "0d7210a87d254adba064447cda99b137"
 from {username='slave'} at 127.0.0.1:53002
I20260709 13:14:48.210582  3283 raft_consensus.cc:606] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Received request to transfer leadership to TS 0d7210a87d254adba064447cda99b137
I20260709 13:14:48.210837  3357 raft_consensus.cc:1275] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.212448  4503 consensus_queue.cc:1048] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.213567 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:48.215463 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:48.228547  4518 raft_consensus.cc:993] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower 0d7210a87d254adba064447cda99b137 to start an election
I20260709 13:14:48.229300  4518 raft_consensus.cc:1081] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Signalling peer 0d7210a87d254adba064447cda99b137 to start an election
I20260709 13:14:48.242376  3357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328"
dest_uuid: "0d7210a87d254adba064447cda99b137"
 from {username='slave'} at 127.0.0.1:39100
I20260709 13:14:48.242996  3357 raft_consensus.cc:493] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.243360  3357 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.286856  4516 raft_consensus.cc:993] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower 445754f29ffe4648a57f8124ddf8be20 to start an election
I20260709 13:14:48.287451  4516 raft_consensus.cc:1081] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer 445754f29ffe4648a57f8124ddf8be20 to start an election
I20260709 13:14:48.290002  3216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c68824dda743d8b97417c774968f45"
dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
 from {username='slave'} at 127.0.0.1:53428
I20260709 13:14:48.290625  3216 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.290988  3216 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.299542  3284 raft_consensus.cc:1275] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.295766  3357 raft_consensus.cc:515] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.305038  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:48.305915  3212 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.308876  3357 leader_election.cc:290] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:48.310215  3216 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.321496  3283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:48.322162  3283 raft_consensus.cc:3055] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.322552  3283 raft_consensus.cc:740] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:48.325994  3216 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:48.326835  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c68824dda743d8b97417c774968f45" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:48.327641  3357 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.321317  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0bca49e16e1444591119e2dd581d328" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:48.314846  4458 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:14:48.329526  3284 raft_consensus.cc:3055] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.329953  3284 raft_consensus.cc:740] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:48.333936  3284 consensus_queue.cc:260] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.335292  3284 raft_consensus.cc:3060] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.339438  3283 consensus_queue.cc:260] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.342979  3283 raft_consensus.cc:3060] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.354748  3212 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:48.378834  3327 leader_election.cc:304] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:48.380285  3283 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:48.380287  4446 raft_consensus.cc:2804] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.382604  4446 raft_consensus.cc:697] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:48.382704  3181 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:48.383675  4503 raft_consensus.cc:2804] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.384204  4503 raft_consensus.cc:697] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:48.385229  4503 consensus_queue.cc:237] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.355099  3357 raft_consensus.cc:2468] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:48.355960  3284 raft_consensus.cc:2468] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:48.363222  3287 raft_consensus.cc:1275] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.372407  3361 raft_consensus.cc:1275] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.392493  3359 raft_consensus.cc:1240] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Rejecting Update request from peer d3cae46c9c1d449fb2da72ce640e9ee4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:48.398375  4446 consensus_queue.cc:237] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:48.402663  4458 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.404156  4484 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.407814  4518 raft_consensus.cc:993] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:48.408394  4502 raft_consensus.cc:1081] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:48.411567  4169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:48.412410  4169 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.412885  4169 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.441624  3359 raft_consensus.cc:1275] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.445312  4455 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.449818  4169 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:48.452643  4169 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:48.454201  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:48.463641  3361 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.459586  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:48.465741  3287 raft_consensus.cc:3055] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:48.466073  3287 raft_consensus.cc:740] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:48.477047  3287 consensus_queue.cc:260] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:48.503650  3210 raft_consensus.cc:1275] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.505820  3287 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.505872  4458 consensus_queue.cc:1048] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:48.522639  3361 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:48.524017  4007 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:48.524950  4458 raft_consensus.cc:2804] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.525671  4458 raft_consensus.cc:697] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:48.526775  4458 consensus_queue.cc:237] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:48.529783  3283 raft_consensus.cc:1275] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.531713  4512 consensus_queue.cc:1048] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.532788  3038 catalog_manager.cc:5697] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 2 to 3, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.542572  3287 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:48.535578  3037 catalog_manager.cc:5697] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.591192  4518 raft_consensus.cc:993] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:48.591712  4518 raft_consensus.cc:1081] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:48.595659  4169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54904
I20260709 13:14:48.596290  4169 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:48.596654  4169 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.607700  4169 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:48.615814  4169 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:48.617254  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:48.617892  3212 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.618338  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:48.618940  3284 raft_consensus.cc:3055] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.619242  3284 raft_consensus.cc:740] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:48.619992  3284 consensus_queue.cc:260] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:48.621179  3284 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:48.623220  4544 log.cc:927] Time spent T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:14:48.649053  3035 catalog_manager.cc:5697] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.629554  3212 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:48.654855  4005 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:48.658778  4455 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.659375  4455 raft_consensus.cc:697] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:48.660312  4455 consensus_queue.cc:237] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:48.675870  3284 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 3.
I20260709 13:14:48.778267  3037 catalog_manager.cc:5697] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 2 to 3, leader changed from d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 3 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.833906  3210 raft_consensus.cc:1275] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.835496  4509 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.865648  3284 raft_consensus.cc:1275] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:48.868161  4511 consensus_queue.cc:1048] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.890865  3361 raft_consensus.cc:1275] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.893044  4499 consensus_queue.cc:1048] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.920149  3289 raft_consensus.cc:1275] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.922190  4473 consensus_queue.cc:1048] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.009378  3289 raft_consensus.cc:1275] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.011075  4455 consensus_queue.cc:1048] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.056380  3357 raft_consensus.cc:1275] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:49.057902  4455 consensus_queue.cc:1048] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:49.206764  3283 raft_consensus.cc:1275] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.216462 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:49.235425  4455 consensus_queue.cc:1048] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:49.237872  3216 raft_consensus.cc:1275] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:49.240924  4455 consensus_queue.cc:1048] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:49.422710 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:49.626948  3216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12d502876a864c95a9caf2957c69812b"
dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
mode: GRACEFUL
new_leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
 from {username='slave'} at 127.0.0.1:56624
I20260709 13:14:49.627604  3216 raft_consensus.cc:606] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Received request to transfer leadership to TS d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:49.632027  3357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a"
dest_uuid: "0d7210a87d254adba064447cda99b137"
mode: GRACEFUL
new_leader_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:45176
I20260709 13:14:49.632674  3357 raft_consensus.cc:606] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Received request to transfer leadership to TS f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:49.634610 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:49.636664 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:50.060451  4446 raft_consensus.cc:993] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: : Instructing follower f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:50.061137  4446 raft_consensus.cc:1081] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Signalling peer f15b6c3cd4774f618572acbd29feffa2 to start an election
I20260709 13:14:50.066279  4174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a"
dest_uuid: "f15b6c3cd4774f618572acbd29feffa2"
 from {username='slave'} at 127.0.0.1:54902
I20260709 13:14:50.066874  4174 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.067222  4174 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.072548  4503 raft_consensus.cc:993] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: : Instructing follower d3cae46c9c1d449fb2da72ce640e9ee4 to start an election
I20260709 13:14:50.073165  4503 raft_consensus.cc:1081] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Signalling peer d3cae46c9c1d449fb2da72ce640e9ee4 to start an election
I20260709 13:14:50.075270  3289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12d502876a864c95a9caf2957c69812b"
dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
 from {username='slave'} at 127.0.0.1:46924
I20260709 13:14:50.076014  3289 raft_consensus.cc:493] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.076447  3289 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.084359  4174 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:50.091351  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:50.092026  3361 raft_consensus.cc:3055] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:50.092340  3361 raft_consensus.cc:740] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:50.093115  3361 consensus_queue.cc:260] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:50.094543  3361 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.084941  3289 raft_consensus.cc:515] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:50.106907  4174 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:50.111225  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "f15b6c3cd4774f618572acbd29feffa2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:50.112088  3212 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.112962  3361 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:50.117300  3289 leader_election.cc:290] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535)
I20260709 13:14:50.120498  4007 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2; no voters: 
I20260709 13:14:50.120826  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:50.121589  4484 raft_consensus.cc:2804] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:50.122118  4484 raft_consensus.cc:697] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Becoming Leader. State: Replica: f15b6c3cd4774f618572acbd29feffa2, State: Running, Role: LEADER
I20260709 13:14:50.121589  3210 raft_consensus.cc:3055] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:50.123149  3210 raft_consensus.cc:740] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:50.123037  4484 consensus_queue.cc:237] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:50.124130  3210 consensus_queue.cc:260] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:50.125386  3210 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.155535  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12d502876a864c95a9caf2957c69812b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:50.184381  3361 raft_consensus.cc:3060] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.228507  3212 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15b6c3cd4774f618572acbd29feffa2 in term 2.
I20260709 13:14:50.259485  3361 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:50.293368  3210 raft_consensus.cc:2468] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:50.294692  3253 leader_election.cc:304] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:50.296223  4516 raft_consensus.cc:2804] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.297506  4516 raft_consensus.cc:697] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:50.298447  4516 consensus_queue.cc:237] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:50.382990  3038 catalog_manager.cc:5697] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 2 to 3, leader changed from 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.395944  3037 catalog_manager.cc:5697] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 reported cstate change: term changed from 1 to 2, leader changed from 0d7210a87d254adba064447cda99b137 (127.28.62.132) to f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f15b6c3cd4774f618572acbd29feffa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:50.431449  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 77564.8us
I20260709 13:14:50.669793 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.716318  3361 raft_consensus.cc:1275] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.717778  4565 consensus_queue.cc:1048] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.743886  3357 raft_consensus.cc:1275] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:50.755195  4516 consensus_queue.cc:1048] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:50.759723  3210 raft_consensus.cc:1275] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Refusing update from remote peer f15b6c3cd4774f618572acbd29feffa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:50.763237  4560 consensus_queue.cc:1048] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.828336  3216 raft_consensus.cc:1275] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:50.830700  4491 consensus_queue.cc:1048] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:51.002851  3329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:35457, user_credentials={real_user=slave}} blocked reactor thread for 70798.7us
I20260709 13:14:51.004366 28922 tablet_server.cc:179] TabletServer@127.28.62.129:39973 shutting down...
W20260709 13:14:51.022984  3254 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 64 similar messages]
W20260709 13:14:51.050410  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.095055  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.102435  3180 consensus_peers.cc:597] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.130005  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.138032  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.173355  3180 consensus_peers.cc:597] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.180685  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.187670  3180 consensus_peers.cc:597] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.231701 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:51.233037 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.234392 28922 raft_consensus.cc:2243] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.243515 28922 raft_consensus.cc:2272] T fd93a03a51b6448b86959645526e2dd1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.249850 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.250897 28922 raft_consensus.cc:2243] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.251619 28922 raft_consensus.cc:2272] T 09f56cff7d5e42d1828255add82ab240 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.254817 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.255798 28922 raft_consensus.cc:2243] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:51.256290  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.258853  3328 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.262667  3328 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.263358  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.256376 28922 raft_consensus.cc:2272] T 302a732ff54a4673bd480a2aa501cfa1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.265955  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.268177 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.269150 28922 raft_consensus.cc:2243] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.269687 28922 raft_consensus.cc:2272] T e63193ea538e42d1913abde82e22fbda P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.280859  3180 consensus_peers.cc:597] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.283656 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.284772 28922 raft_consensus.cc:2243] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.285858 28922 raft_consensus.cc:2272] T 29fbebd988e2438d9be8247d581ce029 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.286266  3180 consensus_peers.cc:597] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.308830  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.315006 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.315994 28922 raft_consensus.cc:2243] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.316586 28922 raft_consensus.cc:2272] T 635e301b4bec4ff889241f95afc76f35 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.331414 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.332454 28922 raft_consensus.cc:2243] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.344164 28922 raft_consensus.cc:2272] T 54b9bc7bb2494d188055fd77fbdd0c93 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.350972 28922 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:51.351227  3254 consensus_peers.cc:597] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.353083  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.354974  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.358484 28922 raft_consensus.cc:2243] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:14:51.358564  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.359776 28922 raft_consensus.cc:2272] T d06abc8907064e7fa5e6b6da9b9f0104 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.359498  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.372434 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.373520 28922 raft_consensus.cc:2243] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.375285 28922 raft_consensus.cc:2272] T 0125b77760be464886c1533e8749b934 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.389321 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.393453 28922 raft_consensus.cc:2243] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.394603 28922 raft_consensus.cc:2272] T cef153cabc764fe2ba8ac3fb612bf68c P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.394840  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.399307 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.400533 28922 raft_consensus.cc:2243] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:51.401629  3328 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.405200 28922 raft_consensus.cc:2272] T 161c10ebbba04c93bd1debaffb57b9f3 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.412308 28922 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:51.412552  3180 consensus_peers.cc:597] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.418030 28922 raft_consensus.cc:2243] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.419027 28922 raft_consensus.cc:2272] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.420181  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.425438 28922 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:51.433746  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.441066 28922 raft_consensus.cc:2243] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.442220 28922 raft_consensus.cc:2272] T 9436ea12f5e14810aef6c3bb3c5e4f3a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.445951 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.446959 28922 raft_consensus.cc:2243] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.448066 28922 raft_consensus.cc:2272] T 1c4b7ad2aa204fb1912df90f00ccde0a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.451763 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.452801 28922 raft_consensus.cc:2243] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.461558 28922 raft_consensus.cc:2272] T 8a5ca5ebd2fd460db5be94489079d53d P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.462354  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.470834  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:51.472502  3180 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.474967 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.482261 28922 raft_consensus.cc:2243] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.483120 28922 raft_consensus.cc:2272] T 30dfc159d3e44c748c3eba625cfb200a P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.486584 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.490302 28922 raft_consensus.cc:2243] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.491472 28922 raft_consensus.cc:2272] T c66bac0298e146bc8cbd817d3014f8ee P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.500427  3328 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.502508 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.503590 28922 raft_consensus.cc:2243] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.504196 28922 raft_consensus.cc:2272] T bcbc57c19cbf45639b5504d44069ba50 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.512730 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.515799 28922 raft_consensus.cc:2243] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.519280 28922 raft_consensus.cc:2272] T 63dc51b539a24310ac2d3e91b733fc8a P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:51.526611  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:51.529875 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.532196 28922 raft_consensus.cc:2243] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.534242 28922 raft_consensus.cc:2272] T 44413e6de00643eb907ef2494cacf07d P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.545365 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.555531 28922 raft_consensus.cc:2243] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.556290 28922 raft_consensus.cc:2272] T 0d533b92378e42ffb969e732f2b89ea5 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.559409 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.565689 28922 raft_consensus.cc:2243] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.566620 28922 raft_consensus.cc:2272] T ebc82eb45cde416fa64698383ea73ce1 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.574859 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.575886 28922 raft_consensus.cc:2243] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.577194 28922 raft_consensus.cc:2272] T eb1ead8560d7474aa8151592a32d2504 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.597906 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.603607 28922 raft_consensus.cc:2243] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.609282 28922 raft_consensus.cc:2272] T 9ecb53642c2843ecaa6e646c37b94237 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.624447 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.636929 28922 raft_consensus.cc:2243] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.637748 28922 raft_consensus.cc:2272] T ba17a83551cc4376a2c46e57f9cf2ed1 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.641016 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.642105 28922 raft_consensus.cc:2243] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.642762 28922 raft_consensus.cc:2272] T b2a76547731d4f008e06b068ba25d7d0 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.650583 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.651607 28922 raft_consensus.cc:2243] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.654289 28922 raft_consensus.cc:2272] T cf6f299d36fd4914a70ec6a42cd7b6b3 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.673287 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.674314 28922 raft_consensus.cc:2243] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.675006 28922 raft_consensus.cc:2272] T c2d9a2a7adeb4cec89a15b5825dd2b84 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.691849 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.692996 28922 raft_consensus.cc:2243] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.693903 28922 raft_consensus.cc:2272] T ec41f0b588b54cef878b9f2521faccf2 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.697275 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.698455 28922 raft_consensus.cc:2243] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.699164 28922 raft_consensus.cc:2272] T fd631ae86be54b36b7ed84e2b1b50a68 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.716516 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.720319 28922 raft_consensus.cc:2243] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.721115 28922 raft_consensus.cc:2272] T 94672ea4db5244b9ac8b5046a0149fec P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.728610 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.742568 28922 raft_consensus.cc:2243] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.743785 28922 raft_consensus.cc:2272] T 9f9d964541c4496f9e463032efb20c9a P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.746974 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.747849 28922 raft_consensus.cc:2243] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.748893 28922 raft_consensus.cc:2272] T ec65a4c4148f48d7ba5bd19407e9777b P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.751710 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.752511 28922 raft_consensus.cc:2243] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.770337 28922 raft_consensus.cc:2272] T 3bc0b5eeeb9a42c4a9407009215af4c1 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.773284 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.774111 28922 raft_consensus.cc:2243] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.775086 28922 raft_consensus.cc:2272] T 213ebf5b3e5548359ec47659f5461eed P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.777904 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.778688 28922 raft_consensus.cc:2243] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.779259 28922 raft_consensus.cc:2272] T 5acc30d61f594798856e57196b3f0490 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.788060 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.789363 28922 raft_consensus.cc:2243] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.790025 28922 raft_consensus.cc:2272] T a8c4d51b5f734584ad6775456f893f3f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.793028 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.800879 28922 raft_consensus.cc:2243] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:51.802088 28922 raft_consensus.cc:2272] T 491c3de1fd26459c8e5bb1b42dbfa546 P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.810112 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.815078 28922 raft_consensus.cc:2243] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.815676 28922 raft_consensus.cc:2272] T 8e1f2f8cedde4cd3b992d015ba644252 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.818454 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.822606 28922 raft_consensus.cc:2243] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.823226 28922 raft_consensus.cc:2272] T cbbc30fbceeb4d5089322bab45cb7e92 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.827018 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.836555 28922 raft_consensus.cc:2243] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.838431 28922 raft_consensus.cc:2272] T 7a549cce7b7f418eb35ed1c1251524b9 P f15b6c3cd4774f618572acbd29feffa2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.841387 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.842275 28922 raft_consensus.cc:2243] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.847291 28922 raft_consensus.cc:2272] T a1e914af73c7464c8a474702750e862f P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.850306 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.909956 28922 raft_consensus.cc:2243] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:51.920462 28922 raft_consensus.cc:2272] T 543ba4118aea4f4a896a49c4a10875e5 P f15b6c3cd4774f618572acbd29feffa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:51.931457 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:51.950712 28922 raft_consensus.cc:2243] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:51.958777  4560 raft_consensus.cc:670] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping [suppressed 1 similar messages]
I20260709 13:14:51.959851 28922 raft_consensus.cc:2272] T 04212fef1d744adb9d0591162c6db6b6 P f15b6c3cd4774f618572acbd29feffa2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:52.069921 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:52.070997 28922 raft_consensus.cc:2243] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:52.072356 28922 raft_consensus.cc:2272] T 84775eef96c643ac81766e32fa580a4e P f15b6c3cd4774f618572acbd29feffa2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:52.139894  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 86338.1us
I20260709 13:14:52.511620  4511 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.512210  4511 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.514321  4511 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.517441  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
W20260709 13:14:52.526999  3328 leader_election.cc:336] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.529695  3328 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.530763  4511 raft_consensus.cc:2749] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:52.572180  4491 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.572798  4491 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:52.580413  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.583096  4491 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.610158  4589 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.614262  4589 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.616585  4589 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:52.617895  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:52.623353  4595 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.624006  4595 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:52.625592  3254 leader_election.cc:336] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.627792  3254 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.628649  4502 raft_consensus.cc:2749] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:52.629177  4595 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.629963  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.630673  3359 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:52.672991  3181 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:52.680156  4516 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.681690  4516 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.693780  4563 raft_consensus.cc:2804] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.694533  4563 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.695065  4563 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.705811  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.706530  4516 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.720140  4592 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.721349  4592 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:52.723425  3254 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:52.724174  3180 leader_election.cc:336] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.724603  3254 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.724884  3180 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.725991  4516 raft_consensus.cc:2749] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:52.730085  4592 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.735602  4595 raft_consensus.cc:2749] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:52.738524  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:52.739787  3289 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
W20260709 13:14:52.740291  3328 leader_election.cc:336] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.742228  4595 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.743285  4595 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.747018  4511 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.748109  4511 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.751240  4511 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.752701  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:52.757296  3289 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:52.757625  4502 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.758988  3181 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:52.759163  4502 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.760591  4589 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:52.761059  4589 raft_consensus.cc:493] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.761466  4589 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.762384  4502 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.761936  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.757539  4595 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:52.760476  3329 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.764075  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.765935  4511 raft_consensus.cc:2804] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.767452  4511 raft_consensus.cc:493] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.767946  4511 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.769093  4516 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:52.770272  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 46305.1us
I20260709 13:14:52.770773  4516 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.778631  4516 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:52.780212  3328 leader_election.cc:336] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.783098  3328 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.783859  4592 raft_consensus.cc:2749] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:52.782389  3254 leader_election.cc:336] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.785609  3254 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.786479  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.787456  3212 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 2.
I20260709 13:14:52.788002  4602 raft_consensus.cc:2749] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:52.788769  4602 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:52.789529  3255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 67027.8us
I20260709 13:14:52.790601  3253 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:52.793551  4580 raft_consensus.cc:2804] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.793984  4580 raft_consensus.cc:493] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.794627  4580 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:52.796440  3254 leader_election.cc:336] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.801493  4602 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:52.805114  4602 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.807053  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.809703  4603 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.814074  4603 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.817159  4592 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.818552  4590 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.825985  4590 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.830003  4590 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.834753  4592 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:52.835302  4603 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.809232  4511 raft_consensus.cc:515] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:52.839422  3180 leader_election.cc:336] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.842191  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.843526  4589 raft_consensus.cc:515] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:52.845223  3254 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.846465  3254 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.849080  4502 raft_consensus.cc:2749] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:52.849359  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.850641  3359 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:52.845789  4602 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.851374  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:52.852420  3289 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:52.851795  4602 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:52.856235  4592 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.864830  4516 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.865844  4516 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.866534  3181 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:52.868085  4603 raft_consensus.cc:2804] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.868633  4603 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.869593  4603 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.870961  4511 leader_election.cc:290] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.871795  4563 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.873731  4516 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.869876  4580 raft_consensus.cc:515] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.874482  3329 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:52.874765  3212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.876120  4590 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:52.876524  4590 raft_consensus.cc:493] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.876962  4590 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.880656  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4b7ad2aa204fb1912df90f00ccde0a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:52.881901  4563 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.881265  4580 leader_election.cc:290] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.882963  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fbebd988e2438d9be8247d581ce029" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:52.883723  3210 raft_consensus.cc:3060] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.887333  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cef153cabc764fe2ba8ac3fb612bf68c" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:52.888614  3289 raft_consensus.cc:3060] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.882905  3359 raft_consensus.cc:3060] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.889997  4595 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:52.890784  3180 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.890744  4595 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:52.894479  4595 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.894866  4589 leader_election.cc:290] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:52.896544  3328 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.897516  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.908838  4580 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.914752  3289 raft_consensus.cc:2468] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 4.
I20260709 13:14:52.915354  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06abc8907064e7fa5e6b6da9b9f0104" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:52.916147  3284 raft_consensus.cc:3060] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.914959  4580 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.916704  3181 leader_election.cc:304] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:52.897174  3328 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.918028  4589 raft_consensus.cc:2804] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:52.918898  4589 raft_consensus.cc:697] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:52.920292  4589 consensus_queue.cc:237] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.921226  4592 raft_consensus.cc:2749] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:52.926622  3328 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:52.927754  3328 leader_election.cc:336] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.910514  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:52.930449  4580 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:52.930855  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:52.930353  3357 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:52.935601  3181 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:52.936527  3284 raft_consensus.cc:2468] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:52.936914  4595 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:52.909123  4602 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:52.945267  4595 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.945811  3359 raft_consensus.cc:2468] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
W20260709 13:14:52.944559  3254 leader_election.cc:336] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.945901  4595 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.949769  3254 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.955443  4502 raft_consensus.cc:2749] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:52.959204  3254 leader_election.cc:336] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:52.960078  3254 leader_election.cc:336] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.960541  3254 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.930161  3210 raft_consensus.cc:2468] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:52.951177  3181 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:52.960807  3329 leader_election.cc:304] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.964713  4502 raft_consensus.cc:2749] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:52.965018  3254 leader_election.cc:336] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.965346  4596 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:52.963320  4590 raft_consensus.cc:515] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:52.965668  3254 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:52.966216  4596 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:52.966637  4580 raft_consensus.cc:2749] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:52.970014  4563 raft_consensus.cc:2804] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.981012  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66bac0298e146bc8cbd817d3014f8ee" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:52.981746  3284 raft_consensus.cc:3060] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:52.982357  3180 leader_election.cc:336] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.973888  4592 raft_consensus.cc:2804] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.976665  4590 leader_election.cc:290] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:52.994423  3180 leader_election.cc:336] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:52.998919  3284 raft_consensus.cc:2468] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 4.
I20260709 13:14:52.999529  4603 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:53.006388  3180 leader_election.cc:336] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.006567  4596 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:53.007306  4596 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
W20260709 13:14:53.009349  3180 leader_election.cc:336] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.013439  3329 leader_election.cc:304] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.016987  4595 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.018110  4604 raft_consensus.cc:2804] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:53.018486  4502 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.018643  4604 raft_consensus.cc:697] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 4 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:53.019210  4502 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.019786  4604 consensus_queue.cc:237] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.008286  4592 raft_consensus.cc:697] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:53.023048  4592 consensus_queue.cc:237] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.024340  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:53.019495  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:53.011617  3253 leader_election.cc:304] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:53.026485  3284 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:53.017084  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63dc51b539a24310ac2d3e91b733fc8a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:53.033519  3361 raft_consensus.cc:3060] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.007925  4596 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.034199  4602 raft_consensus.cc:2804] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.038038  4595 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.039971  4602 raft_consensus.cc:697] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:53.041213  4602 consensus_queue.cc:237] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
W20260709 13:14:53.050263  3328 leader_election.cc:336] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.052699  4596 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.053794  4590 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.050272  4502 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.054834  4590 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.036580  4563 raft_consensus.cc:697] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.085471  4590 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:53.086827  3254 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.087568  3254 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 0d7210a87d254adba064447cda99b137, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:53.090545  4502 raft_consensus.cc:2749] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:53.089372  3361 raft_consensus.cc:2468] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:53.072825  4603 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.095794  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:53.096511  3284 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 2.
I20260709 13:14:53.098275  3329 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.099289  4605 raft_consensus.cc:2804] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:53.099730  4605 raft_consensus.cc:493] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.101956  4589 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.102797  4589 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.105185  4589 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:53.107795  3328 leader_election.cc:336] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.100768  3181 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.100100  4605 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.114363  3361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9d964541c4496f9e463032efb20c9a" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:53.115286  3361 raft_consensus.cc:3060] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.109603  4589 raft_consensus.cc:2804] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:53.121894  3357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137" is_pre_election: true
I20260709 13:14:53.167071  3357 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:53.124629  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:53.126320  3181 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:53.168183  3285 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 2.
I20260709 13:14:53.169127  4589 raft_consensus.cc:493] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.169735  4589 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.169988  4603 raft_consensus.cc:2804] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.170636  4603 raft_consensus.cc:697] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.171836  4603 consensus_queue.cc:237] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.141880  4563 consensus_queue.cc:237] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.145838  4590 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.188997  3361 raft_consensus.cc:2468] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 4.
I20260709 13:14:53.202345  4590 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.211714  3037 catalog_manager.cc:5697] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 3 to 4, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.217732  3038 catalog_manager.cc:5697] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.203778  3181 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
I20260709 13:14:53.223433  4590 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.225311  3036 catalog_manager.cc:5697] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:53.240705  3328 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.244094  4605 raft_consensus.cc:515] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.251678  4589 raft_consensus.cc:515] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.252997  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
W20260709 13:14:53.255535  3181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.132:43535, user_credentials={real_user=slave}} blocked reactor thread for 51845.3us
I20260709 13:14:53.255983  3289 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:53.256300  3181 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
W20260709 13:14:53.258338  3180 leader_election.cc:336] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.261307  3181 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.263827  4612 raft_consensus.cc:2804] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:53.264210  4612 raft_consensus.cc:493] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.264595  4612 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.265918  4618 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:53.266433  4618 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.266799  4618 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.262068  4605 leader_election.cc:290] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.261722  4609 raft_consensus.cc:2804] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:53.267947  4609 raft_consensus.cc:697] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.269095  4609 consensus_queue.cc:237] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
W20260709 13:14:53.270987  3180 leader_election.cc:336] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.271697  4589 leader_election.cc:290] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:53.278475  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf6f299d36fd4914a70ec6a42cd7b6b3" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:53.279232  3289 raft_consensus.cc:3060] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:53.284495  3328 leader_election.cc:336] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.276732  4589 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.286293  4589 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.290223  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:53.290933  3284 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 4.
I20260709 13:14:53.292830  3181 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.294955  4563 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:53.295557  4563 raft_consensus.cc:493] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.297731  3329 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:53.298432  3289 raft_consensus.cc:2468] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:53.302124  3285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213ebf5b3e5548359ec47659f5461eed" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:53.302953  3285 raft_consensus.cc:3060] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.296082  4563 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.305727  3181 leader_election.cc:304] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.322825  4612 raft_consensus.cc:515] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.311192  4592 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:53.300613  4589 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:53.334683  4612 leader_election.cc:290] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:53.341701  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec65a4c4148f48d7ba5bd19407e9777b" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:53.342432  3284 raft_consensus.cc:3060] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.349150  4615 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.349920  4615 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.329202  4592 raft_consensus.cc:493] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.355295  4615 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:53.356523  3289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" is_pre_election: true
I20260709 13:14:53.365623  4592 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.370682  3284 raft_consensus.cc:2468] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
I20260709 13:14:53.371052  3285 raft_consensus.cc:2468] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 3.
I20260709 13:14:53.372936  3181 leader_election.cc:304] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.373939  4603 raft_consensus.cc:2804] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.374552  4603 raft_consensus.cc:697] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.375608  4603 consensus_queue.cc:237] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.377007  4618 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.381795  4618 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7210a87d254adba064447cda99b137 (127.28.62.132:43535), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
W20260709 13:14:53.384071  3180 leader_election.cc:336] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:53.385099  3180 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:53.385855  3180 leader_election.cc:336] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.388732  3329 leader_election.cc:304] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:53.389297  4516 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.390034  4516 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.390874  3359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44413e6de00643eb907ef2494cacf07d" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d7210a87d254adba064447cda99b137"
I20260709 13:14:53.391462  3359 raft_consensus.cc:3060] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:53.392693  4620 raft_consensus.cc:2804] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.394011  3210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20" is_pre_election: true
I20260709 13:14:53.393318  4620 raft_consensus.cc:697] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:53.394726  3210 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 3.
I20260709 13:14:53.332034  4609 raft_consensus.cc:2804] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.396315  3253 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.396889  4516 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:53.398983  4602 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:53.399997  4602 raft_consensus.cc:493] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f15b6c3cd4774f618572acbd29feffa2)
I20260709 13:14:53.400583  4602 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.402130  4620 consensus_queue.cc:237] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:53.406636  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.399952  3180 leader_election.cc:336] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.408215  3359 raft_consensus.cc:2468] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 3.
W20260709 13:14:53.411903  3254 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:53.412196 28922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4238)
I20260709 13:14:53.412276  3181 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, 445754f29ffe4648a57f8124ddf8be20; no voters: 
W20260709 13:14:53.414904  3180 leader_election.cc:336] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:53.416934  3180 leader_election.cc:336] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.406569  4609 raft_consensus.cc:697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
W20260709 13:14:53.425328  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.430405  4609 consensus_queue.cc:237] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.433115  4563 raft_consensus.cc:515] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.435494  4602 raft_consensus.cc:515] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.449928  3284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bc0b5eeeb9a42c4a9407009215af4c1" candidate_uuid: "445754f29ffe4648a57f8124ddf8be20" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:53.450677  3284 raft_consensus.cc:3060] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.459926  3285 raft_consensus.cc:1275] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:14:53.461031  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.463644  4621 consensus_queue.cc:1048] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:53.468685  3180 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.469246  3180 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20; no voters: d3cae46c9c1d449fb2da72ce640e9ee4, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:53.471239  3284 raft_consensus.cc:2468] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445754f29ffe4648a57f8124ddf8be20 in term 5.
I20260709 13:14:53.473150  3181 leader_election.cc:304] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.474242  4615 raft_consensus.cc:2804] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:53.475020  3328 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.418241  4618 raft_consensus.cc:2804] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:53.477113  3180 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.474787  4615 raft_consensus.cc:697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 5 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.481259  4615 consensus_queue.cc:237] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.482393  4613 raft_consensus.cc:2749] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:53.475804  3328 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.442569  4563 leader_election.cc:290] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:53.495505  3180 leader_election.cc:336] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.488798  4592 raft_consensus.cc:515] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
I20260709 13:14:53.493636  4618 raft_consensus.cc:697] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Becoming Leader. State: Replica: 445754f29ffe4648a57f8124ddf8be20, State: Running, Role: LEADER
I20260709 13:14:53.540052  4602 leader_election.cc:290] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 election: Requested vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:53.543056  3213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84775eef96c643ac81766e32fa580a4e" candidate_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "445754f29ffe4648a57f8124ddf8be20"
I20260709 13:14:53.544480  3213 raft_consensus.cc:3060] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.543303  3210 raft_consensus.cc:1275] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:53.546900  4602 consensus_queue.cc:1048] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:53.554363  3213 raft_consensus.cc:2468] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cae46c9c1d449fb2da72ce640e9ee4 in term 4.
I20260709 13:14:53.556254  3253 leader_election.cc:304] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.565228  3287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491c3de1fd26459c8e5bb1b42dbfa546" candidate_uuid: "0d7210a87d254adba064447cda99b137" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4"
I20260709 13:14:53.565930  3287 raft_consensus.cc:3060] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:53.569918  3180 consensus_peers.cc:597] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.571832  3180 consensus_peers.cc:597] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.573762  3284 raft_consensus.cc:1275] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:53.571619  4580 raft_consensus.cc:2804] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:53.574635  3254 leader_election.cc:336] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.575450  4580 raft_consensus.cc:697] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 LEADER]: Becoming Leader. State: Replica: d3cae46c9c1d449fb2da72ce640e9ee4, State: Running, Role: LEADER
I20260709 13:14:53.576674  4580 consensus_queue.cc:237] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } }
I20260709 13:14:53.582185  4596 consensus_queue.cc:1048] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:14:53.592164  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.595171  3287 raft_consensus.cc:2468] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7210a87d254adba064447cda99b137 in term 4.
I20260709 13:14:53.599503  3329 leader_election.cc:304] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7210a87d254adba064447cda99b137, d3cae46c9c1d449fb2da72ce640e9ee4; no voters: 
I20260709 13:14:53.604367  4620 raft_consensus.cc:2804] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:53.554378  4618 consensus_queue.cc:237] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:53.634859  3287 raft_consensus.cc:1275] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:14:53.645926  3328 leader_election.cc:336] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:53.612759  4592 leader_election.cc:290] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 election: Requested vote from peers d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457), f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973)
I20260709 13:14:53.613240  4620 raft_consensus.cc:697] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 4 LEADER]: Becoming Leader. State: Replica: 0d7210a87d254adba064447cda99b137, State: Running, Role: LEADER
I20260709 13:14:53.666464  4639 consensus_queue.cc:1048] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:14:53.688731  3180 consensus_peers.cc:597] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.689555  3180 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.758198  4620 consensus_queue.cc:237] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } }
W20260709 13:14:53.776058  4630 log.cc:927] Time spent T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:14:53.785424  3254 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.792209  3361 raft_consensus.cc:1275] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:53.806393  3359 raft_consensus.cc:1275] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:53.809468  4595 consensus_queue.cc:1048] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:53.810477  4563 consensus_queue.cc:1048] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:53.833009  3180 consensus_peers.cc:597] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.838771  3180 consensus_peers.cc:597] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:53.840790  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.839496  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.843261  3180 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.846954  3360 raft_consensus.cc:1275] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:14:53.844980  3180 consensus_peers.cc:597] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.857091  4615 consensus_queue.cc:1048] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:53.860967  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.862144  3180 consensus_peers.cc:597] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:53.871999  3328 consensus_peers.cc:597] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:53.872671  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.870304  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.890329  3328 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.890930  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.891440  3328 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.891994  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.892442  3328 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.892656  3285 raft_consensus.cc:1275] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:53.894869  4615 consensus_queue.cc:1048] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:53.900487  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.913691  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.914067  3254 consensus_peers.cc:597] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:53.920126  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.951097  3038 catalog_manager.cc:5697] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.981762  3283 raft_consensus.cc:1275] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 5 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:14:53.982793  3180 consensus_peers.cc:597] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:53.952981  3038 catalog_manager.cc:5697] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.985538  3038 catalog_manager.cc:5697] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.987363  3038 catalog_manager.cc:5697] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.989056  3038 catalog_manager.cc:5697] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 3 to 4, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 4 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.991223  3038 catalog_manager.cc:5697] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 3 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.992380  4608 consensus_queue.cc:1048] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:54.004356  3180 consensus_peers.cc:597] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.011497  3180 consensus_peers.cc:597] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:53.992750  3038 catalog_manager.cc:5697] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 reported cstate change: term changed from 4 to 5, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130). New cstate: current_term: 5 leader_uuid: "445754f29ffe4648a57f8124ddf8be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.017640  3285 raft_consensus.cc:1275] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.019232  4620 consensus_queue.cc:1048] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:54.038513  3180 consensus_peers.cc:597] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:54.048643  3287 raft_consensus.cc:1275] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.050267  4613 consensus_queue.cc:1048] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:54.053748  3328 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:54.062575  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:54.072067  3213 raft_consensus.cc:1275] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Refusing update from remote peer d3cae46c9c1d449fb2da72ce640e9ee4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:54.075075  4638 consensus_queue.cc:1048] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:54.098944  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:54.116310  3357 raft_consensus.cc:1275] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Refusing update from remote peer 445754f29ffe4648a57f8124ddf8be20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:54.118706  4613 consensus_queue.cc:1048] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:54.164014  4659 log.cc:927] Time spent T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:14:54.189690  3180 consensus_peers.cc:597] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.193601  3254 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.194473  3180 consensus_peers.cc:597] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:54.210312  3328 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:54.233997  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:54.228991  3037 catalog_manager.cc:5697] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 3 to 4, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131). New cstate: current_term: 4 leader_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.236418  3037 catalog_manager.cc:5697] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 reported cstate change: term changed from 3 to 4, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } }
I20260709 13:14:54.251927  3036 catalog_manager.cc:5697] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 3 to 4, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 4 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.253975  3036 catalog_manager.cc:5697] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 reported cstate change: term changed from 2 to 3, leader changed from f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129) to 0d7210a87d254adba064447cda99b137 (127.28.62.132). New cstate: current_term: 3 leader_uuid: "0d7210a87d254adba064447cda99b137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:54.267096  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:54.270301  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:54.354883  3287 raft_consensus.cc:1275] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Refusing update from remote peer 0d7210a87d254adba064447cda99b137: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:54.356644  4605 consensus_queue.cc:1048] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:14:54.412919 28922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4238)
W20260709 13:14:54.822122  3254 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 46458.5us
W20260709 13:14:55.413519 28922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4238)
W20260709 13:14:55.553695  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.775377  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.857160  3180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:39973, user_credentials={real_user=slave}} blocked reactor thread for 45086.5us
W20260709 13:14:55.918005  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.946544  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:55.976612  3328 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.007256  3180 consensus_peers.cc:597] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.036936  3254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111) [suppressed 419 similar messages]
W20260709 13:14:56.043469  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.057894  3328 consensus_peers.cc:597] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.093847  3254 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.099900  3180 consensus_peers.cc:597] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.102226  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.181627  3180 consensus_peers.cc:597] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.202178  3180 consensus_peers.cc:597] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.214951  3254 consensus_peers.cc:597] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.219723  3180 consensus_peers.cc:597] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.236301  3328 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.271826  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.280272  3180 consensus_peers.cc:597] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.291410  3328 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.297610  3180 consensus_peers.cc:597] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.312531  3328 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.322053  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.344266  3180 consensus_peers.cc:597] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.362596  3180 consensus_peers.cc:597] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.365953  3180 consensus_peers.cc:597] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.374541  3180 consensus_peers.cc:597] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.378973  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.398195  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.409783  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.411363  3180 consensus_peers.cc:597] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.414187 28922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 4238)
W20260709 13:14:56.437743  3180 consensus_peers.cc:597] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.437633  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.439205  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.457696  3254 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.464998  3328 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.468088  3328 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.512501  3180 consensus_peers.cc:597] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.591593  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.593628  3180 consensus_peers.cc:597] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.639874  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.648276  3328 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.725744  3180 consensus_peers.cc:597] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.778339  3180 consensus_peers.cc:597] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:56.834367  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:56.995886  3180 consensus_peers.cc:597] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:57.415482 28922 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 4238)
I20260709 13:14:57.994143 28922 tablet_server.cc:196] TabletServer@127.28.62.129:39973 shutdown complete.
W20260709 13:14:58.022744  3254 consensus_peers.cc:597] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.159504 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
W20260709 13:14:58.204008  3253 consensus_peers.cc:597] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.255771 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:58.261101 28922 tablet_replica.cc:333] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.265220  3253 consensus_peers.cc:597] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.268968  3327 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.270328 28922 raft_consensus.cc:2243] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:14:58.276031  3327 consensus_peers.cc:597] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.277612 28922 raft_consensus.cc:2272] T 1752bd797b664bdc8cbfe571234287b7 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.281032 28922 tablet_replica.cc:333] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.281932 28922 raft_consensus.cc:2243] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.282519 28922 raft_consensus.cc:2272] T 29fbebd988e2438d9be8247d581ce029 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.284480  3254 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.284881 28922 tablet_replica.cc:333] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.286536 28922 raft_consensus.cc:2243] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.287524 28922 raft_consensus.cc:2272] T 84775eef96c643ac81766e32fa580a4e P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.291085 28922 tablet_replica.cc:333] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.292187 28922 raft_consensus.cc:2243] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:14:58.293504  3253 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.293586 28922 raft_consensus.cc:2272] T a8c4d51b5f734584ad6775456f893f3f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.297335 28922 tablet_replica.cc:333] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.298511 28922 raft_consensus.cc:2243] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.299791 28922 raft_consensus.cc:2272] T 5acc30d61f594798856e57196b3f0490 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.303108 28922 tablet_replica.cc:333] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.304216 28922 raft_consensus.cc:2243] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.305486 28922 raft_consensus.cc:2272] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.308650 28922 tablet_replica.cc:333] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.309744 28922 raft_consensus.cc:2243] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.310433 28922 raft_consensus.cc:2272] T ec41f0b588b54cef878b9f2521faccf2 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.317162  3327 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.319728 28922 tablet_replica.cc:333] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.321163 28922 raft_consensus.cc:2243] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.322399 28922 raft_consensus.cc:2272] T 63dc51b539a24310ac2d3e91b733fc8a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.327059 28922 tablet_replica.cc:333] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.328115 28922 raft_consensus.cc:2243] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.328779 28922 raft_consensus.cc:2272] T 06e5cb02e52a438e964626a80223bbf1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.332922 28922 tablet_replica.cc:333] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.333798  3253 consensus_peers.cc:597] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.334024 28922 raft_consensus.cc:2243] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.336694 28922 raft_consensus.cc:2272] T e0bca49e16e1444591119e2dd581d328 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.338616  3254 consensus_peers.cc:597] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.340673 28922 tablet_replica.cc:333] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.341681 28922 raft_consensus.cc:2243] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.342306 28922 raft_consensus.cc:2272] T ebc82eb45cde416fa64698383ea73ce1 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.345432 28922 tablet_replica.cc:333] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.346313 28922 raft_consensus.cc:2243] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.347610 28922 raft_consensus.cc:2272] T ec65a4c4148f48d7ba5bd19407e9777b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.351307 28922 tablet_replica.cc:333] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.352510  3253 consensus_peers.cc:597] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.352522 28922 raft_consensus.cc:2243] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.354511 28922 raft_consensus.cc:2272] T 3bc0b5eeeb9a42c4a9407009215af4c1 P 445754f29ffe4648a57f8124ddf8be20 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.359704 28922 tablet_replica.cc:333] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.360633 28922 raft_consensus.cc:2243] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.361282 28922 raft_consensus.cc:2272] T 68e1a9ca444a4778b0939095c9d3b4b9 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.364154 28922 tablet_replica.cc:333] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.365128 28922 raft_consensus.cc:2243] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.366302 28922 raft_consensus.cc:2272] T 543ba4118aea4f4a896a49c4a10875e5 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.368252  3253 consensus_peers.cc:597] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.368995  3327 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.370611 28922 tablet_replica.cc:333] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.371827 28922 raft_consensus.cc:2243] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.372525 28922 raft_consensus.cc:2272] T bd79b371bd37425ca172f8db6667a9ce P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.375815 28922 tablet_replica.cc:333] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.377224 28922 raft_consensus.cc:2243] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.378345 28922 raft_consensus.cc:2272] T 12d502876a864c95a9caf2957c69812b P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.378772  3253 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.380654  3253 consensus_peers.cc:597] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.380983  3327 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.385819  3327 consensus_peers.cc:597] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.388295 28922 tablet_replica.cc:333] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.388432  3254 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:58.389335 28922 raft_consensus.cc:2243] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.393770 28922 raft_consensus.cc:2272] T 9436ea12f5e14810aef6c3bb3c5e4f3a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.399024 28922 tablet_replica.cc:333] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.399447  3328 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.400056 28922 raft_consensus.cc:2243] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.400767 28922 raft_consensus.cc:2272] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.403954 28922 tablet_replica.cc:333] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.404906 28922 raft_consensus.cc:2243] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.406273 28922 raft_consensus.cc:2272] T cef153cabc764fe2ba8ac3fb612bf68c P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.408478  3253 consensus_peers.cc:597] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.409168 28922 tablet_replica.cc:333] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.410140 28922 raft_consensus.cc:2243] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.410782 28922 raft_consensus.cc:2272] T 161c10ebbba04c93bd1debaffb57b9f3 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.413828 28922 tablet_replica.cc:333] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.414798 28922 raft_consensus.cc:2243] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.416029 28922 raft_consensus.cc:2272] T 58c68824dda743d8b97417c774968f45 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.418977 28922 tablet_replica.cc:333] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.420007 28922 raft_consensus.cc:2243] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.420749 28922 raft_consensus.cc:2272] T d121904185e8450abb721293cc7b640f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.422761  3253 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.423931 28922 tablet_replica.cc:333] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.425009 28922 raft_consensus.cc:2243] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.425700 28922 raft_consensus.cc:2272] T 635e301b4bec4ff889241f95afc76f35 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.429136 28922 tablet_replica.cc:333] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.430094 28922 raft_consensus.cc:2243] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.431349 28922 raft_consensus.cc:2272] T 90595259a0e645f18c3ca5eafdf245f2 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.440737 28922 tablet_replica.cc:333] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.441757 28922 raft_consensus.cc:2243] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.442463 28922 raft_consensus.cc:2272] T 41e2be9da907458e82ba3b70769eaab4 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.445492 28922 tablet_replica.cc:333] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.446463 28922 raft_consensus.cc:2243] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:14:58.447117  3180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.448428 28922 raft_consensus.cc:2272] T 04212fef1d744adb9d0591162c6db6b6 P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.451505 28922 tablet_replica.cc:333] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.452407 28922 raft_consensus.cc:2243] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.453579 28922 raft_consensus.cc:2272] T 302a732ff54a4673bd480a2aa501cfa1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.456770 28922 tablet_replica.cc:333] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.457695 28922 raft_consensus.cc:2243] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.458355 28922 raft_consensus.cc:2272] T cac2abd7128a46079164d4d9c65c09af P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.461585 28922 tablet_replica.cc:333] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.462509 28922 raft_consensus.cc:2243] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.463138 28922 raft_consensus.cc:2272] T b3212147d3064988b5c1ad49eb50d04d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.466255 28922 tablet_replica.cc:333] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.467154 28922 raft_consensus.cc:2243] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.467870 28922 raft_consensus.cc:2272] T 09f56cff7d5e42d1828255add82ab240 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.468987  3254 consensus_peers.cc:597] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.471011 28922 tablet_replica.cc:333] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.472066 28922 raft_consensus.cc:2243] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.473287 28922 raft_consensus.cc:2272] T 30dfc159d3e44c748c3eba625cfb200a P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.476621 28922 tablet_replica.cc:333] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.477532 28922 raft_consensus.cc:2243] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.478621 28922 raft_consensus.cc:2272] T 0d533b92378e42ffb969e732f2b89ea5 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.481647 28922 tablet_replica.cc:333] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.482842 28922 raft_consensus.cc:2243] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.484120 28922 raft_consensus.cc:2272] T 44413e6de00643eb907ef2494cacf07d P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.485643  3327 consensus_peers.cc:597] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.487402 28922 tablet_replica.cc:333] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.488524 28922 raft_consensus.cc:2243] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.489219 28922 raft_consensus.cc:2272] T 8a5ca5ebd2fd460db5be94489079d53d P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.492389 28922 tablet_replica.cc:333] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.493449 28922 raft_consensus.cc:2243] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.494674 28922 raft_consensus.cc:2272] T 1c4b7ad2aa204fb1912df90f00ccde0a P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.497900 28922 tablet_replica.cc:333] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.498798 28922 raft_consensus.cc:2243] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.500162 28922 raft_consensus.cc:2272] T cf6f299d36fd4914a70ec6a42cd7b6b3 P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.503194 28922 tablet_replica.cc:333] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.504024 28922 raft_consensus.cc:2243] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.504648 28922 raft_consensus.cc:2272] T ba17a83551cc4376a2c46e57f9cf2ed1 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.507324 28922 tablet_replica.cc:333] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.508065 28922 raft_consensus.cc:2243] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.509123 28922 raft_consensus.cc:2272] T b2a76547731d4f008e06b068ba25d7d0 P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.511713 28922 tablet_replica.cc:333] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.512465 28922 raft_consensus.cc:2243] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.513492 28922 raft_consensus.cc:2272] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.516188 28922 tablet_replica.cc:333] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.516921 28922 raft_consensus.cc:2243] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.517992 28922 raft_consensus.cc:2272] T 0f650af1337541488d26f54b98a050df P 445754f29ffe4648a57f8124ddf8be20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.520819 28922 tablet_replica.cc:333] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.521623 28922 raft_consensus.cc:2243] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.522208 28922 raft_consensus.cc:2272] T a1e914af73c7464c8a474702750e862f P 445754f29ffe4648a57f8124ddf8be20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.524557  3328 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.525158 28922 tablet_replica.cc:333] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
W20260709 13:14:58.526666  3327 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.527303 28922 raft_consensus.cc:2243] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.528486 28922 raft_consensus.cc:2272] T 9f9d964541c4496f9e463032efb20c9a P 445754f29ffe4648a57f8124ddf8be20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.531454 28922 tablet_replica.cc:333] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20: stopping tablet replica
I20260709 13:14:58.532162 28922 raft_consensus.cc:2243] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.532848 28922 raft_consensus.cc:2272] T 94672ea4db5244b9ac8b5046a0149fec P 445754f29ffe4648a57f8124ddf8be20 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.547542  3254 consensus_peers.cc:597] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.565290  3254 consensus_peers.cc:597] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:58.583725  3327 consensus_peers.cc:597] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.596215  3327 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:58.617537  3254 consensus_peers.cc:597] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.683334  3253 consensus_peers.cc:597] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Couldn't send request to peer 445754f29ffe4648a57f8124ddf8be20. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.702860 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
W20260709 13:14:58.728889  3328 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.743762  3328 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:58.826728 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
W20260709 13:14:58.973414  3328 consensus_peers.cc:597] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:58.997892  3328 consensus_peers.cc:597] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.001082  3328 consensus_peers.cc:597] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.001864  3328 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.016954  3328 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.017561  3328 consensus_peers.cc:597] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.053650  3328 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:59.063493  3254 consensus_peers.cc:597] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.067019  3329 consensus_peers.cc:597] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:59.081740  3254 consensus_peers.cc:597] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.082832  3254 consensus_peers.cc:597] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.090620  3329 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:59.091607  3329 consensus_peers.cc:597] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:59.092427  3329 consensus_peers.cc:597] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:59.095310  3329 consensus_peers.cc:597] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.102522 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:59.106839 28922 tablet_replica.cc:333] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.108517 28922 raft_consensus.cc:2243] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.110239 28922 raft_consensus.cc:2272] T 7a549cce7b7f418eb35ed1c1251524b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.115741 28922 tablet_replica.cc:333] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.117233 28922 raft_consensus.cc:2243] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.119617 28922 raft_consensus.cc:2272] T 8a5ca5ebd2fd460db5be94489079d53d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.123138 28922 tablet_replica.cc:333] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.125294 28922 raft_consensus.cc:2243] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:14:59.126926  3328 consensus_peers.cc:597] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:59.126667 28922 raft_consensus.cc:2272] T 0125b77760be464886c1533e8749b934 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.131134 28922 tablet_replica.cc:333] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.132319 28922 raft_consensus.cc:2243] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.133457 28922 raft_consensus.cc:2272] T 1752bd797b664bdc8cbfe571234287b7 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.141767 28922 tablet_replica.cc:333] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.143117 28922 raft_consensus.cc:2243] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.144868 28922 raft_consensus.cc:2272] T 29fbebd988e2438d9be8247d581ce029 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.147090  3329 consensus_peers.cc:597] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.148151 28922 tablet_replica.cc:333] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.149451 28922 raft_consensus.cc:2243] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.150157 28922 raft_consensus.cc:2272] T cbbc30fbceeb4d5089322bab45cb7e92 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.158591  3329 consensus_peers.cc:597] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:59.162400  3329 consensus_peers.cc:597] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.160583 28922 tablet_replica.cc:333] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.168527 28922 raft_consensus.cc:2243] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.170104 28922 raft_consensus.cc:2272] T e63193ea538e42d1913abde82e22fbda P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.170791  3328 consensus_peers.cc:597] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:59.174474 28922 tablet_replica.cc:333] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.175776 28922 raft_consensus.cc:2243] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.178161 28922 raft_consensus.cc:2272] T 84775eef96c643ac81766e32fa580a4e P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.179179  3329 consensus_peers.cc:597] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.182356 28922 tablet_replica.cc:333] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.183512 28922 raft_consensus.cc:2243] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.184221 28922 raft_consensus.cc:2272] T c66bac0298e146bc8cbd817d3014f8ee P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.187551 28922 tablet_replica.cc:333] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.188704 28922 raft_consensus.cc:2243] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.189431 28922 raft_consensus.cc:2272] T bcbc57c19cbf45639b5504d44069ba50 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.193641 28922 tablet_replica.cc:333] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.194777 28922 raft_consensus.cc:2243] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.196094 28922 raft_consensus.cc:2272] T 06e5cb02e52a438e964626a80223bbf1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.200662 28922 tablet_replica.cc:333] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.201753 28922 raft_consensus.cc:2243] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.202625 28922 raft_consensus.cc:2272] T ec65a4c4148f48d7ba5bd19407e9777b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.206218 28922 tablet_replica.cc:333] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.207417 28922 raft_consensus.cc:2243] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.208806 28922 raft_consensus.cc:2272] T 3bc0b5eeeb9a42c4a9407009215af4c1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.211232  3328 consensus_peers.cc:597] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:59.211925 28922 tablet_replica.cc:333] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.212939 28922 raft_consensus.cc:2243] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.213606 28922 raft_consensus.cc:2272] T 543ba4118aea4f4a896a49c4a10875e5 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.217069 28922 tablet_replica.cc:333] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.219298 28922 raft_consensus.cc:2243] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.220012 28922 raft_consensus.cc:2272] T 68e1a9ca444a4778b0939095c9d3b4b9 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.224673 28922 tablet_replica.cc:333] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
W20260709 13:14:59.225229  3329 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.225961 28922 raft_consensus.cc:2243] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.227278 28922 raft_consensus.cc:2272] T 9436ea12f5e14810aef6c3bb3c5e4f3a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.233213 28922 tablet_replica.cc:333] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.234630 28922 raft_consensus.cc:2243] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.236050 28922 raft_consensus.cc:2272] T 9fa5d68f72ea43e8973ceedb1ddfcb4c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.247650 28922 tablet_replica.cc:333] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.248920 28922 raft_consensus.cc:2243] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.249683 28922 raft_consensus.cc:2272] T e0bca49e16e1444591119e2dd581d328 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.252948 28922 tablet_replica.cc:333] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.254020 28922 raft_consensus.cc:2243] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.255239 28922 raft_consensus.cc:2272] T eb1ead8560d7474aa8151592a32d2504 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.258549 28922 tablet_replica.cc:333] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.259406 28922 raft_consensus.cc:2243] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.260003 28922 raft_consensus.cc:2272] T 9ecb53642c2843ecaa6e646c37b94237 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.263636 28922 tablet_replica.cc:333] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.264624 28922 raft_consensus.cc:2243] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.265990 28922 raft_consensus.cc:2272] T bd79b371bd37425ca172f8db6667a9ce P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.269620 28922 tablet_replica.cc:333] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.270713 28922 raft_consensus.cc:2243] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.272049 28922 raft_consensus.cc:2272] T 12d502876a864c95a9caf2957c69812b P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.275285 28922 tablet_replica.cc:333] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.276276 28922 raft_consensus.cc:2243] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.276899 28922 raft_consensus.cc:2272] T 58c68824dda743d8b97417c774968f45 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.280043 28922 tablet_replica.cc:333] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.280978 28922 raft_consensus.cc:2243] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.282198 28922 raft_consensus.cc:2272] T d121904185e8450abb721293cc7b640f P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.285039 28922 tablet_replica.cc:333] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.285935 28922 raft_consensus.cc:2243] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.286620 28922 raft_consensus.cc:2272] T cef153cabc764fe2ba8ac3fb612bf68c P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.289708 28922 tablet_replica.cc:333] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.290671 28922 raft_consensus.cc:2243] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.291347 28922 raft_consensus.cc:2272] T fd631ae86be54b36b7ed84e2b1b50a68 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.293586  3329 consensus_peers.cc:597] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.294379 28922 tablet_replica.cc:333] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.295322 28922 raft_consensus.cc:2243] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.296039 28922 raft_consensus.cc:2272] T 302a732ff54a4673bd480a2aa501cfa1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.299222 28922 tablet_replica.cc:333] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.300165 28922 raft_consensus.cc:2243] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.300794 28922 raft_consensus.cc:2272] T d06abc8907064e7fa5e6b6da9b9f0104 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.303665 28922 tablet_replica.cc:333] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.304548 28922 raft_consensus.cc:2243] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.305745 28922 raft_consensus.cc:2272] T 635e301b4bec4ff889241f95afc76f35 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.309301 28922 tablet_replica.cc:333] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.310196 28922 raft_consensus.cc:2243] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.310758 28922 raft_consensus.cc:2272] T 54b9bc7bb2494d188055fd77fbdd0c93 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.314174 28922 tablet_replica.cc:333] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.315162 28922 raft_consensus.cc:2243] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.315811 28922 raft_consensus.cc:2272] T 90595259a0e645f18c3ca5eafdf245f2 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.327589 28922 tablet_replica.cc:333] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.331211 28922 raft_consensus.cc:2243] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.332718 28922 raft_consensus.cc:2272] T fd93a03a51b6448b86959645526e2dd1 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.336275 28922 tablet_replica.cc:333] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.337376 28922 raft_consensus.cc:2243] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.338153 28922 raft_consensus.cc:2272] T 30dfc159d3e44c748c3eba625cfb200a P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.341722 28922 tablet_replica.cc:333] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.342145  4685 raft_consensus.cc:493] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.342780 28922 raft_consensus.cc:2243] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.342912  4685 raft_consensus.cc:515] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.346573  4685 leader_election.cc:290] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.348371  3328 consensus_peers.cc:597] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:59.343708 28922 raft_consensus.cc:2272] T cf6f299d36fd4914a70ec6a42cd7b6b3 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.358649 28922 tablet_replica.cc:333] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.359727 28922 raft_consensus.cc:2243] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.360562 28922 raft_consensus.cc:2272] T b2a76547731d4f008e06b068ba25d7d0 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.364053 28922 tablet_replica.cc:333] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.365036 28922 raft_consensus.cc:2243] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.366287 28922 raft_consensus.cc:2272] T 41e2be9da907458e82ba3b70769eaab4 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.369725 28922 tablet_replica.cc:333] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.370761 28922 raft_consensus.cc:2243] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.372119 28922 raft_consensus.cc:2272] T 8e1f2f8cedde4cd3b992d015ba644252 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.357692  3327 leader_election.cc:336] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.375298 28922 tablet_replica.cc:333] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.376487 28922 raft_consensus.cc:2243] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.377333 28922 raft_consensus.cc:2272] T 491c3de1fd26459c8e5bb1b42dbfa546 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.378075  3328 leader_election.cc:336] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:59.381255 28922 tablet_replica.cc:333] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.378633  3328 leader_election.cc:304] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.382460 28922 raft_consensus.cc:2243] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.383513 28922 raft_consensus.cc:2272] T fd0c04ed8911404c8d0a9c6aecbf3f71 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.387115 28922 tablet_replica.cc:333] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.388092 28922 raft_consensus.cc:2243] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.388782 28922 raft_consensus.cc:2272] T 0f650af1337541488d26f54b98a050df P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.392499 28922 tablet_replica.cc:333] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.393051  4666 raft_consensus.cc:493] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.393682 28922 raft_consensus.cc:2243] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.393740  4666 raft_consensus.cc:515] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.394547 28922 raft_consensus.cc:2272] T 213ebf5b3e5548359ec47659f5461eed P d3cae46c9c1d449fb2da72ce640e9ee4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.396225  4666 leader_election.cc:290] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
I20260709 13:14:59.398108 28922 tablet_replica.cc:333] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.399187 28922 raft_consensus.cc:2243] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.399960 28922 raft_consensus.cc:2272] T cac2abd7128a46079164d4d9c65c09af P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.402809  4671 raft_consensus.cc:2749] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:59.403798 28922 tablet_replica.cc:333] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
I20260709 13:14:59.404919 28922 raft_consensus.cc:2243] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:59.406101 28922 raft_consensus.cc:2272] T b3212147d3064988b5c1ad49eb50d04d P d3cae46c9c1d449fb2da72ce640e9ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:59.409260 28922 tablet_replica.cc:333] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4: stopping tablet replica
W20260709 13:14:59.409971  3329 consensus_peers.cc:597] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 -> Peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Couldn't send request to peer d3cae46c9c1d449fb2da72ce640e9ee4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:59.410073 28922 raft_consensus.cc:2243] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:59.411705 28922 raft_consensus.cc:2272] T 04212fef1d744adb9d0591162c6db6b6 P d3cae46c9c1d449fb2da72ce640e9ee4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:59.426764  3327 leader_election.cc:336] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
W20260709 13:14:59.438290  3328 consensus_peers.cc:597] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 -> Peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Couldn't send request to peer f15b6c3cd4774f618572acbd29feffa2. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:59.440832  3328 leader_election.cc:336] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:59.441512  4671 raft_consensus.cc:493] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.444826  4671 raft_consensus.cc:515] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
W20260709 13:14:59.451679  3329 leader_election.cc:336] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:59.452697  4671 leader_election.cc:290] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
I20260709 13:14:59.453418  3328 leader_election.cc:304] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.458987  4671 raft_consensus.cc:2749] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:59.468287  3327 leader_election.cc:336] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.468773  3327 leader_election.cc:304] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:59.470068  4671 raft_consensus.cc:2749] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:59.579937  4666 raft_consensus.cc:493] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.580582  4666 raft_consensus.cc:515] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:59.583110  4666 leader_election.cc:290] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:59.588559  3327 leader_election.cc:336] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
W20260709 13:14:59.591646  3329 leader_election.cc:336] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Network error: Client connection negotiation failed: client connection to 127.28.62.131:35457: connect: Connection refused (error 111)
I20260709 13:14:59.592255  3329 leader_election.cc:304] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:59.593168  4666 raft_consensus.cc:2749] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.619150  4666 raft_consensus.cc:493] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.619803  4666 raft_consensus.cc:515] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.622242  4666 leader_election.cc:290] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.627524  3328 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:59.628824  3327 leader_election.cc:336] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.629335  3327 leader_election.cc:304] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.630225  4666 raft_consensus.cc:2749] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.717658  4667 raft_consensus.cc:493] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.719064  4667 raft_consensus.cc:515] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:59.723049  4667 leader_election.cc:290] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:59.732767  3327 leader_election.cc:336] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
W20260709 13:14:59.738171  3329 leader_election.cc:336] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Network error: Client connection negotiation failed: client connection to 127.28.62.131:35457: connect: Connection refused (error 111)
I20260709 13:14:59.739068  3329 leader_election.cc:304] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
I20260709 13:14:59.741232  4667 raft_consensus.cc:2749] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:59.742769  4667 raft_consensus.cc:493] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.743364  4667 raft_consensus.cc:515] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.745879  4667 leader_election.cc:290] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.754436  3328 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:59.757503  3327 leader_election.cc:336] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.758114  3327 leader_election.cc:304] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.759006  4667 raft_consensus.cc:2749] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.762806  4667 raft_consensus.cc:493] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.763342  4667 raft_consensus.cc:515] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.765408  4667 leader_election.cc:290] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.770870  3328 leader_election.cc:336] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:59.773113  3327 leader_election.cc:336] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.773624  3327 leader_election.cc:304] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.774451  4667 raft_consensus.cc:2749] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.782503  4667 raft_consensus.cc:493] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.783022  4667 raft_consensus.cc:515] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:59.785080  4667 leader_election.cc:290] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:59.789196  3327 leader_election.cc:336] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.790936 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:14:59.826507  4666 raft_consensus.cc:493] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.827211  4666 raft_consensus.cc:515] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.829522  4666 leader_election.cc:290] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.836313  3328 leader_election.cc:336] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
W20260709 13:14:59.837776  3327 leader_election.cc:336] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.838238  3327 leader_election.cc:304] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.839669  4666 raft_consensus.cc:2749] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.840915  4667 raft_consensus.cc:493] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.841552  4667 raft_consensus.cc:515] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } } peers { permanent_uuid: "d3cae46c9c1d449fb2da72ce640e9ee4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 35457 } } peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } }
I20260709 13:14:59.845080  4667 leader_election.cc:290] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533), d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457)
W20260709 13:14:59.847460  3327 leader_election.cc:336] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
I20260709 13:14:59.893013  4667 raft_consensus.cc:493] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:14:59.894116  4667 raft_consensus.cc:515] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:14:59.897904  4667 leader_election.cc:290] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:14:59.905779  3327 leader_election.cc:336] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
W20260709 13:14:59.906535  3328 leader_election.cc:336] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:14:59.907052  3328 leader_election.cc:304] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:14:59.907737 28922 tablet_server.cc:179] TabletServer@127.28.62.132:0 shutting down...
I20260709 13:14:59.907758  4666 raft_consensus.cc:2749] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.064487  4666 raft_consensus.cc:493] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 445754f29ffe4648a57f8124ddf8be20)
I20260709 13:15:00.065109  4666 raft_consensus.cc:515] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d7210a87d254adba064447cda99b137" member_type: VOTER last_known_addr { host: "127.28.62.132" port: 43535 } } peers { permanent_uuid: "f15b6c3cd4774f618572acbd29feffa2" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 39973 } } peers { permanent_uuid: "445754f29ffe4648a57f8124ddf8be20" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 46533 } }
I20260709 13:15:00.070470  4666 leader_election.cc:290] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973), 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533)
W20260709 13:15:00.082024  3327 leader_election.cc:336] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 445754f29ffe4648a57f8124ddf8be20 (127.28.62.130:46533): Network error: Client connection negotiation failed: client connection to 127.28.62.130:46533: connect: Connection refused (error 111)
W20260709 13:15:00.083076  3328 leader_election.cc:336] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f15b6c3cd4774f618572acbd29feffa2 (127.28.62.129:39973): Network error: Client connection negotiation failed: client connection to 127.28.62.129:39973: connect: Connection refused (error 111)
I20260709 13:15:00.083561  3328 leader_election.cc:304] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, f15b6c3cd4774f618572acbd29feffa2
I20260709 13:15:00.084407  4667 raft_consensus.cc:2749] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.100428 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:00.101755 28922 tablet_replica.cc:333] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.102888 28922 raft_consensus.cc:2243] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.103590 28922 raft_consensus.cc:2272] T 0125b77760be464886c1533e8749b934 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.106094 28922 tablet_replica.cc:333] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.106745 28922 raft_consensus.cc:2243] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.107276 28922 raft_consensus.cc:2272] T 1752bd797b664bdc8cbfe571234287b7 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.109323 28922 tablet_replica.cc:333] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.110019 28922 raft_consensus.cc:2243] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.111169 28922 raft_consensus.cc:2272] T cbbc30fbceeb4d5089322bab45cb7e92 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.114079 28922 tablet_replica.cc:333] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.115147 28922 raft_consensus.cc:2243] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.115655 28922 raft_consensus.cc:2272] T a8c4d51b5f734584ad6775456f893f3f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.118378 28922 tablet_replica.cc:333] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.119161 28922 raft_consensus.cc:2243] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.119670 28922 raft_consensus.cc:2272] T 5acc30d61f594798856e57196b3f0490 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.122043 28922 tablet_replica.cc:333] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.122695 28922 raft_consensus.cc:2243] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.123193 28922 raft_consensus.cc:2272] T e63193ea538e42d1913abde82e22fbda P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.125767 28922 tablet_replica.cc:333] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.126446 28922 raft_consensus.cc:2243] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.126964 28922 raft_consensus.cc:2272] T c2d9a2a7adeb4cec89a15b5825dd2b84 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.129096 28922 tablet_replica.cc:333] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.129786 28922 raft_consensus.cc:2243] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.130679 28922 raft_consensus.cc:2272] T ec41f0b588b54cef878b9f2521faccf2 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.132798 28922 tablet_replica.cc:333] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.133476 28922 raft_consensus.cc:2243] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.134364 28922 raft_consensus.cc:2272] T c66bac0298e146bc8cbd817d3014f8ee P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.136363 28922 tablet_replica.cc:333] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.137006 28922 raft_consensus.cc:2243] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.137632 28922 raft_consensus.cc:2272] T 63dc51b539a24310ac2d3e91b733fc8a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.140612 28922 tablet_replica.cc:333] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.141363 28922 raft_consensus.cc:2243] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.142014 28922 raft_consensus.cc:2272] T 06e5cb02e52a438e964626a80223bbf1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.144918 28922 tablet_replica.cc:333] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.145731 28922 raft_consensus.cc:2243] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.146726 28922 raft_consensus.cc:2272] T bcbc57c19cbf45639b5504d44069ba50 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.149031 28922 tablet_replica.cc:333] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.149682 28922 raft_consensus.cc:2243] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.150410 28922 raft_consensus.cc:2272] T 68e1a9ca444a4778b0939095c9d3b4b9 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.152743 28922 tablet_replica.cc:333] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.153548 28922 raft_consensus.cc:2243] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.154081 28922 raft_consensus.cc:2272] T bd79b371bd37425ca172f8db6667a9ce P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.156001 28922 tablet_replica.cc:333] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.156534 28922 raft_consensus.cc:2243] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.156942 28922 raft_consensus.cc:2272] T 12d502876a864c95a9caf2957c69812b P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.159421 28922 tablet_replica.cc:333] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.159955 28922 raft_consensus.cc:2243] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.160696 28922 raft_consensus.cc:2272] T 161c10ebbba04c93bd1debaffb57b9f3 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.162950 28922 tablet_replica.cc:333] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.163551 28922 raft_consensus.cc:2243] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.164254 28922 raft_consensus.cc:2272] T fd631ae86be54b36b7ed84e2b1b50a68 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.166195 28922 tablet_replica.cc:333] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.166754 28922 raft_consensus.cc:2243] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.167148 28922 raft_consensus.cc:2272] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.168998 28922 tablet_replica.cc:333] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.169667 28922 raft_consensus.cc:2243] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.170068 28922 raft_consensus.cc:2272] T d121904185e8450abb721293cc7b640f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.172037 28922 tablet_replica.cc:333] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.172539 28922 raft_consensus.cc:2243] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.173174 28922 raft_consensus.cc:2272] T d06abc8907064e7fa5e6b6da9b9f0104 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.175050 28922 tablet_replica.cc:333] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.175547 28922 raft_consensus.cc:2243] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.175921 28922 raft_consensus.cc:2272] T 90595259a0e645f18c3ca5eafdf245f2 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.178001 28922 tablet_replica.cc:333] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.178550 28922 raft_consensus.cc:2243] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.179200 28922 raft_consensus.cc:2272] T 54b9bc7bb2494d188055fd77fbdd0c93 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.181177 28922 tablet_replica.cc:333] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.181951 28922 raft_consensus.cc:2243] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.182528 28922 raft_consensus.cc:2272] T fd93a03a51b6448b86959645526e2dd1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.185151 28922 tablet_replica.cc:333] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.185859 28922 raft_consensus.cc:2243] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.186359 28922 raft_consensus.cc:2272] T 8e1f2f8cedde4cd3b992d015ba644252 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.188778 28922 tablet_replica.cc:333] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.189504 28922 raft_consensus.cc:2243] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.190243 28922 raft_consensus.cc:2272] T 491c3de1fd26459c8e5bb1b42dbfa546 P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.192203 28922 tablet_replica.cc:333] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.192791 28922 raft_consensus.cc:2243] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.193244 28922 raft_consensus.cc:2272] T 41e2be9da907458e82ba3b70769eaab4 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.195238 28922 tablet_replica.cc:333] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.195814 28922 raft_consensus.cc:2243] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.196540 28922 raft_consensus.cc:2272] T 213ebf5b3e5548359ec47659f5461eed P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.198565 28922 tablet_replica.cc:333] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.199124 28922 raft_consensus.cc:2243] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.199548 28922 raft_consensus.cc:2272] T 7a549cce7b7f418eb35ed1c1251524b9 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.201597 28922 tablet_replica.cc:333] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.202190 28922 raft_consensus.cc:2243] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.203020 28922 raft_consensus.cc:2272] T a1e914af73c7464c8a474702750e862f P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.205036 28922 tablet_replica.cc:333] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.205803 28922 raft_consensus.cc:2243] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.206385 28922 raft_consensus.cc:2272] T 0d533b92378e42ffb969e732f2b89ea5 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.208930 28922 tablet_replica.cc:333] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.209617 28922 raft_consensus.cc:2243] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.210551 28922 raft_consensus.cc:2272] T 44413e6de00643eb907ef2494cacf07d P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:00.212491  3329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.213212 28922 tablet_replica.cc:333] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.214395 28922 raft_consensus.cc:2243] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.214941 28922 raft_consensus.cc:2272] T 1c4b7ad2aa204fb1912df90f00ccde0a P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.216975 28922 tablet_replica.cc:333] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.217787 28922 raft_consensus.cc:2243] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.218245 28922 raft_consensus.cc:2272] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.220443 28922 tablet_replica.cc:333] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.221113 28922 raft_consensus.cc:2243] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.221632 28922 raft_consensus.cc:2272] T 0f650af1337541488d26f54b98a050df P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.223682 28922 tablet_replica.cc:333] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.224256 28922 raft_consensus.cc:2243] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.225140 28922 raft_consensus.cc:2272] T 09f56cff7d5e42d1828255add82ab240 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.227857 28922 tablet_replica.cc:333] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.228430 28922 raft_consensus.cc:2243] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.229244 28922 raft_consensus.cc:2272] T ba17a83551cc4376a2c46e57f9cf2ed1 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.231495 28922 tablet_replica.cc:333] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.232153 28922 raft_consensus.cc:2243] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.232816 28922 raft_consensus.cc:2272] T e0bca49e16e1444591119e2dd581d328 P 0d7210a87d254adba064447cda99b137 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.234979 28922 tablet_replica.cc:333] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.235607 28922 raft_consensus.cc:2243] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.236049 28922 raft_consensus.cc:2272] T eb1ead8560d7474aa8151592a32d2504 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.238071 28922 tablet_replica.cc:333] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.238575 28922 raft_consensus.cc:2243] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.239300 28922 raft_consensus.cc:2272] T ebc82eb45cde416fa64698383ea73ce1 P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.241173 28922 tablet_replica.cc:333] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.241791 28922 raft_consensus.cc:2243] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.242393 28922 raft_consensus.cc:2272] T 9ecb53642c2843ecaa6e646c37b94237 P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.244234 28922 tablet_replica.cc:333] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.244726 28922 raft_consensus.cc:2243] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.245121 28922 raft_consensus.cc:2272] T 9f9d964541c4496f9e463032efb20c9a P 0d7210a87d254adba064447cda99b137 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.247038 28922 tablet_replica.cc:333] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.247498 28922 raft_consensus.cc:2243] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.249339 28922 raft_consensus.cc:2272] T 94672ea4db5244b9ac8b5046a0149fec P 0d7210a87d254adba064447cda99b137 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.251461 28922 tablet_replica.cc:333] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.252045 28922 raft_consensus.cc:2243] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.252784 28922 raft_consensus.cc:2272] T cac2abd7128a46079164d4d9c65c09af P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.255613 28922 tablet_replica.cc:333] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137: stopping tablet replica
I20260709 13:15:00.256162 28922 raft_consensus.cc:2243] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.256641 28922 raft_consensus.cc:2272] T b3212147d3064988b5c1ad49eb50d04d P 0d7210a87d254adba064447cda99b137 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:00.287143  3330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.442127  3327 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.495198  3328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.517616  3327 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.557971  3329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.664453  3329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.676199  3329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.727020  3327 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.729315  3330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.756875  4688 leader_election.cc:336] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Service unavailable: reactor is shutting down (error 108)
I20260709 13:15:00.757365  4688 leader_election.cc:304] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:15:00.757982  4688 raft_consensus.cc:2686] T fd0c04ed8911404c8d0a9c6aecbf3f71 P 0d7210a87d254adba064447cda99b137: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 13:15:00.759930  4688 leader_election.cc:336] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d3cae46c9c1d449fb2da72ce640e9ee4 (127.28.62.131:35457): Service unavailable: reactor is shutting down (error 108)
I20260709 13:15:00.760365  4688 leader_election.cc:304] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7210a87d254adba064447cda99b137; no voters: 445754f29ffe4648a57f8124ddf8be20, d3cae46c9c1d449fb2da72ce640e9ee4
W20260709 13:15:00.761057  4688 raft_consensus.cc:2686] T 58c68824dda743d8b97417c774968f45 P 0d7210a87d254adba064447cda99b137: unable to run election callback: Service unavailable: The pool has been shut down.
I20260709 13:15:00.772554 28922 tablet_server.cc:196] TabletServer@127.28.62.132:0 shutdown complete.
I20260709 13:15:00.845431 28922 master.cc:562] Master@127.28.62.190:41111 shutting down...
I20260709 13:15:00.874316 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:00.874971 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.875272 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 486352c3a45b4734aca4453334f7e74e: stopping tablet replica
W20260709 13:15:00.994033  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd7a0 after lost signal to thread 28925
W20260709 13:15:00.995075  3070 debug-util.cc:398] Leaking SignalData structure 0x7b08001a59e0 after lost signal to thread 3073
I20260709 13:15:01.827970 28922 master.cc:584] Master@127.28.62.190:41111 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (50412 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:15:01.932094 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:39513
I20260709 13:15:01.933880 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:01.940752  4689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:01.940862  4690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:01.941161  4692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:01.942303 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:01.943564 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:01.943791 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:01.943925 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602901943913 us; error 0 us; skew 500 ppm
I20260709 13:15:01.944407 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:01.947113 28922 webserver.cc:533] Webserver started at http://127.28.62.190:45323/ using document root <none> and password file <none>
I20260709 13:15:01.947623 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:01.947779 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:01.948051 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:01.949146 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "dbcea0935a9b4788bb1839e8add5d8db"
format_stamp: "Formatted at 2026-07-09 13:15:01 on dist-test-slave-50cs"
I20260709 13:15:01.953910 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:15:01.957691  4697 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:01.958974 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:01.959323 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "dbcea0935a9b4788bb1839e8add5d8db"
format_stamp: "Formatted at 2026-07-09 13:15:01 on dist-test-slave-50cs"
I20260709 13:15:01.959599 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:01.985606 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:01.986856 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.033309 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:39513
I20260709 13:15:02.033514  4748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:39513 every 8 connection(s)
I20260709 13:15:02.037774  4749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.050081  4749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db: Bootstrap starting.
I20260709 13:15:02.055626  4749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.060460  4749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db: No bootstrap required, opened a new log
I20260709 13:15:02.062950  4749 raft_consensus.cc:359] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER }
I20260709 13:15:02.063386  4749 raft_consensus.cc:385] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:02.063566  4749 raft_consensus.cc:740] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbcea0935a9b4788bb1839e8add5d8db, State: Initialized, Role: FOLLOWER
I20260709 13:15:02.064179  4749 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER }
I20260709 13:15:02.064620  4749 raft_consensus.cc:399] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:02.064916  4749 raft_consensus.cc:493] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:02.065199  4749 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:02.070029  4749 raft_consensus.cc:515] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER }
I20260709 13:15:02.070614  4749 leader_election.cc:304] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbcea0935a9b4788bb1839e8add5d8db; no voters: 
I20260709 13:15:02.071904  4749 leader_election.cc:290] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:02.072283  4752 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:02.073761  4752 raft_consensus.cc:697] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 1 LEADER]: Becoming Leader. State: Replica: dbcea0935a9b4788bb1839e8add5d8db, State: Running, Role: LEADER
I20260709 13:15:02.074496  4752 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER }
I20260709 13:15:02.074909  4749 sys_catalog.cc:565] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:02.079926  4754 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbcea0935a9b4788bb1839e8add5d8db. Latest consensus state: current_term: 1 leader_uuid: "dbcea0935a9b4788bb1839e8add5d8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER } }
I20260709 13:15:02.081701  4754 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.080050  4753 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbcea0935a9b4788bb1839e8add5d8db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcea0935a9b4788bb1839e8add5d8db" member_type: VOTER } }
I20260709 13:15:02.083429  4753 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:02.089747  4760 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:02.097350  4760 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:02.098593 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:02.106923  4760 catalog_manager.cc:1383] Generated new cluster ID: 6ebcfa5bd35c451db1da37f7bbf291c2
I20260709 13:15:02.107256  4760 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:02.146878  4760 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:02.148394  4760 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:02.165246  4760 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db: Generated new TSK 0
I20260709 13:15:02.166139  4760 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:02.230340 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.236791  4770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.238107  4771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.240355  4773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.240438 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:02.242115 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.242319 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.242440 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602902242429 us; error 0 us; skew 500 ppm
I20260709 13:15:02.242913 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.245589 28922 webserver.cc:533] Webserver started at http://127.28.62.129:46021/ using document root <none> and password file <none>
I20260709 13:15:02.246064 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.246224 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.246467 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.247597 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "c21911b82a6b4f9f888cf1400df3ad21"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.252421 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:15:02.256556  4778 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.257540 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:02.257858 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "c21911b82a6b4f9f888cf1400df3ad21"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.258140 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.279294 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.280516 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.282138 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.284590 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.284775 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.285101 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.285292 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.331120 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:45365
I20260709 13:15:02.331378  4840 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:45365 every 8 connection(s)
I20260709 13:15:02.336465 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.344442  4845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.347214  4846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.347724 28922 server_base.cc:1061] running on GCE node
W20260709 13:15:02.349042  4848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.350289 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:02.350519 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.350714 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602902350699 us; error 0 us; skew 500 ppm
I20260709 13:15:02.351243 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.354508 28922 webserver.cc:533] Webserver started at http://127.28.62.130:38985/ using document root <none> and password file <none>
I20260709 13:15:02.355186 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.355432 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.355793 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.356964 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "10eb54c560144c0f9dc735ef9be91cad"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.357731  4841 heartbeater.cc:344] Connected to a master server at 127.28.62.190:39513
I20260709 13:15:02.358253  4841 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:02.359759  4841 heartbeater.cc:507] Master 127.28.62.190:39513 requested a full tablet report, sending...
I20260709 13:15:02.362242 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:15:02.362367  4714 ts_manager.cc:194] Registered new tserver with Master: c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365)
I20260709 13:15:02.364349  4714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55476
I20260709 13:15:02.367204  4853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.368350 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:02.368788 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "10eb54c560144c0f9dc735ef9be91cad"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.369093 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.384348 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.385689 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.387316 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.389869 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.390122 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.390394 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.390614 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.437670 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:36395
I20260709 13:15:02.437855  4915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:36395 every 8 connection(s)
I20260709 13:15:02.442917 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:02.450419  4919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.453002  4920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:02.455487  4922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:02.455622 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:02.457027  4916 heartbeater.cc:344] Connected to a master server at 127.28.62.190:39513
I20260709 13:15:02.457229 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:02.457537  4916 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:02.457587 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:02.457974 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602902457956 us; error 0 us; skew 500 ppm
I20260709 13:15:02.458491  4916 heartbeater.cc:507] Master 127.28.62.190:39513 requested a full tablet report, sending...
I20260709 13:15:02.458590 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:02.461059  4714 ts_manager.cc:194] Registered new tserver with Master: 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:02.461802 28922 webserver.cc:533] Webserver started at http://127.28.62.131:42781/ using document root <none> and password file <none>
I20260709 13:15:02.462446 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:02.462666 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:02.462642  4714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55480
I20260709 13:15:02.463150 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:02.464560 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "471b23bc542341c2ac372eac52b17a78"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.469805 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 13:15:02.473872  4927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.474748 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:02.475113 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "471b23bc542341c2ac372eac52b17a78"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:02.475423 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:02.486091 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:02.487812 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:02.489573 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:02.492349 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:02.492636 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.492933 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:02.493129 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:02.539824 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:43261
I20260709 13:15:02.539942  4989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:43261 every 8 connection(s)
I20260709 13:15:02.556460  4990 heartbeater.cc:344] Connected to a master server at 127.28.62.190:39513
I20260709 13:15:02.556911  4990 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:02.557749  4990 heartbeater.cc:507] Master 127.28.62.190:39513 requested a full tablet report, sending...
I20260709 13:15:02.560045  4714 ts_manager.cc:194] Registered new tserver with Master: 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:02.560432 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01726073s
I20260709 13:15:02.561681  4714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55492
I20260709 13:15:02.591141  4714 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55506:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:02.594225  4714 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:02.695181  4806 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcbcd79f9b5486587ed2ad92b0dac34 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:02.696024  4805 tablet_service.cc:1511] Processing CreateTablet for tablet 4c56d34b705b4a0e83159cd91a0bdd2b (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:02.696811  4806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcbcd79f9b5486587ed2ad92b0dac34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.697547  4805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c56d34b705b4a0e83159cd91a0bdd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.701264  4804 tablet_service.cc:1511] Processing CreateTablet for tablet 0023a413de544e98bf4dcc5242e2bfc9 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:02.702838  4804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0023a413de544e98bf4dcc5242e2bfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.706795  4803 tablet_service.cc:1511] Processing CreateTablet for tablet e33da5b7d1a743a4939aa6898bb11b93 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:02.708387  4803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33da5b7d1a743a4939aa6898bb11b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.708076  4955 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcbcd79f9b5486587ed2ad92b0dac34 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:02.709707  4955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcbcd79f9b5486587ed2ad92b0dac34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.711879  4802 tablet_service.cc:1511] Processing CreateTablet for tablet d70b5ff38ad24132a0e9a1ffc0c64210 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:02.713788  4802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b5ff38ad24132a0e9a1ffc0c64210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.714460  4954 tablet_service.cc:1511] Processing CreateTablet for tablet 4c56d34b705b4a0e83159cd91a0bdd2b (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:02.715881  4954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c56d34b705b4a0e83159cd91a0bdd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.726791  4953 tablet_service.cc:1511] Processing CreateTablet for tablet 0023a413de544e98bf4dcc5242e2bfc9 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:02.733261  4953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0023a413de544e98bf4dcc5242e2bfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.742843  4952 tablet_service.cc:1511] Processing CreateTablet for tablet e33da5b7d1a743a4939aa6898bb11b93 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:02.744444  4952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33da5b7d1a743a4939aa6898bb11b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.760097  4951 tablet_service.cc:1511] Processing CreateTablet for tablet d70b5ff38ad24132a0e9a1ffc0c64210 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:02.760538  4881 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcbcd79f9b5486587ed2ad92b0dac34 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:02.762831  4880 tablet_service.cc:1511] Processing CreateTablet for tablet 4c56d34b705b4a0e83159cd91a0bdd2b (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:02.764319  4880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c56d34b705b4a0e83159cd91a0bdd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.764875  4801 tablet_service.cc:1511] Processing CreateTablet for tablet 5a283a436eb74802b938b5f9369c89fe (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:02.766996  4879 tablet_service.cc:1511] Processing CreateTablet for tablet 0023a413de544e98bf4dcc5242e2bfc9 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:02.768074  4801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a283a436eb74802b938b5f9369c89fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.770311  4878 tablet_service.cc:1511] Processing CreateTablet for tablet e33da5b7d1a743a4939aa6898bb11b93 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:02.772611  4877 tablet_service.cc:1511] Processing CreateTablet for tablet d70b5ff38ad24132a0e9a1ffc0c64210 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:02.774596  4951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b5ff38ad24132a0e9a1ffc0c64210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.779312  4879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0023a413de544e98bf4dcc5242e2bfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.785919  4881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcbcd79f9b5486587ed2ad92b0dac34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.789093  4877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b5ff38ad24132a0e9a1ffc0c64210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.797961  4878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33da5b7d1a743a4939aa6898bb11b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.806260  4876 tablet_service.cc:1511] Processing CreateTablet for tablet 5a283a436eb74802b938b5f9369c89fe (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:02.808034  4876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a283a436eb74802b938b5f9369c89fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.826416  4950 tablet_service.cc:1511] Processing CreateTablet for tablet 5a283a436eb74802b938b5f9369c89fe (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:02.843231  5005 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:02.843344  4950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a283a436eb74802b938b5f9369c89fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.853267  5005 tablet_bootstrap.cc:654] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.876971  5007 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:02.877900  5008 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:02.884093  5007 tablet_bootstrap.cc:654] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.884148  5008 tablet_bootstrap.cc:654] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:02.891343  5005 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:02.892124  5005 ts_tablet_manager.cc:1403] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.010s
I20260709 13:15:02.929167  4803 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:02.940445  4803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.954854  4880 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:02.967358  5005 raft_consensus.cc:359] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:02.969574  5005 raft_consensus.cc:385] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:02.969758  5007 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:02.970088  5005 raft_consensus.cc:740] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:02.970973  5007 ts_tablet_manager.cc:1403] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.000s
I20260709 13:15:02.971809  5005 consensus_queue.cc:260] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:02.975950  4880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.979871  5007 raft_consensus.cc:359] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:02.981112  5007 raft_consensus.cc:385] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:02.981528  5007 raft_consensus.cc:740] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:02.982909  5007 consensus_queue.cc:260] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:02.987350  5005 ts_tablet_manager.cc:1434] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.013s
I20260709 13:15:02.987784  4952 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:02.988672  4841 heartbeater.cc:499] Master 127.28.62.190:39513 was elected leader, sending a full tablet report...
I20260709 13:15:02.989214  5005 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:02.989948  4952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5859b32cbc48bd9fddf1bc2a3be7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.996155  4801 tablet_service.cc:1511] Processing CreateTablet for tablet 53278a260d6d484ab3614e3ab2c69780 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:02.997387  5008 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:02.996778  4951 tablet_service.cc:1511] Processing CreateTablet for tablet 53278a260d6d484ab3614e3ab2c69780 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:02.998198  4801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53278a260d6d484ab3614e3ab2c69780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.998327  5008 ts_tablet_manager.cc:1403] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.004s
I20260709 13:15:02.998829  4951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53278a260d6d484ab3614e3ab2c69780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.004339  4878 tablet_service.cc:1511] Processing CreateTablet for tablet 23510825c22a4843958883c7f521c5e2 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:03.010661  4878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23510825c22a4843958883c7f521c5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.003645  4805 tablet_service.cc:1511] Processing CreateTablet for tablet 23510825c22a4843958883c7f521c5e2 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:03.020445  4805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23510825c22a4843958883c7f521c5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.024955  5007 ts_tablet_manager.cc:1434] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.053s	user 0.015s	sys 0.016s
I20260709 13:15:03.026628  4990 heartbeater.cc:499] Master 127.28.62.190:39513 was elected leader, sending a full tablet report...
I20260709 13:15:03.027200  5008 raft_consensus.cc:359] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.028167  5008 raft_consensus.cc:385] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.028463  5008 raft_consensus.cc:740] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.004942  4876 tablet_service.cc:1511] Processing CreateTablet for tablet 53278a260d6d484ab3614e3ab2c69780 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:03.037653  4876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53278a260d6d484ab3614e3ab2c69780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.044163  5014 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.044384  4991 tablet.cc:2406] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:03.045632  5005 tablet_bootstrap.cc:654] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.046693  5008 consensus_queue.cc:260] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.033516  5007 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.058678  4881 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec2bfff7bb248d5b097081998724f71 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:03.061864  4881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec2bfff7bb248d5b097081998724f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.064726  5014 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.058739  4950 tablet_service.cc:1511] Processing CreateTablet for tablet 23510825c22a4843958883c7f521c5e2 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:03.055279  4804 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec2bfff7bb248d5b097081998724f71 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:03.067842  4804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec2bfff7bb248d5b097081998724f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.080765  4953 tablet_service.cc:1511] Processing CreateTablet for tablet 5ec2bfff7bb248d5b097081998724f71 (DEFAULT_TABLE table=test-workload [id=c4afb813749744c6b4fa23ca91c80d91]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:03.084391  4950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23510825c22a4843958883c7f521c5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.086417  4953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ec2bfff7bb248d5b097081998724f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:03.112838  5012 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.113840  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:03.113536  5012 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.137468  5012 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.142798  5018 raft_consensus.cc:493] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.143641  5018 raft_consensus.cc:515] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.144241  4916 heartbeater.cc:499] Master 127.28.62.190:39513 was elected leader, sending a full tablet report...
I20260709 13:15:03.107640  5014 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.162334  5005 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.163048  5005 ts_tablet_manager.cc:1403] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.021s
I20260709 13:15:03.163854  5007 tablet_bootstrap.cc:654] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.170189  5008 ts_tablet_manager.cc:1434] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.171s	user 0.022s	sys 0.000s
I20260709 13:15:03.195950  5018 leader_election.cc:290] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.227496  5008 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.238494  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
W20260709 13:15:03.241474  4780 leader_election.cc:343] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.181883  5005 raft_consensus.cc:359] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.243206  5005 raft_consensus.cc:385] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.243590  5005 raft_consensus.cc:740] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.244853  5005 consensus_queue.cc:260] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.248590  5005 ts_tablet_manager.cc:1434] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.003s
I20260709 13:15:03.249899  5005 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.254140  5012 raft_consensus.cc:493] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.254900  5012 raft_consensus.cc:515] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.260653  5012 leader_election.cc:290] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.264421  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
W20260709 13:15:03.272301  4780 leader_election.cc:343] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.284976  5008 tablet_bootstrap.cc:654] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.295027  5005 tablet_bootstrap.cc:654] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.298133  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
W20260709 13:15:03.302182  4929 leader_election.cc:343] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.305418  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.306452  4816 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.306903  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.307940  4965 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 0.
I20260709 13:15:03.308178  4930 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:03.310118  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.310743  4782 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:03.311873  5012 raft_consensus.cc:2804] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.312271  5012 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.312664  5012 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.313633  5014 raft_consensus.cc:2804] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.314095  5014 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.314433  5014 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.322582  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.324776  5007 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.325656  5007 ts_tablet_manager.cc:1403] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.293s	user 0.022s	sys 0.016s
I20260709 13:15:03.325881  5012 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
W20260709 13:15:03.326843  4782 leader_election.cc:343] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.327363  4782 leader_election.cc:304] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78
W20260709 13:15:03.327841  4857 leader_election.cc:343] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.324227  5014 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.329648  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.329610  5007 raft_consensus.cc:359] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.330597  5007 raft_consensus.cc:385] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.330935  5007 raft_consensus.cc:740] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
W20260709 13:15:03.332134  4780 leader_election.cc:343] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.332986  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.332945  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.334193  5014 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.334662  5005 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.337795  5005 ts_tablet_manager.cc:1403] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.007s
I20260709 13:15:03.335631  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.336555  5008 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
W20260709 13:15:03.339273  4929 leader_election.cc:343] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.339812  5008 ts_tablet_manager.cc:1403] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.006s
I20260709 13:15:03.337911  4816 raft_consensus.cc:2393] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 471b23bc542341c2ac372eac52b17a78 in current term 1: Already voted for candidate c21911b82a6b4f9f888cf1400df3ad21 in this term.
I20260709 13:15:03.341938  4930 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78; no voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:03.342264  5012 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Requested vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.337507  5007 consensus_queue.cc:260] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.342345  5005 raft_consensus.cc:359] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.343362  5005 raft_consensus.cc:385] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.345149  5005 raft_consensus.cc:740] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.344988  5008 raft_consensus.cc:359] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.334721  5030 raft_consensus.cc:2749] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.347321  5014 raft_consensus.cc:2749] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.344614  5007 ts_tablet_manager.cc:1434] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:15:03.346457  4856 leader_election.cc:343] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:03.347362  5008 raft_consensus.cc:385] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.348205  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.348152  4856 leader_election.cc:304] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad; no voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:03.348678  5008 raft_consensus.cc:740] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.349279  4965 raft_consensus.cc:2393] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c21911b82a6b4f9f888cf1400df3ad21 in current term 1: Already voted for candidate 471b23bc542341c2ac372eac52b17a78 in this term.
I20260709 13:15:03.346109  5005 consensus_queue.cc:260] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.349509  5018 raft_consensus.cc:2749] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.350390  4782 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:03.350301  5008 consensus_queue.cc:260] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.351940  5012 raft_consensus.cc:2749] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.353020  5008 ts_tablet_manager.cc:1434] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:03.354265  5008 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.355343  5005 ts_tablet_manager.cc:1434] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:03.356587  5005 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.358705  5007 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.362732  5008 tablet_bootstrap.cc:654] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.369954  5007 tablet_bootstrap.cc:654] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.375439  5008 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.375960  5008 ts_tablet_manager.cc:1403] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:15:03.376639  5005 tablet_bootstrap.cc:654] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.379005  5008 raft_consensus.cc:359] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.379702  5008 raft_consensus.cc:385] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.379974  5008 raft_consensus.cc:740] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.380357  5007 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.381007  5007 ts_tablet_manager.cc:1403] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 13:15:03.380935  5008 consensus_queue.cc:260] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.382881  5005 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.383496  5005 ts_tablet_manager.cc:1403] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.007s
I20260709 13:15:03.383596  5008 ts_tablet_manager.cc:1434] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:03.384912  5008 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.384632  5007 raft_consensus.cc:359] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.385548  5007 raft_consensus.cc:385] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.385910  5007 raft_consensus.cc:740] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.386873  5007 consensus_queue.cc:260] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.387060  5005 raft_consensus.cc:359] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.388067  5005 raft_consensus.cc:385] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.388429  5005 raft_consensus.cc:740] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.389552  5005 consensus_queue.cc:260] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.394598  5007 ts_tablet_manager.cc:1434] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:15:03.395756  5008 tablet_bootstrap.cc:654] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.395949  5007 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.406483  5007 tablet_bootstrap.cc:654] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.406826  5005 ts_tablet_manager.cc:1434] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:15:03.406912  5008 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.407634  5008 ts_tablet_manager.cc:1403] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.016s
I20260709 13:15:03.410452  5005 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.410890  5008 raft_consensus.cc:359] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.411733  5008 raft_consensus.cc:385] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.412106  5007 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.412079  5008 raft_consensus.cc:740] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.412828  5007 ts_tablet_manager.cc:1403] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:15:03.413261  5008 consensus_queue.cc:260] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.416261  5008 ts_tablet_manager.cc:1434] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:03.416159  5007 raft_consensus.cc:359] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.417232  5007 raft_consensus.cc:385] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.417660  5007 raft_consensus.cc:740] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.417699  5008 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.418680  5007 consensus_queue.cc:260] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.419379  5005 tablet_bootstrap.cc:654] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.421239  5007 ts_tablet_manager.cc:1434] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:03.422451  5007 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.425952  5008 tablet_bootstrap.cc:654] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.429811  5007 tablet_bootstrap.cc:654] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.441354  5007 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.441926  5007 ts_tablet_manager.cc:1403] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.005s
I20260709 13:15:03.442305  5005 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.442329  5008 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.443097  5005 ts_tablet_manager.cc:1403] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.012s
I20260709 13:15:03.443158  5008 ts_tablet_manager.cc:1403] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.002s
I20260709 13:15:03.444913  5007 raft_consensus.cc:359] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.445756  5007 raft_consensus.cc:385] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.446036  5007 raft_consensus.cc:740] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.446781  5005 raft_consensus.cc:359] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.446933  5008 raft_consensus.cc:359] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.448212  5005 raft_consensus.cc:385] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.448212  5008 raft_consensus.cc:385] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.449522  5005 raft_consensus.cc:740] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.449633  5008 raft_consensus.cc:740] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.449564  5007 consensus_queue.cc:260] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.451608  5008 consensus_queue.cc:260] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.451608  5005 consensus_queue.cc:260] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.453414  5007 ts_tablet_manager.cc:1434] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:15:03.454609  5008 ts_tablet_manager.cc:1434] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:03.454810  5007 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.455880  5008 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.458897  5005 ts_tablet_manager.cc:1434] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:15:03.460584  5005 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.463215  5007 tablet_bootstrap.cc:654] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.463824  5008 tablet_bootstrap.cc:654] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.475155  5018 raft_consensus.cc:493] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.476511  5018 raft_consensus.cc:515] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.481674  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.482815  4965 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.487128  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.488484  4816 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.490085  4857 leader_election.cc:304] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.491793  5018 leader_election.cc:290] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.491868  5016 raft_consensus.cc:2804] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.492650  5016 raft_consensus.cc:493] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.493012  5016 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.494092  5005 tablet_bootstrap.cc:654] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.505285  5016 raft_consensus.cc:515] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.511868  5008 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.512544  5008 ts_tablet_manager.cc:1403] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.035s
I20260709 13:15:03.512637  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.513280  4816 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.513661  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.514549  4965 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.516201  5008 raft_consensus.cc:359] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.517052  5008 raft_consensus.cc:385] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.517364  5008 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.518405  5008 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.521098  5008 ts_tablet_manager.cc:1434] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:03.522341  5008 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.528957  5007 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.529847  5007 ts_tablet_manager.cc:1403] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.018s
I20260709 13:15:03.529930  5008 tablet_bootstrap.cc:654] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.533547  5016 leader_election.cc:290] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.538861  5007 raft_consensus.cc:359] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.540100  5007 raft_consensus.cc:385] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.540524  4965 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.540095  4816 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.542842  4857 leader_election.cc:304] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.545126  5018 raft_consensus.cc:2804] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.548086  5016 raft_consensus.cc:493] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.548772  5016 raft_consensus.cc:515] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.550016  5008 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.550633  5008 ts_tablet_manager.cc:1403] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.013s
I20260709 13:15:03.553115  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.553983  4816 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.554494  5008 raft_consensus.cc:359] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.554975  4964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.555505  5008 raft_consensus.cc:385] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.555346  4856 leader_election.cc:304] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.555924  5008 raft_consensus.cc:740] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.556037  4964 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.556856  5008 consensus_queue.cc:260] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.540607  5007 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.558671  5016 leader_election.cc:290] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.561309  5016 raft_consensus.cc:2804] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.563067  5016 raft_consensus.cc:493] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.563482  5016 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.562116  5007 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.562767  5005 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.566006  5005 ts_tablet_manager.cc:1403] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.106s	user 0.042s	sys 0.035s
I20260709 13:15:03.566788  5018 raft_consensus.cc:697] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:03.568364  5018 consensus_queue.cc:237] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.569525  5005 raft_consensus.cc:359] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.570482  5005 raft_consensus.cc:385] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.570832  5005 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.571687  5005 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.574647  5005 ts_tablet_manager.cc:1434] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:03.575553  5007 ts_tablet_manager.cc:1434] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.006s
I20260709 13:15:03.576078  5005 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.580667  5008 ts_tablet_manager.cc:1434] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.017s
I20260709 13:15:03.581960  5008 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.585999  5007 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.587898  5005 tablet_bootstrap.cc:654] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.589920  5008 tablet_bootstrap.cc:654] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.595203  5007 tablet_bootstrap.cc:654] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.599874  5016 raft_consensus.cc:515] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.604173  5008 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.607426  5008 ts_tablet_manager.cc:1403] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
I20260709 13:15:03.607805  5005 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.608218  5007 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.605258  4714 catalog_manager.cc:5697] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 1 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.608421  5005 ts_tablet_manager.cc:1403] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.001s
I20260709 13:15:03.609596  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.610373  4816 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.610781  5008 raft_consensus.cc:359] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.611603  5008 raft_consensus.cc:385] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.611887  5008 raft_consensus.cc:740] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.612443  5007 ts_tablet_manager.cc:1403] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 13:15:03.611871  5005 raft_consensus.cc:359] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.612954  5005 raft_consensus.cc:385] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.613299  5005 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.613081  5008 consensus_queue.cc:260] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.614388  5012 raft_consensus.cc:493] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.615029  5012 raft_consensus.cc:515] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.620980  5014 raft_consensus.cc:493] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.621685  5014 raft_consensus.cc:515] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.622113  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.622829  4965 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.622630  5007 raft_consensus.cc:359] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.623234  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.624002  5014 leader_election.cc:290] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.624603  5012 leader_election.cc:290] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.624022  4891 raft_consensus.cc:2468] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 0.
I20260709 13:15:03.626142  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.626878  4964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.620573  5005 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.627393  4780 leader_election.cc:304] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.627810  4964 raft_consensus.cc:2468] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 0.
I20260709 13:15:03.628887  5008 ts_tablet_manager.cc:1434] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:03.629908  5005 ts_tablet_manager.cc:1434] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.011s
I20260709 13:15:03.630213  5008 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.631363  5005 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.632892  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.628819  5030 raft_consensus.cc:2804] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.635118  5030 raft_consensus.cc:493] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.635639  5030 raft_consensus.cc:3060] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.637606  5008 tablet_bootstrap.cc:654] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.639242  5005 tablet_bootstrap.cc:654] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.623397  5007 raft_consensus.cc:385] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.626993  4890 raft_consensus.cc:2468] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.641232  5007 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.642601  4929 leader_election.cc:304] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.642385  5007 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.643896  5014 raft_consensus.cc:2804] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.644286  5014 raft_consensus.cc:493] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.644806  5014 raft_consensus.cc:3060] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.666846  4816 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.670599  5030 raft_consensus.cc:515] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.652334  5016 leader_election.cc:290] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.661356  5014 raft_consensus.cc:515] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.683431  5014 leader_election.cc:290] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.671893  4856 leader_election.cc:304] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.674841  5008 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.684440  5016 raft_consensus.cc:2804] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.684823  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.685027  5016 raft_consensus.cc:697] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:03.685983  5016 consensus_queue.cc:237] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:03.687156  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.687820  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.688217  4890 raft_consensus.cc:3060] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.688644  5045 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.689512  5045 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.690891  4815 raft_consensus.cc:2393] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 471b23bc542341c2ac372eac52b17a78 in current term 1: Already voted for candidate c21911b82a6b4f9f888cf1400df3ad21 in this term.
I20260709 13:15:03.692826  4964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b5ff38ad24132a0e9a1ffc0c64210" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.693807  5045 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.693976  5014 raft_consensus.cc:493] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.684837  5008 ts_tablet_manager.cc:1403] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.007s
I20260709 13:15:03.694681  5014 raft_consensus.cc:515] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.698292  5008 raft_consensus.cc:359] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.698850  4890 raft_consensus.cc:2468] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.694015  4963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.680600  5007 ts_tablet_manager.cc:1434] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.002s
I20260709 13:15:03.688174  5005 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.699857  4963 raft_consensus.cc:2393] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10eb54c560144c0f9dc735ef9be91cad in current term 1: Already voted for candidate 471b23bc542341c2ac372eac52b17a78 in this term.
I20260709 13:15:03.700196  5005 ts_tablet_manager.cc:1403] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.069s	user 0.029s	sys 0.021s
I20260709 13:15:03.699039  5008 raft_consensus.cc:385] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.700642  5008 raft_consensus.cc:740] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.701550  5008 consensus_queue.cc:260] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.702399  5007 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.703953  5008 ts_tablet_manager.cc:1434] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:03.704937  5014 leader_election.cc:290] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.693823  4964 raft_consensus.cc:2393] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c21911b82a6b4f9f888cf1400df3ad21 in current term 1: Already voted for candidate 471b23bc542341c2ac372eac52b17a78 in this term.
I20260709 13:15:03.707876  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.708622  4890 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.706087  5005 raft_consensus.cc:359] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.713763  5005 raft_consensus.cc:385] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.714068  5005 raft_consensus.cc:740] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.706736  4929 leader_election.cc:304] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:03.715632  4713 catalog_manager.cc:5697] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 1 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.716969  4929 leader_election.cc:304] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.709431  4782 leader_election.cc:304] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:03.705065  5008 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: Bootstrap starting.
I20260709 13:15:03.717665  5014 raft_consensus.cc:2804] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.714919  5005 consensus_queue.cc:260] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.719213  5014 raft_consensus.cc:697] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:03.663058  4965 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.710784  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.720501  4816 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.720321  5014 consensus_queue.cc:237] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.711351  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.721792  4815 raft_consensus.cc:2393] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10eb54c560144c0f9dc735ef9be91cad in current term 1: Already voted for candidate c21911b82a6b4f9f888cf1400df3ad21 in this term.
I20260709 13:15:03.711895  5030 leader_election.cc:290] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Requested vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.724812  5030 raft_consensus.cc:2749] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.712491  5007 tablet_bootstrap.cc:654] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.719326  5055 raft_consensus.cc:2804] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.727180  5055 raft_consensus.cc:493] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.727694  5055 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.727789  5005 ts_tablet_manager.cc:1434] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 13:15:03.729555  5005 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.710572  5012 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.737741  5012 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.738894  5055 raft_consensus.cc:515] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.741554  5005 tablet_bootstrap.cc:654] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.742635  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.743359  4815 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.745425  5055 leader_election.cc:290] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.746898  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.747823  4890 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.750475  5012 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.751259  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.751964  4891 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 0.
I20260709 13:15:03.753484  4780 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.754509  5012 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.754937  5012 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.755322  5012 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.756647  4890 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.759282  4929 leader_election.cc:304] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.760716  5055 raft_consensus.cc:2804] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.761346  5055 raft_consensus.cc:697] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:03.762652  5055 consensus_queue.cc:237] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.763641  5005 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.765589  5005 ts_tablet_manager.cc:1403] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.008s
I20260709 13:15:03.767973  5008 tablet_bootstrap.cc:654] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.770188  4713 catalog_manager.cc:5697] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.775544  5007 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.776247  5007 ts_tablet_manager.cc:1403] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.005s
I20260709 13:15:03.777369  4815 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
W20260709 13:15:03.779729  4782 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.62.131:43261, user_credentials={real_user=slave}} blocked reactor thread for 70441.8us
I20260709 13:15:03.781104  4856 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad; no voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:03.782244  5016 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.783198  5012 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.784070  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.784626  5014 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.785357  5008 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: No bootstrap required, opened a new log
I20260709 13:15:03.778821  5005 raft_consensus.cc:359] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.786124  5008 ts_tablet_manager.cc:1403] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.002s
I20260709 13:15:03.785172  5014 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.787074  4965 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 0.
I20260709 13:15:03.788244  5007 raft_consensus.cc:359] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.788959  5007 raft_consensus.cc:385] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.789202  5007 raft_consensus.cc:740] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.791849  5008 raft_consensus.cc:359] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.786185  5005 raft_consensus.cc:385] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.790333  5016 raft_consensus.cc:2749] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:03.792222  5007 consensus_queue.cc:260] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.792639  5008 raft_consensus.cc:385] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.792659  5005 raft_consensus.cc:740] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.794699  5005 consensus_queue.cc:260] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.795769  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.793514  5014 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.796563  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.794816  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.796844  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "c21911b82a6b4f9f888cf1400df3ad21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.797508  4965 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.797611  4815 raft_consensus.cc:2393] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 471b23bc542341c2ac372eac52b17a78 in current term 1: Already voted for candidate c21911b82a6b4f9f888cf1400df3ad21 in this term.
I20260709 13:15:03.796554  4890 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.799567  4929 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:03.801111  5005 ts_tablet_manager.cc:1434] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:15:03.802325  5005 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:03.807904  5008 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.808568  5005 tablet_bootstrap.cc:654] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.808889  5008 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.809659  5007 ts_tablet_manager.cc:1434] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:15:03.810801  5007 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.811287  5008 ts_tablet_manager.cc:1434] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:15:03.807938  5012 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Requested vote from peers 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.809574  4965 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21911b82a6b4f9f888cf1400df3ad21 in term 1.
I20260709 13:15:03.815173  5005 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: No bootstrap required, opened a new log
I20260709 13:15:03.816576  5005 ts_tablet_manager.cc:1403] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:15:03.816644  5014 raft_consensus.cc:2764] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:03.818842  4782 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:03.819710  5012 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.819697  5005 raft_consensus.cc:359] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.822216  5005 raft_consensus.cc:385] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.822831  5005 raft_consensus.cc:740] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.823819  5007 tablet_bootstrap.cc:654] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.823868  5005 consensus_queue.cc:260] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.822633  4713 catalog_manager.cc:5697] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.826610  5005 ts_tablet_manager.cc:1434] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:03.820518  5012 raft_consensus.cc:697] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 LEADER]: Becoming Leader. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Running, Role: LEADER
I20260709 13:15:03.828583  5012 consensus_queue.cc:237] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.830163  5007 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.830300  5016 raft_consensus.cc:493] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.830861  5007 ts_tablet_manager.cc:1403] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:15:03.830862  5016 raft_consensus.cc:515] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.834225  5007 raft_consensus.cc:359] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.835035  5007 raft_consensus.cc:385] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.835323  5007 raft_consensus.cc:740] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.835629  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.836165  5007 consensus_queue.cc:260] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.836863  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.836695  4965 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.837556  4815 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.839448  5007 ts_tablet_manager.cc:1434] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:03.839314  4857 leader_election.cc:304] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.835323  5016 leader_election.cc:290] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.840730  5007 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: Bootstrap starting.
I20260709 13:15:03.840780  5016 raft_consensus.cc:2804] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.841271  5016 raft_consensus.cc:493] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.841719  5016 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.849956  5016 raft_consensus.cc:515] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.852119  5007 tablet_bootstrap.cc:654] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:03.853247  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.853984  4815 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.863984  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.864106  5016 leader_election.cc:290] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.865206  4965 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.863960  4815 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.865155  4713 catalog_manager.cc:5697] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "c21911b82a6b4f9f888cf1400df3ad21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.869738  5007 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: No bootstrap required, opened a new log
I20260709 13:15:03.870474  5007 ts_tablet_manager.cc:1403] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:15:03.874408  5007 raft_consensus.cc:359] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.875185  5007 raft_consensus.cc:385] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:03.875443  5007 raft_consensus.cc:740] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Initialized, Role: FOLLOWER
I20260709 13:15:03.876384  5007 consensus_queue.cc:260] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.876575  4856 leader_election.cc:304] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.877583  5016 raft_consensus.cc:2804] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.878087  5016 raft_consensus.cc:697] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:03.879050  5016 consensus_queue.cc:237] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.879859  5007 ts_tablet_manager.cc:1434] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:03.885099  4965 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.893728  4712 catalog_manager.cc:5697] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 1 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.916891  5014 raft_consensus.cc:493] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.917560  5014 raft_consensus.cc:515] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.919641  5014 leader_election.cc:290] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.920869  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.920799  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.921905  4815 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.921904  4890 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.923393  4929 leader_election.cc:304] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.924216  5014 raft_consensus.cc:2804] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.924619  5014 raft_consensus.cc:493] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.924948  5014 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.925657  5055 raft_consensus.cc:493] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.926120  5055 raft_consensus.cc:515] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.928377  5055 leader_election.cc:290] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.929299  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.929678  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
I20260709 13:15:03.929996  4815 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.930474  4890 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 0.
I20260709 13:15:03.931111  4930 leader_election.cc:304] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.932050  5055 raft_consensus.cc:2804] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.932461  5055 raft_consensus.cc:493] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.932747  5055 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.932910  5014 raft_consensus.cc:515] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.935058  5014 leader_election.cc:290] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.936041  4815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.936295  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.936682  4815 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.936972  4890 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.940245  5055 raft_consensus.cc:515] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.942579  5016 raft_consensus.cc:493] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.943295  5016 raft_consensus.cc:515] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.944676  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:03.944262  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.945590  4891 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.945679  4816 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.946967  4890 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.948662  4814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:03.949347  4929 leader_election.cc:304] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.949520  4814 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.949503  5016 leader_election.cc:290] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.950436  5014 raft_consensus.cc:2804] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.951397  4856 leader_election.cc:304] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.952215  5045 raft_consensus.cc:2804] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:03.952752  5045 raft_consensus.cc:493] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.953090  5045 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.943373  5055 leader_election.cc:290] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:03.944777  4815 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.955667  4816 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.951421  5014 raft_consensus.cc:697] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:03.957744  4930 leader_election.cc:304] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:03.957906  5014 consensus_queue.cc:237] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.958669  5055 raft_consensus.cc:2804] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.949390  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:03.959470  5055 raft_consensus.cc:697] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:03.960225  4965 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 0.
I20260709 13:15:03.962392  4891 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 1.
I20260709 13:15:03.962292  5045 raft_consensus.cc:515] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.963191  5055 consensus_queue.cc:237] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.965116  5045 leader_election.cc:290] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:03.966425  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:03.966969  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:03.967201  4965 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.967639  4816 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:03.975154  4712 catalog_manager.cc:5697] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.980077  4965 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.981208  4816 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:03.981976  4857 leader_election.cc:304] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:03.983584  5045 raft_consensus.cc:2804] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:03.984221  5045 raft_consensus.cc:697] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:03.985155  5045 consensus_queue.cc:237] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:03.998040  4713 catalog_manager.cc:5697] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 1 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.998044  4712 catalog_manager.cc:5697] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.012173  5045 consensus_queue.cc:1048] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.035167  5045 consensus_queue.cc:1048] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:04.118115  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:04.248224  5045 consensus_queue.cc:1048] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.261189  5045 consensus_queue.cc:1048] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.273974  5012 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.285887  4891 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.296056  5081 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.320221  5055 consensus_queue.cc:1048] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.335680  5063 consensus_queue.cc:1048] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.346784  5045 consensus_queue.cc:1048] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.353806  5063 consensus_queue.cc:1048] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.368021  5045 consensus_queue.cc:1048] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.377969  5014 consensus_queue.cc:1048] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:04.392434  5014 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.412828  5055 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.483255  5055 consensus_queue.cc:1048] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.496945  5014 consensus_queue.cc:1048] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.508773  5045 consensus_queue.cc:1048] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:04.521935  5016 consensus_queue.cc:1048] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:05.122584  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:05.385999  5016 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.386735  5016 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:05.388707  5016 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:05.389539  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21" is_pre_election: true
I20260709 13:15:05.390161  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:05.390407  4816 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:05.391080  4965 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:05.391855  4856 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:05.392664  5018 raft_consensus.cc:2804] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:05.393064  5018 raft_consensus.cc:493] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.393440  5018 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.399029  5018 raft_consensus.cc:515] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:05.400710  5018 leader_election.cc:290] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:05.401763  4816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:05.401865  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33da5b7d1a743a4939aa6898bb11b93" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:05.402431  4816 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.402514  4965 raft_consensus.cc:3060] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.408160  4965 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:05.408155  4816 raft_consensus.cc:2468] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:05.409513  4857 leader_election.cc:304] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:05.410377  5018 raft_consensus.cc:2804] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:05.411062  5018 raft_consensus.cc:697] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:05.411857  5018 consensus_queue.cc:237] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:05.420480  4712 catalog_manager.cc:5697] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 0 to 2, leader changed from <none> to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 2 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.655083 28922 ts_manager.cc:295] Set tserver state for c21911b82a6b4f9f888cf1400df3ad21 to MAINTENANCE_MODE
I20260709 13:15:05.656188 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:15:05.684032 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:05.684872 28922 tablet_replica.cc:333] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.685654 28922 raft_consensus.cc:2243] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.686095 28922 raft_consensus.cc:2272] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.692914 28922 tablet_replica.cc:333] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.693763 28922 raft_consensus.cc:2243] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.694283 28922 raft_consensus.cc:2272] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.696262 28922 tablet_replica.cc:333] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.696887 28922 raft_consensus.cc:2243] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.697362 28922 raft_consensus.cc:2272] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.699338 28922 tablet_replica.cc:333] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.699967 28922 raft_consensus.cc:2243] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:05.700872 28922 raft_consensus.cc:2272] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.703065 28922 tablet_replica.cc:333] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.703691 28922 raft_consensus.cc:2243] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.704165 28922 raft_consensus.cc:2272] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.706498 28922 tablet_replica.cc:333] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.707336 28922 raft_consensus.cc:2243] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.707774 28922 raft_consensus.cc:2272] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.710165 28922 tablet_replica.cc:333] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.710803 28922 raft_consensus.cc:2243] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.711277 28922 raft_consensus.cc:2272] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.713349 28922 tablet_replica.cc:333] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.714030 28922 raft_consensus.cc:2243] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.714509 28922 raft_consensus.cc:2272] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.717453 28922 tablet_replica.cc:333] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.718461 28922 raft_consensus.cc:2243] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.719040 28922 raft_consensus.cc:2272] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:05.722620 28922 tablet_replica.cc:333] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: stopping tablet replica
I20260709 13:15:05.723516 28922 raft_consensus.cc:2243] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:05.724321 28922 raft_consensus.cc:2272] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:05.738113  4930 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 404 similar messages]
W20260709 13:15:05.741839  4930 consensus_peers.cc:597] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.766075 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:15:05.795126  4930 consensus_peers.cc:597] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.853719  4856 consensus_peers.cc:597] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.868649  4856 consensus_peers.cc:597] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.879282  4856 consensus_peers.cc:597] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.937608  4856 consensus_peers.cc:597] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.961340  4930 consensus_peers.cc:597] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.969684  4965 raft_consensus.cc:1275] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:05.971012  5018 consensus_queue.cc:1048] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:05.990000  4856 consensus_peers.cc:597] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:06.054178  4930 consensus_peers.cc:597] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:06.123844  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:07.124926  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:07.156303  5112 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c21911b82a6b4f9f888cf1400df3ad21)
I20260709 13:15:07.156912  5112 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:07.158736  5112 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:07.159927  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10eb54c560144c0f9dc735ef9be91cad" is_pre_election: true
W20260709 13:15:07.162631  4930 leader_election.cc:336] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111)
I20260709 13:15:07.163043  4930 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78; no voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:07.163712  5112 raft_consensus.cc:2749] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:07.177357  5018 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c21911b82a6b4f9f888cf1400df3ad21)
I20260709 13:15:07.178092  5018 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:07.180137  5018 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:07.181370  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78" is_pre_election: true
I20260709 13:15:07.182147  4965 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 1.
I20260709 13:15:07.183388  4857 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:07.184135  5018 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:07.184358  4856 leader_election.cc:336] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111)
I20260709 13:15:07.184499  5018 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader c21911b82a6b4f9f888cf1400df3ad21)
I20260709 13:15:07.184996  5018 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.190631  5018 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:07.192500  5018 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:07.193747  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:07.194363  4965 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:07.196458  4856 leader_election.cc:336] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111)
I20260709 13:15:07.199963  4965 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:07.201299  4857 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:07.202294  5018 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.203372  5018 raft_consensus.cc:697] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:07.204236  5018 consensus_queue.cc:237] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:07.212080  4714 catalog_manager.cc:5697] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 1 to 2, leader changed from c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129) to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 2 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:07.662871  4856 consensus_peers.cc:597] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:07.781608  4965 raft_consensus.cc:1275] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.783030  5018 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:08.126031  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:08.129230  4930 consensus_peers.cc:597] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.188948  4856 consensus_peers.cc:597] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.297835  4856 consensus_peers.cc:597] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.332525  4856 consensus_peers.cc:597] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.458518  4930 consensus_peers.cc:597] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.475261  4930 consensus_peers.cc:597] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.545863  4856 consensus_peers.cc:597] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.558390  4856 consensus_peers.cc:597] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.776520  4930 consensus_peers.cc:597] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:09.127120  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:10.128257  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:10.375197  4856 consensus_peers.cc:597] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:10.656116  4856 consensus_peers.cc:597] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.663388  4856 consensus_peers.cc:597] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.683739  4856 consensus_peers.cc:597] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:10.788869 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:10.797094  5126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.797561  5127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.805884  4930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111) [suppressed 100 similar messages]
W20260709 13:15:10.806027  5129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.806933 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:10.809170 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:10.809213  4930 consensus_peers.cc:597] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.809541 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:10.809852 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602910809833 us; error 0 us; skew 500 ppm
I20260709 13:15:10.810592 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:10.814158 28922 webserver.cc:533] Webserver started at http://127.28.62.129:46021/ using document root <none> and password file <none>
I20260709 13:15:10.814896 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:10.815171 28922 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:15:10.819275 28922 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:15:10.824767  5134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.825873 28922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:10.826347 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "c21911b82a6b4f9f888cf1400df3ad21"
format_stamp: "Formatted at 2026-07-09 13:15:02 on dist-test-slave-50cs"
I20260709 13:15:10.826768 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:15:10.837826  4856 consensus_peers.cc:597] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:10.845160 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:10.846836 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:10.848572 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:10.852835  5141 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:15:10.904804 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:15:10.905100 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:15:10.905547 28922 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:15:10.910624  5141 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:10.925179  5141 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:10.926240  5141 tablet_bootstrap.cc:492] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:10.926802  5141 ts_tablet_manager.cc:1403] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:15:10.929085  5141 raft_consensus.cc:359] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:10.929700  5141 raft_consensus.cc:740] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.930392  5141 consensus_queue.cc:260] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:10.932586  5141 ts_tablet_manager.cc:1434] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:10.933266  5141 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:10.945835  5141 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:10.946638 28922 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:15:10.946671  5141 tablet_bootstrap.cc:492] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:10.946992 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.037s	sys 0.003s
I20260709 13:15:10.947602  5141 ts_tablet_manager.cc:1403] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:15:10.949817  5141 raft_consensus.cc:359] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.950407  5141 raft_consensus.cc:740] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.951117  5141 consensus_queue.cc:260] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.952705  5141 ts_tablet_manager.cc:1434] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:15:10.953504  5141 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:10.966603  5141 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:10.967399  5141 tablet_bootstrap.cc:492] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:10.968016  5141 ts_tablet_manager.cc:1403] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:15:10.970333  5141 raft_consensus.cc:359] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.971151  5141 raft_consensus.cc:740] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.971963  5141 consensus_queue.cc:260] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.973742  5141 ts_tablet_manager.cc:1434] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:15:10.974483  5141 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:10.988523  5141 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:10.989315  5141 tablet_bootstrap.cc:492] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:10.989991  5141 ts_tablet_manager.cc:1403] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:15:10.991765  5141 raft_consensus.cc:359] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.992288  5141 raft_consensus.cc:740] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.992920  5141 consensus_queue.cc:260] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:10.994428  5141 ts_tablet_manager.cc:1434] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:10.995187  5141 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.009181  5141 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.010030  5141 tablet_bootstrap.cc:492] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.010610  5141 ts_tablet_manager.cc:1403] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:15:11.012454  5141 raft_consensus.cc:359] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.013077  5141 raft_consensus.cc:740] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.013777  5141 consensus_queue.cc:260] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.013840 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:45365
I20260709 13:15:11.013960  5203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:45365 every 8 connection(s)
I20260709 13:15:11.015468  5141 ts_tablet_manager.cc:1434] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:11.016175  5141 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.028312 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.040949  5141 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.042140  5141 tablet_bootstrap.cc:492] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.042801  5141 ts_tablet_manager.cc:1403] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:15:11.046609  5141 raft_consensus.cc:359] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.047435  5141 raft_consensus.cc:740] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.048187  5141 consensus_queue.cc:260] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.050333  5141 ts_tablet_manager.cc:1434] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:11.051247  5141 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.053344  5204 heartbeater.cc:344] Connected to a master server at 127.28.62.190:39513
I20260709 13:15:11.053872  5204 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.054765  5204 heartbeater.cc:507] Master 127.28.62.190:39513 requested a full tablet report, sending...
I20260709 13:15:11.062358  4712 ts_manager.cc:194] Re-registered known tserver with Master: c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365)
I20260709 13:15:11.064832  4891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:11.065677  4891 raft_consensus.cc:606] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:11.068462  5141 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.068753  4891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:11.069360  5141 tablet_bootstrap.cc:492] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.069449  4891 raft_consensus.cc:606] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:11.070088  5141 ts_tablet_manager.cc:1403] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:15:11.070888 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:11.071785 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:11.072512 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.072664  5141 raft_consensus.cc:359] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.073266  4712 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57378
I20260709 13:15:11.073374  5141 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.077100  5204 heartbeater.cc:499] Master 127.28.62.190:39513 was elected leader, sending a full tablet report...
I20260709 13:15:11.074419  5141 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.080278  5141 ts_tablet_manager.cc:1434] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:11.083635  5141 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.095709  5018 raft_consensus.cc:993] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:11.096325  5213 raft_consensus.cc:1081] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:11.098438  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:11.099032  4965 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:11.099364  4965 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.106506  4965 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.108673  4965 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 3 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:11.109809  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:11.110373  4891 raft_consensus.cc:3055] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:11.110589  4891 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:11.111562  5141 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.111336  4891 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.112284  5178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:11.112391  4891 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.112591  5141 tablet_bootstrap.cc:492] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.113350  5141 ts_tablet_manager.cc:1403] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
W20260709 13:15:11.114506  4930 leader_election.cc:343] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.115772  5141 raft_consensus.cc:359] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.116477  5141 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.117165  5141 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.119184  5141 ts_tablet_manager.cc:1434] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:11.120014  5141 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.120019  4891 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 3.
I20260709 13:15:11.121573  4929 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: c21911b82a6b4f9f888cf1400df3ad21
I20260709 13:15:11.122440  5112 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.123937  5112 raft_consensus.cc:697] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:11.124854  5112 consensus_queue.cc:237] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
W20260709 13:15:11.129172  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:11.134537  4712 catalog_manager.cc:5697] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 2 to 3, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.136394  5141 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.137521  5141 tablet_bootstrap.cc:492] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.138336  5141 ts_tablet_manager.cc:1403] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:15:11.140573  5141 raft_consensus.cc:359] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.141147  5141 raft_consensus.cc:740] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.141876  5141 consensus_queue.cc:260] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.143784  5141 ts_tablet_manager.cc:1434] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:11.147312  5141 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap starting.
I20260709 13:15:11.167949  5141 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.168933  5141 tablet_bootstrap.cc:492] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Bootstrap complete.
I20260709 13:15:11.169653  5141 ts_tablet_manager.cc:1403] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:15:11.172169  5141 raft_consensus.cc:359] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.172809  5141 raft_consensus.cc:740] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21911b82a6b4f9f888cf1400df3ad21, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.173377  5141 consensus_queue.cc:260] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:11.174948  5141 ts_tablet_manager.cc:1434] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:15:11.402997  5213 raft_consensus.cc:993] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:11.403457  5018 raft_consensus.cc:1081] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:11.405179  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:11.405764  4965 raft_consensus.cc:493] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:11.406154  4965 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.411983  4965 raft_consensus.cc:515] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:11.414098  4965 leader_election.cc:290] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:11.414971  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:11.415447  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcbcd79f9b5486587ed2ad92b0dac34" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:11.415716  5176 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.416064  4891 raft_consensus.cc:3055] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.416395  4891 raft_consensus.cc:740] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:11.417239  4891 consensus_queue.cc:260] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:11.418516  4891 raft_consensus.cc:3060] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.423278  5176 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:11.424834  4930 leader_election.cc:304] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:11.425595  5112 raft_consensus.cc:2804] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.425549  4891 raft_consensus.cc:2468] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:11.426297  5112 raft_consensus.cc:697] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:11.427093  5112 consensus_queue.cc:237] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } }
I20260709 13:15:11.434370  4712 catalog_manager.cc:5697] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 1 to 2, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.547508  5176 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.554538  5176 raft_consensus.cc:1275] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:11.556252  5112 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:11.567180  4891 raft_consensus.cc:1275] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:11.568638  5112 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:11.807871  4891 raft_consensus.cc:1275] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.809538  5215 consensus_queue.cc:1048] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:11.819346  5176 raft_consensus.cc:1275] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:11.820904  5215 consensus_queue.cc:1048] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:12.089649 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.108801  4965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23510825c22a4843958883c7f521c5e2"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
mode: GRACEFUL
new_leader_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:48076
I20260709 13:15:12.109534  4965 raft_consensus.cc:606] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Received request to transfer leadership to TS 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:12.112653  4965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
mode: GRACEFUL
new_leader_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:48076
I20260709 13:15:12.113298  4965 raft_consensus.cc:606] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Received request to transfer leadership to TS 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:12.114408 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:12.114840 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:12.115376 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:12.130337  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:12.168006  5215 raft_consensus.cc:993] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: : Instructing follower 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:12.168633  5226 raft_consensus.cc:1081] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Signalling peer 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:12.170362  4891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:40996
I20260709 13:15:12.171077  4891 raft_consensus.cc:493] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.171417  4891 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.176805  4891 raft_consensus.cc:515] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.178880  4891 leader_election.cc:290] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 4 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:12.179881  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:12.179836  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a283a436eb74802b938b5f9369c89fe" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:12.180634  4965 raft_consensus.cc:3055] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:12.180714  5176 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.180929  4965 raft_consensus.cc:740] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:12.181875  4965 consensus_queue.cc:260] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.182806  4965 raft_consensus.cc:3060] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.186602  5176 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 4.
I20260709 13:15:12.187402  4965 raft_consensus.cc:2468] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 4.
I20260709 13:15:12.187988  4856 leader_election.cc:304] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:12.188967  5018 raft_consensus.cc:2804] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:12.189366  5018 raft_consensus.cc:697] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 4 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:12.190027  5018 consensus_queue.cc:237] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.196033  4714 catalog_manager.cc:5697] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 3 to 4, leader changed from 471b23bc542341c2ac372eac52b17a78 (127.28.62.131) to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 4 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.589766  5215 raft_consensus.cc:993] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: : Instructing follower 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:12.590252  5226 raft_consensus.cc:1081] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Signalling peer 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:12.591868  4891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23510825c22a4843958883c7f521c5e2"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:40996
I20260709 13:15:12.592367  4891 raft_consensus.cc:493] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.592629  4891 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.597818  4891 raft_consensus.cc:515] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.599632  4891 leader_election.cc:290] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:12.600466  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:12.600709  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23510825c22a4843958883c7f521c5e2" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:12.601114  5176 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.601281  4965 raft_consensus.cc:3055] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.601673  4965 raft_consensus.cc:740] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:12.602335  4965 consensus_queue.cc:260] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.603189  4965 raft_consensus.cc:3060] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.607048  5176 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:12.608404  4856 leader_election.cc:304] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:12.609097  4965 raft_consensus.cc:2468] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:12.609259  5227 raft_consensus.cc:2804] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.609776  5227 raft_consensus.cc:697] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:12.610605  5227 consensus_queue.cc:237] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:12.617478  4714 catalog_manager.cc:5697] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 1 to 2, leader changed from 471b23bc542341c2ac372eac52b17a78 (127.28.62.131) to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 2 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.738483  4965 raft_consensus.cc:1275] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 4 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:12.740152  5227 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:12.750377  5176 raft_consensus.cc:1275] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 4 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:12.752452  5242 consensus_queue.cc:1048] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:13.000316  5176 raft_consensus.cc:1275] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.003618  5227 consensus_queue.cc:1048] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.020005  4965 raft_consensus.cc:1275] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.022341  5018 consensus_queue.cc:1048] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.123505 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:13.131583  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:13.134618  4890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:13.135378  4890 raft_consensus.cc:606] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:13.138473  4890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:13.139019  4890 raft_consensus.cc:606] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:13.140295 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:13.140828 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:13.141678 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.460708  5227 raft_consensus.cc:993] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:13.461187  5018 raft_consensus.cc:1081] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:13.462828  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:13.463274  4965 raft_consensus.cc:493] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.463522  4965 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.470825  4965 raft_consensus.cc:515] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.472344  4965 leader_election.cc:290] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:13.473757  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:13.473592  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0023a413de544e98bf4dcc5242e2bfc9" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:13.474452  4890 raft_consensus.cc:3055] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.474650  5176 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.474905  4890 raft_consensus.cc:740] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:13.476157  4890 consensus_queue.cc:260] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.478147  4890 raft_consensus.cc:3060] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.485111  5176 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:13.486644  4930 leader_election.cc:304] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:13.487614  5215 raft_consensus.cc:2804] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.488054  5215 raft_consensus.cc:697] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:13.488279  4890 raft_consensus.cc:2468] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:13.489197  5215 consensus_queue.cc:237] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.496903  4712 catalog_manager.cc:5697] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 1 to 2, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.612335  5018 raft_consensus.cc:993] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:13.612816  5227 raft_consensus.cc:1081] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:13.614495  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:13.615044  4965 raft_consensus.cc:493] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.615430  4965 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.622592  4965 raft_consensus.cc:515] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.624547  4965 leader_election.cc:290] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:13.625169  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:13.625783  4890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5859b32cbc48bd9fddf1bc2a3be7a8" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:13.625957  5176 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.626387  4890 raft_consensus.cc:3055] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.626737  4890 raft_consensus.cc:740] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:13.627673  4890 consensus_queue.cc:260] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.629011  4890 raft_consensus.cc:3060] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.632519  5176 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:13.634140  4930 leader_election.cc:304] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:13.635046  5215 raft_consensus.cc:2804] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.635537  5215 raft_consensus.cc:697] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:13.636370  4890 raft_consensus.cc:2468] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:13.636687  5215 consensus_queue.cc:237] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:13.644268  4712 catalog_manager.cc:5697] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 1 to 2, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.972283  5176 raft_consensus.cc:1275] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.973769  5215 consensus_queue.cc:1048] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.985780  4890 raft_consensus.cc:1275] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.987699  5258 consensus_queue.cc:1048] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:14.064633  5176 raft_consensus.cc:1275] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.066053  5215 consensus_queue.cc:1048] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.077322  4890 raft_consensus.cc:1275] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.079739  5215 consensus_queue.cc:1048] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:14.132856  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:14.148458 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.156561  4965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
mode: GRACEFUL
new_leader_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:48076
I20260709 13:15:14.157073  4965 raft_consensus.cc:606] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Received request to transfer leadership to TS 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:14.159586  4965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
mode: GRACEFUL
new_leader_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:48076
I20260709 13:15:14.160048  4965 raft_consensus.cc:606] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Received request to transfer leadership to TS 10eb54c560144c0f9dc735ef9be91cad
I20260709 13:15:14.161289 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:14.161856 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:14.162400 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.258217  5263 raft_consensus.cc:993] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: : Instructing follower 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:14.258765  5263 raft_consensus.cc:1081] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Signalling peer 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:14.260437  4890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:40996
I20260709 13:15:14.260965  4890 raft_consensus.cc:493] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.261475  4890 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.267462  4890 raft_consensus.cc:515] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.269361  4890 leader_election.cc:290] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:14.270269  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:14.270499  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c56d34b705b4a0e83159cd91a0bdd2b" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:14.271010  4965 raft_consensus.cc:3055] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.271010  5176 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.271646  4965 raft_consensus.cc:740] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:14.272629  4965 consensus_queue.cc:260] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.274024  4965 raft_consensus.cc:3060] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.279330  5176 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:14.280650  4856 leader_election.cc:304] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:14.280795  4965 raft_consensus.cc:2468] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:14.281536  5227 raft_consensus.cc:2804] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.282604  5227 raft_consensus.cc:697] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:14.283470  5227 consensus_queue.cc:237] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.290987  4712 catalog_manager.cc:5697] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 1 to 2, leader changed from 471b23bc542341c2ac372eac52b17a78 (127.28.62.131) to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 2 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.540828  5215 raft_consensus.cc:993] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: : Instructing follower 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:14.541364  5215 raft_consensus.cc:1081] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Signalling peer 10eb54c560144c0f9dc735ef9be91cad to start an election
I20260709 13:15:14.542999  4891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
 from {username='slave'} at 127.0.0.1:40996
I20260709 13:15:14.543452  4891 raft_consensus.cc:493] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.543761  4891 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.549233  4891 raft_consensus.cc:515] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.550838  4891 leader_election.cc:290] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 471b23bc542341c2ac372eac52b17a78 (127.28.62.131:43261)
I20260709 13:15:14.551891  4965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "471b23bc542341c2ac372eac52b17a78"
I20260709 13:15:14.551724  5176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "10eb54c560144c0f9dc735ef9be91cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:14.552587  4965 raft_consensus.cc:3055] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.552628  5176 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.553043  4965 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:14.554060  4965 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.555392  4965 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.560527  5176 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:14.561894  4856 leader_election.cc:304] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:14.562681  5227 raft_consensus.cc:2804] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.562722  4965 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10eb54c560144c0f9dc735ef9be91cad in term 2.
I20260709 13:15:14.563308  5227 raft_consensus.cc:697] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Leader. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:14.564397  5227 consensus_queue.cc:237] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:14.571344  4712 catalog_manager.cc:5697] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad reported cstate change: term changed from 1 to 2, leader changed from 471b23bc542341c2ac372eac52b17a78 (127.28.62.131) to 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130). New cstate: current_term: 2 leader_uuid: "10eb54c560144c0f9dc735ef9be91cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.810170  5176 raft_consensus.cc:1275] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.811414  5227 consensus_queue.cc:1048] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.822602  4965 raft_consensus.cc:1275] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.824982  5274 consensus_queue.cc:1048] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:15.026281  4965 raft_consensus.cc:1275] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.027462  5274 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:15.037897  5176 raft_consensus.cc:1275] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 10eb54c560144c0f9dc735ef9be91cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.039757  5227 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:15.134013  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:15.169680 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.177222  4891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:15.177857  4891 raft_consensus.cc:606] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:15.180485  4891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71"
dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
mode: GRACEFUL
new_leader_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35828
I20260709 13:15:15.181123  4891 raft_consensus.cc:606] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Received request to transfer leadership to TS 471b23bc542341c2ac372eac52b17a78
I20260709 13:15:15.182191 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:15.182644 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:15.183162 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.257884  5265 raft_consensus.cc:993] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:15.258431  5279 raft_consensus.cc:1081] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:15.260174  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:15.260785  4965 raft_consensus.cc:493] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.261101  4965 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.266562  4965 raft_consensus.cc:515] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.268217  4965 leader_election.cc:290] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:15.269361  5178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:15.269411  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ec2bfff7bb248d5b097081998724f71" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:15.270128  5178 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.270200  4891 raft_consensus.cc:3055] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:15.270840  4891 raft_consensus.cc:740] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:15.271652  4891 consensus_queue.cc:260] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.272799  4891 raft_consensus.cc:3060] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.277880  4891 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:15.277951  5178 raft_consensus.cc:2468] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 2.
I20260709 13:15:15.279402  4929 leader_election.cc:304] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10eb54c560144c0f9dc735ef9be91cad, 471b23bc542341c2ac372eac52b17a78; no voters: 
I20260709 13:15:15.280278  5215 raft_consensus.cc:2804] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:15.280804  5215 raft_consensus.cc:697] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:15.281986  5215 consensus_queue.cc:237] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.291013  4712 catalog_manager.cc:5697] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 1 to 2, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.496420  5274 raft_consensus.cc:993] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: : Instructing follower 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:15.496943  5279 raft_consensus.cc:1081] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Signalling peer 471b23bc542341c2ac372eac52b17a78 to start an election
I20260709 13:15:15.498509  4965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780"
dest_uuid: "471b23bc542341c2ac372eac52b17a78"
 from {username='slave'} at 127.0.0.1:35102
I20260709 13:15:15.499137  4965 raft_consensus.cc:493] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.499471  4965 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.505267  4965 raft_consensus.cc:515] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.506944  4965 leader_election.cc:290] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 3 election: Requested vote from peers c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365), 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395)
I20260709 13:15:15.507959  5178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c21911b82a6b4f9f888cf1400df3ad21"
I20260709 13:15:15.508097  4891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53278a260d6d484ab3614e3ab2c69780" candidate_uuid: "471b23bc542341c2ac372eac52b17a78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10eb54c560144c0f9dc735ef9be91cad"
I20260709 13:15:15.508764  5178 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.508786  4891 raft_consensus.cc:3055] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:15.509474  4891 raft_consensus.cc:740] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10eb54c560144c0f9dc735ef9be91cad, State: Running, Role: LEADER
I20260709 13:15:15.510354  4891 consensus_queue.cc:260] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.511694  4891 raft_consensus.cc:3060] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.517802  5178 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 3.
I20260709 13:15:15.519335  4930 leader_election.cc:304] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 471b23bc542341c2ac372eac52b17a78, c21911b82a6b4f9f888cf1400df3ad21; no voters: 
I20260709 13:15:15.519714  4891 raft_consensus.cc:2468] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 471b23bc542341c2ac372eac52b17a78 in term 3.
I20260709 13:15:15.520262  5215 raft_consensus.cc:2804] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:15.520732  5215 raft_consensus.cc:697] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Becoming Leader. State: Replica: 471b23bc542341c2ac372eac52b17a78, State: Running, Role: LEADER
I20260709 13:15:15.521626  5215 consensus_queue.cc:237] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } }
I20260709 13:15:15.528968  4712 catalog_manager.cc:5697] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 reported cstate change: term changed from 2 to 3, leader changed from 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130) to 471b23bc542341c2ac372eac52b17a78 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "471b23bc542341c2ac372eac52b17a78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "471b23bc542341c2ac372eac52b17a78" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 43261 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.825924  5178 raft_consensus.cc:1275] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.827364  5215 consensus_queue.cc:1048] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.833545  4891 raft_consensus.cc:1275] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.835989  5287 consensus_queue.cc:1048] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.055464  4891 raft_consensus.cc:1275] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.056931  5289 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10eb54c560144c0f9dc735ef9be91cad" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.067094  5178 raft_consensus.cc:1275] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Refusing update from remote peer 471b23bc542341c2ac372eac52b17a78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.072301  5263 consensus_queue.cc:1048] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21911b82a6b4f9f888cf1400df3ad21" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 45365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:16.135016  4762 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:16.189292 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.222772 28922 tablet_server.cc:179] TabletServer@127.28.62.129:45365 shutting down...
W20260709 13:15:16.234206  4930 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:15:16.239334  4930 consensus_peers.cc:597] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.252048 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.252995 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.253925 28922 raft_consensus.cc:2243] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.254410 28922 raft_consensus.cc:2272] T 4c56d34b705b4a0e83159cd91a0bdd2b P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.256804 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.257515 28922 raft_consensus.cc:2243] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.258070 28922 raft_consensus.cc:2272] T 5a283a436eb74802b938b5f9369c89fe P c21911b82a6b4f9f888cf1400df3ad21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.260418 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.261040 28922 raft_consensus.cc:2243] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.261561 28922 raft_consensus.cc:2272] T 53278a260d6d484ab3614e3ab2c69780 P c21911b82a6b4f9f888cf1400df3ad21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.264565 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.265223 28922 raft_consensus.cc:2243] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.265725 28922 raft_consensus.cc:2272] T d70b5ff38ad24132a0e9a1ffc0c64210 P c21911b82a6b4f9f888cf1400df3ad21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.268041 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.268587 28922 raft_consensus.cc:2243] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.268954 28922 raft_consensus.cc:2272] T 0023a413de544e98bf4dcc5242e2bfc9 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.271301 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.271862 28922 raft_consensus.cc:2243] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.272305 28922 raft_consensus.cc:2272] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.274701 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.275280 28922 raft_consensus.cc:2243] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.275758 28922 raft_consensus.cc:2272] T e33da5b7d1a743a4939aa6898bb11b93 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.278381 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.278935 28922 raft_consensus.cc:2243] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.279400 28922 raft_consensus.cc:2272] T 23510825c22a4843958883c7f521c5e2 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.281702 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.282219 28922 raft_consensus.cc:2243] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.282701 28922 raft_consensus.cc:2272] T 5ec2bfff7bb248d5b097081998724f71 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.285624 28922 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.286178 28922 raft_consensus.cc:2243] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.286693 28922 raft_consensus.cc:2272] T 6bcbcd79f9b5486587ed2ad92b0dac34 P c21911b82a6b4f9f888cf1400df3ad21 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:16.298243  4856 consensus_peers.cc:597] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.299626  4930 consensus_peers.cc:597] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.324312 28922 tablet_server.cc:196] TabletServer@127.28.62.129:45365 shutdown complete.
I20260709 13:15:16.352662 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:15:16.380916 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.381798 28922 tablet_replica.cc:333] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.382642 28922 raft_consensus.cc:2243] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.383127 28922 raft_consensus.cc:2272] T 53278a260d6d484ab3614e3ab2c69780 P 10eb54c560144c0f9dc735ef9be91cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.386343 28922 tablet_replica.cc:333] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.387077 28922 raft_consensus.cc:2243] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.387974 28922 raft_consensus.cc:2272] T 23510825c22a4843958883c7f521c5e2 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.390602 28922 tablet_replica.cc:333] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.391284 28922 raft_consensus.cc:2243] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.391712 28922 raft_consensus.cc:2272] T 5ec2bfff7bb248d5b097081998724f71 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.394533 28922 tablet_replica.cc:333] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.395102 28922 raft_consensus.cc:2243] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.395838 28922 raft_consensus.cc:2272] T 5a283a436eb74802b938b5f9369c89fe P 10eb54c560144c0f9dc735ef9be91cad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.398376 28922 tablet_replica.cc:333] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.398908 28922 raft_consensus.cc:2243] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.399397 28922 raft_consensus.cc:2272] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.401496 28922 tablet_replica.cc:333] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.401975 28922 raft_consensus.cc:2243] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.402792 28922 raft_consensus.cc:2272] T e33da5b7d1a743a4939aa6898bb11b93 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.405054 28922 tablet_replica.cc:333] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.405742 28922 raft_consensus.cc:2243] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.406222 28922 raft_consensus.cc:2272] T 0023a413de544e98bf4dcc5242e2bfc9 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.409422 28922 tablet_replica.cc:333] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
W20260709 13:15:16.409629  4929 consensus_peers.cc:597] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 -> Peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Couldn't send request to peer 10eb54c560144c0f9dc735ef9be91cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.410115 28922 raft_consensus.cc:2243] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.410688 28922 raft_consensus.cc:2272] T d70b5ff38ad24132a0e9a1ffc0c64210 P 10eb54c560144c0f9dc735ef9be91cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.413071 28922 tablet_replica.cc:333] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.413743 28922 raft_consensus.cc:2243] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.414209 28922 raft_consensus.cc:2272] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.416350 28922 tablet_replica.cc:333] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad: stopping tablet replica
I20260709 13:15:16.416852 28922 raft_consensus.cc:2243] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.417640 28922 raft_consensus.cc:2272] T 4c56d34b705b4a0e83159cd91a0bdd2b P 10eb54c560144c0f9dc735ef9be91cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.450820 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
W20260709 13:15:16.455875  4930 consensus_peers.cc:597] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.478113 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
W20260709 13:15:16.501681  4929 consensus_peers.cc:597] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 -> Peer 10eb54c560144c0f9dc735ef9be91cad (127.28.62.130:36395): Couldn't send request to peer 10eb54c560144c0f9dc735ef9be91cad. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:36395: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.502012  4930 consensus_peers.cc:597] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 -> Peer c21911b82a6b4f9f888cf1400df3ad21 (127.28.62.129:45365): Couldn't send request to peer c21911b82a6b4f9f888cf1400df3ad21. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:45365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.515421 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.516249 28922 tablet_replica.cc:333] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.516963 28922 raft_consensus.cc:2243] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.517860 28922 raft_consensus.cc:2272] T 5ec2bfff7bb248d5b097081998724f71 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.520232 28922 tablet_replica.cc:333] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.520864 28922 raft_consensus.cc:2243] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.521301 28922 raft_consensus.cc:2272] T 23510825c22a4843958883c7f521c5e2 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.523303 28922 tablet_replica.cc:333] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.523867 28922 raft_consensus.cc:2243] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.524680 28922 raft_consensus.cc:2272] T 53278a260d6d484ab3614e3ab2c69780 P 471b23bc542341c2ac372eac52b17a78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.528105 28922 tablet_replica.cc:333] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.528693 28922 raft_consensus.cc:2243] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.529210 28922 raft_consensus.cc:2272] T 5a283a436eb74802b938b5f9369c89fe P 471b23bc542341c2ac372eac52b17a78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.531322 28922 tablet_replica.cc:333] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.531848 28922 raft_consensus.cc:2243] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.532701 28922 raft_consensus.cc:2272] T d70b5ff38ad24132a0e9a1ffc0c64210 P 471b23bc542341c2ac372eac52b17a78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.534773 28922 tablet_replica.cc:333] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.535274 28922 raft_consensus.cc:2243] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.536016 28922 raft_consensus.cc:2272] T 5b5859b32cbc48bd9fddf1bc2a3be7a8 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.538190 28922 tablet_replica.cc:333] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.538722 28922 raft_consensus.cc:2243] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.539232 28922 raft_consensus.cc:2272] T e33da5b7d1a743a4939aa6898bb11b93 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.541496 28922 tablet_replica.cc:333] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.542002 28922 raft_consensus.cc:2243] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.542793 28922 raft_consensus.cc:2272] T 0023a413de544e98bf4dcc5242e2bfc9 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.545073 28922 tablet_replica.cc:333] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.545675 28922 raft_consensus.cc:2243] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.546047 28922 raft_consensus.cc:2272] T 4c56d34b705b4a0e83159cd91a0bdd2b P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.547839 28922 tablet_replica.cc:333] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78: stopping tablet replica
I20260709 13:15:16.548273 28922 raft_consensus.cc:2243] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.549079 28922 raft_consensus.cc:2272] T 6bcbcd79f9b5486587ed2ad92b0dac34 P 471b23bc542341c2ac372eac52b17a78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.585539 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:15:16.612406 28922 master.cc:562] Master@127.28.62.190:39513 shutting down...
I20260709 13:15:16.638827 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.639482 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.639870 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P dbcea0935a9b4788bb1839e8add5d8db: stopping tablet replica
I20260709 13:15:16.661319 28922 master.cc:584] Master@127.28.62.190:39513 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14779 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:15:16.711671 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:45651
I20260709 13:15:16.712894 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.719471  5302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.719723  5303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.720683  5305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.720708 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:16.721925 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:16.722114 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.722254 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602916722238 us; error 0 us; skew 500 ppm
I20260709 13:15:16.722833 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.725389 28922 webserver.cc:533] Webserver started at http://127.28.62.190:43307/ using document root <none> and password file <none>
I20260709 13:15:16.726248 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.726437 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.726734 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.727898 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "21b96d353f3241a9b300f13daed961e4"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-50cs"
I20260709 13:15:16.732489 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:15:16.736196  5310 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.737099 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:16.737576 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "21b96d353f3241a9b300f13daed961e4"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-50cs"
I20260709 13:15:16.738004 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.755110 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.756520 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.806422 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:45651
I20260709 13:15:16.806594  5361 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:45651 every 8 connection(s)
I20260709 13:15:16.811129  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.824443  5362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4: Bootstrap starting.
I20260709 13:15:16.830140  5362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.835026  5362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4: No bootstrap required, opened a new log
I20260709 13:15:16.837327  5362 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER }
I20260709 13:15:16.837754  5362 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.837934  5362 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b96d353f3241a9b300f13daed961e4, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.838544  5362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER }
I20260709 13:15:16.838979  5362 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:16.839177  5362 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:16.839408  5362 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.844997  5362 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER }
I20260709 13:15:16.845639  5362 leader_election.cc:304] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21b96d353f3241a9b300f13daed961e4; no voters: 
I20260709 13:15:16.846922  5362 leader_election.cc:290] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:16.847314  5365 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.848681  5365 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 1 LEADER]: Becoming Leader. State: Replica: 21b96d353f3241a9b300f13daed961e4, State: Running, Role: LEADER
I20260709 13:15:16.849529  5365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER }
I20260709 13:15:16.850055  5362 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:16.854403  5366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21b96d353f3241a9b300f13daed961e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER } }
I20260709 13:15:16.855262  5366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:16.857602  5371 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:16.857282  5367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b96d353f3241a9b300f13daed961e4. Latest consensus state: current_term: 1 leader_uuid: "21b96d353f3241a9b300f13daed961e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21b96d353f3241a9b300f13daed961e4" member_type: VOTER } }
I20260709 13:15:16.858023  5367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:16.862906  5371 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:16.867859 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:16.873184  5371 catalog_manager.cc:1383] Generated new cluster ID: 73c4367356f04b619a99f363760bcb66
I20260709 13:15:16.873557  5371 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:16.892952  5371 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:16.894367  5371 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:16.909122  5371 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4: Generated new TSK 0
I20260709 13:15:16.909889  5371 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:16.934993 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:16.942152  5383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.943622  5384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:16.945372  5386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:16.945909 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:16.946877 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:16.947062 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:16.947247 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602916947232 us; error 0 us; skew 500 ppm
I20260709 13:15:16.947890 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:16.950660 28922 webserver.cc:533] Webserver started at http://127.28.62.129:37521/ using document root <none> and password file <none>
I20260709 13:15:16.951175 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:16.951364 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:16.951793 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:16.952955 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "7f542979433b4bf0b10ff1cea4a28634"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-50cs"
I20260709 13:15:16.957926 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:16.961928  5391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.962971 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:15:16.963322 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "7f542979433b4bf0b10ff1cea4a28634"
format_stamp: "Formatted at 2026-07-09 13:15:16 on dist-test-slave-50cs"
I20260709 13:15:16.963642 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:16.977952 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:16.979220 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:16.980885 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:16.983409 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:16.983649 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:16.983925 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:16.984118 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.028227 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:34975
I20260709 13:15:17.028342  5453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:34975 every 8 connection(s)
I20260709 13:15:17.033723 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.044165  5458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.045243  5459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.047269  5461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.048645 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:17.049803  5454 heartbeater.cc:344] Connected to a master server at 127.28.62.190:45651
I20260709 13:15:17.049925 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.050293 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.050298  5454 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.050549 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602917050532 us; error 0 us; skew 500 ppm
I20260709 13:15:17.051277 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.051421  5454 heartbeater.cc:507] Master 127.28.62.190:45651 requested a full tablet report, sending...
I20260709 13:15:17.054069  5327 ts_manager.cc:194] Registered new tserver with Master: 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975)
I20260709 13:15:17.054177 28922 webserver.cc:533] Webserver started at http://127.28.62.130:35533/ using document root <none> and password file <none>
I20260709 13:15:17.054843 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.055058 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.055325 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.056334  5327 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48242
I20260709 13:15:17.056475 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-50cs"
I20260709 13:15:17.061691 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:15:17.065217  5466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.066425 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:17.066737 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-50cs"
I20260709 13:15:17.067011 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.076318 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.077984 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.079537 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.082182 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.082422 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.082721 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.082898 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.132296 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:45341
I20260709 13:15:17.132401  5528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:45341 every 8 connection(s)
I20260709 13:15:17.137461 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.146425  5532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.149838  5533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.151819  5535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.151958 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:17.152740  5529 heartbeater.cc:344] Connected to a master server at 127.28.62.190:45651
I20260709 13:15:17.153218  5529 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.153463 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.153784 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.153991 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602917153973 us; error 0 us; skew 500 ppm
I20260709 13:15:17.154161  5529 heartbeater.cc:507] Master 127.28.62.190:45651 requested a full tablet report, sending...
I20260709 13:15:17.154789 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.156715  5327 ts_manager.cc:194] Registered new tserver with Master: 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341)
I20260709 13:15:17.157888 28922 webserver.cc:533] Webserver started at http://127.28.62.131:34275/ using document root <none> and password file <none>
I20260709 13:15:17.158638 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.158926 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.158818  5327 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48252
I20260709 13:15:17.159389 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.161020 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "259d876b718d4b67a28f920e76440ea4"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-50cs"
I20260709 13:15:17.166046 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:15:17.169991  5540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.171007 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:15:17.171355 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "259d876b718d4b67a28f920e76440ea4"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-50cs"
I20260709 13:15:17.171634 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.188902 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.190303 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.191923 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.194465 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.194674 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.195020 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.195174 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.239373 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:33685
I20260709 13:15:17.239667  5602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:33685 every 8 connection(s)
I20260709 13:15:17.255188  5603 heartbeater.cc:344] Connected to a master server at 127.28.62.190:45651
I20260709 13:15:17.255714  5603 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.256493  5603 heartbeater.cc:507] Master 127.28.62.190:45651 requested a full tablet report, sending...
I20260709 13:15:17.258646  5327 ts_manager.cc:194] Registered new tserver with Master: 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:17.259131 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016399949s
I20260709 13:15:17.260180  5327 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48258
I20260709 13:15:17.287793  5327 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48264:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:17.290154  5327 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:17.334888  5494 tablet_service.cc:1511] Processing CreateTablet for tablet 730bc77061854aadbafee8dce30b298c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.335879  5493 tablet_service.cc:1511] Processing CreateTablet for tablet 820ed8d8dfae4292b719e7d940f5cf47 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.336485  5494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730bc77061854aadbafee8dce30b298c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.336815  5418 tablet_service.cc:1511] Processing CreateTablet for tablet 820ed8d8dfae4292b719e7d940f5cf47 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.338291  5418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ed8d8dfae4292b719e7d940f5cf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.338734  5419 tablet_service.cc:1511] Processing CreateTablet for tablet 730bc77061854aadbafee8dce30b298c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.340106  5419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730bc77061854aadbafee8dce30b298c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.337311  5493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ed8d8dfae4292b719e7d940f5cf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.351625  5568 tablet_service.cc:1511] Processing CreateTablet for tablet 730bc77061854aadbafee8dce30b298c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.353145  5568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730bc77061854aadbafee8dce30b298c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.362576  5567 tablet_service.cc:1511] Processing CreateTablet for tablet 820ed8d8dfae4292b719e7d940f5cf47 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=eb65cccd35c8491fabd0b4757927c5e0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.364126  5567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820ed8d8dfae4292b719e7d940f5cf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.365548  5618 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: Bootstrap starting.
I20260709 13:15:17.373188  5618 tablet_bootstrap.cc:654] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.376266  5619 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: Bootstrap starting.
I20260709 13:15:17.387897  5618 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: No bootstrap required, opened a new log
I20260709 13:15:17.388444  5618 ts_tablet_manager.cc:1403] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:15:17.389788  5619 tablet_bootstrap.cc:654] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.391594  5618 raft_consensus.cc:359] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.392287  5621 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: Bootstrap starting.
I20260709 13:15:17.392484  5618 raft_consensus.cc:385] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.392953  5618 raft_consensus.cc:740] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.393863  5618 consensus_queue.cc:260] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.396714  5618 ts_tablet_manager.cc:1434] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:15:17.396299  5454 heartbeater.cc:499] Master 127.28.62.190:45651 was elected leader, sending a full tablet report...
I20260709 13:15:17.398000  5618 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: Bootstrap starting.
I20260709 13:15:17.395848  5619 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: No bootstrap required, opened a new log
I20260709 13:15:17.399683  5619 ts_tablet_manager.cc:1403] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:15:17.401059  5621 tablet_bootstrap.cc:654] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.403046  5619 raft_consensus.cc:359] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.403892  5619 raft_consensus.cc:385] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.404204  5619 raft_consensus.cc:740] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.404793  5618 tablet_bootstrap.cc:654] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.405296  5619 consensus_queue.cc:260] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.413476  5529 heartbeater.cc:499] Master 127.28.62.190:45651 was elected leader, sending a full tablet report...
I20260709 13:15:17.413843  5618 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: No bootstrap required, opened a new log
I20260709 13:15:17.414402  5618 ts_tablet_manager.cc:1403] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:15:17.414631  5621 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: No bootstrap required, opened a new log
I20260709 13:15:17.415122  5621 ts_tablet_manager.cc:1403] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:15:17.417078  5619 ts_tablet_manager.cc:1434] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:15:17.417526  5618 raft_consensus.cc:359] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.418180  5619 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: Bootstrap starting.
I20260709 13:15:17.418356  5618 raft_consensus.cc:385] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.418089  5621 raft_consensus.cc:359] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.418870  5618 raft_consensus.cc:740] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.418931  5621 raft_consensus.cc:385] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.419359  5621 raft_consensus.cc:740] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.419862  5618 consensus_queue.cc:260] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.420131  5621 consensus_queue.cc:260] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.425915  5619 tablet_bootstrap.cc:654] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.427947  5618 ts_tablet_manager.cc:1434] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:17.429970  5603 heartbeater.cc:499] Master 127.28.62.190:45651 was elected leader, sending a full tablet report...
I20260709 13:15:17.430564  5621 ts_tablet_manager.cc:1434] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.004s
I20260709 13:15:17.433506  5621 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: Bootstrap starting.
I20260709 13:15:17.435056  5619 tablet_bootstrap.cc:492] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: No bootstrap required, opened a new log
I20260709 13:15:17.435685  5619 ts_tablet_manager.cc:1403] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 13:15:17.440137  5619 raft_consensus.cc:359] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.440860  5619 raft_consensus.cc:385] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.441262  5621 tablet_bootstrap.cc:654] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.441191  5619 raft_consensus.cc:740] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.442193  5619 consensus_queue.cc:260] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.444450  5619 ts_tablet_manager.cc:1434] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:15:17.448026  5621 tablet_bootstrap.cc:492] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: No bootstrap required, opened a new log
I20260709 13:15:17.448603  5621 ts_tablet_manager.cc:1403] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.006s
I20260709 13:15:17.451123  5621 raft_consensus.cc:359] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.451803  5621 raft_consensus.cc:385] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.452059  5621 raft_consensus.cc:740] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.452687  5621 consensus_queue.cc:260] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.454663  5621 ts_tablet_manager.cc:1434] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:15:17.575369  5623 raft_consensus.cc:493] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.576032  5623 raft_consensus.cc:515] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.578228  5623 leader_election.cc:290] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:17.588762  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" is_pre_election: true
I20260709 13:15:17.589212  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4" is_pre_election: true
I20260709 13:15:17.589675  5504 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 0.
I20260709 13:15:17.589929  5578 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 0.
I20260709 13:15:17.590984  5395 leader_election.cc:304] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:17.591745  5623 raft_consensus.cc:2804] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.592062  5623 raft_consensus.cc:493] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.592379  5623 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.597546  5623 raft_consensus.cc:515] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.599244  5623 leader_election.cc:290] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 election: Requested vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:17.600440  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:17.600440  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:17.601274  5504 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.601310  5578 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.609602  5578 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 1.
I20260709 13:15:17.609602  5504 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 1.
I20260709 13:15:17.610935  5393 leader_election.cc:304] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:17.611752  5623 raft_consensus.cc:2804] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.612746  5623 raft_consensus.cc:697] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Becoming Leader. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:17.613624  5623 consensus_queue.cc:237] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.615290  5625 raft_consensus.cc:493] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.615794  5625 raft_consensus.cc:515] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.618459  5625 leader_election.cc:290] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:17.623675  5326 catalog_manager.cc:5697] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "7f542979433b4bf0b10ff1cea4a28634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.629976  5429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f542979433b4bf0b10ff1cea4a28634" is_pre_election: true
I20260709 13:15:17.630751  5429 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 0.
I20260709 13:15:17.631430  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4" is_pre_election: true
I20260709 13:15:17.632159  5578 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 0.
I20260709 13:15:17.632113  5468 leader_election.cc:304] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:17.633214  5625 raft_consensus.cc:2804] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.633611  5625 raft_consensus.cc:493] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.633942  5625 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.640465  5625 raft_consensus.cc:515] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.642210  5625 leader_election.cc:290] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 1 election: Requested vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:17.643105  5429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
I20260709 13:15:17.643445  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:17.643785  5429 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.644178  5578 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.649763  5429 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 1.
I20260709 13:15:17.649781  5578 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 1.
I20260709 13:15:17.651104  5468 leader_election.cc:304] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:17.651810  5625 raft_consensus.cc:2804] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.653069  5625 raft_consensus.cc:697] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 LEADER]: Becoming Leader. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Running, Role: LEADER
I20260709 13:15:17.653891  5625 consensus_queue.cc:237] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.662308  5326 catalog_manager.cc:5697] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130). New cstate: current_term: 1 leader_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.738289  5326 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48266:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:17.740576  5326 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:17.766434  5419 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c6d496a964466905ab99f8e07aff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.767721  5419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c6d496a964466905ab99f8e07aff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.767489  5493 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c6d496a964466905ab99f8e07aff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.768899  5493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c6d496a964466905ab99f8e07aff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.770862  5567 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5c6d496a964466905ab99f8e07aff0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.771776  5418 tablet_service.cc:1511] Processing CreateTablet for tablet 3f872c33afd24ebf8294ad1f65155ee1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.772212  5567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5c6d496a964466905ab99f8e07aff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.772997  5418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f872c33afd24ebf8294ad1f65155ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.774295  5494 tablet_service.cc:1511] Processing CreateTablet for tablet 3f872c33afd24ebf8294ad1f65155ee1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.775468  5568 tablet_service.cc:1511] Processing CreateTablet for tablet 3f872c33afd24ebf8294ad1f65155ee1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f395cd17b1da422d9780389901b2bec9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.776712  5568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f872c33afd24ebf8294ad1f65155ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.775485  5494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f872c33afd24ebf8294ad1f65155ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.788241  5619 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: Bootstrap starting.
I20260709 13:15:17.794898  5618 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: Bootstrap starting.
I20260709 13:15:17.797786  5619 tablet_bootstrap.cc:654] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.805051  5621 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: Bootstrap starting.
I20260709 13:15:17.813218  5618 tablet_bootstrap.cc:654] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.814177  5621 tablet_bootstrap.cc:654] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.819696  5619 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: No bootstrap required, opened a new log
I20260709 13:15:17.820139  5619 ts_tablet_manager.cc:1403] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.003s
I20260709 13:15:17.820297  5618 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: No bootstrap required, opened a new log
I20260709 13:15:17.820489  5621 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: No bootstrap required, opened a new log
I20260709 13:15:17.820848  5618 ts_tablet_manager.cc:1403] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 13:15:17.820955  5621 ts_tablet_manager.cc:1403] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:15:17.822788  5619 raft_consensus.cc:359] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.823596  5619 raft_consensus.cc:385] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.823957  5619 raft_consensus.cc:740] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.824191  5621 raft_consensus.cc:359] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.824986  5621 raft_consensus.cc:385] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.824782  5618 raft_consensus.cc:359] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.825613  5621 raft_consensus.cc:740] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.824785  5619 consensus_queue.cc:260] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.825898  5618 raft_consensus.cc:385] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.826406  5618 raft_consensus.cc:740] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.826506  5621 consensus_queue.cc:260] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.827294  5618 consensus_queue.cc:260] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.828857  5621 ts_tablet_manager.cc:1434] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:17.829716  5619 ts_tablet_manager.cc:1434] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:17.829986  5621 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: Bootstrap starting.
I20260709 13:15:17.830849  5619 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Bootstrap starting.
I20260709 13:15:17.837718  5621 tablet_bootstrap.cc:654] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.839058  5619 tablet_bootstrap.cc:654] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.839715  5618 ts_tablet_manager.cc:1434] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:15:17.848031  5618 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: Bootstrap starting.
I20260709 13:15:17.858533  5623 raft_consensus.cc:493] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.859355  5623 raft_consensus.cc:515] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.864187  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" is_pre_election: true
W20260709 13:15:17.866582  5395 leader_election.cc:343] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.870054  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4" is_pre_election: true
W20260709 13:15:17.872530  5393 leader_election.cc:343] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.873179  5393 leader_election.cc:304] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f542979433b4bf0b10ff1cea4a28634; no voters: 259d876b718d4b67a28f920e76440ea4, 5c34feaa93fb41de9f1e2432ea566f6e
I20260709 13:15:17.874810  5632 raft_consensus.cc:2749] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.875901  5623 leader_election.cc:290] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
W20260709 13:15:17.878202  5375 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:17.878885  5618 tablet_bootstrap.cc:654] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.880604  5621 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: No bootstrap required, opened a new log
I20260709 13:15:17.881458  5621 ts_tablet_manager.cc:1403] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.024s
I20260709 13:15:17.884389  5619 tablet_bootstrap.cc:492] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: No bootstrap required, opened a new log
I20260709 13:15:17.884948  5619 ts_tablet_manager.cc:1403] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.021s
I20260709 13:15:17.884733  5621 raft_consensus.cc:359] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.885592  5621 raft_consensus.cc:385] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.885985  5621 raft_consensus.cc:740] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.886667  5618 tablet_bootstrap.cc:492] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: No bootstrap required, opened a new log
I20260709 13:15:17.887274  5618 ts_tablet_manager.cc:1403] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:15:17.886933  5621 consensus_queue.cc:260] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.889488  5621 ts_tablet_manager.cc:1434] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:17.890311  5618 raft_consensus.cc:359] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.890496  5619 raft_consensus.cc:359] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.891112  5618 raft_consensus.cc:385] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.891335  5619 raft_consensus.cc:385] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.891788  5619 raft_consensus.cc:740] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.892712  5619 consensus_queue.cc:260] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.895655  5619 ts_tablet_manager.cc:1434] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:17.891476  5618 raft_consensus.cc:740] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.897049  5618 consensus_queue.cc:260] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.898963  5618 ts_tablet_manager.cc:1434] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:15:17.910382  5627 raft_consensus.cc:493] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.910969  5627 raft_consensus.cc:515] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.913348  5627 leader_election.cc:290] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341)
I20260709 13:15:17.925669  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" is_pre_election: true
I20260709 13:15:17.926487  5504 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 0.
I20260709 13:15:17.926285  5429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f542979433b4bf0b10ff1cea4a28634" is_pre_election: true
I20260709 13:15:17.927294  5429 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 0.
I20260709 13:15:17.928061  5544 leader_election.cc:304] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 5c34feaa93fb41de9f1e2432ea566f6e; no voters: 
I20260709 13:15:17.929016  5627 raft_consensus.cc:2804] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.929455  5627 raft_consensus.cc:493] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.929859  5627 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.936076  5627 raft_consensus.cc:515] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.938026  5627 leader_election.cc:290] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 1 election: Requested vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341)
I20260709 13:15:17.938673  5429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
I20260709 13:15:17.939106  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:17.939210  5429 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.939710  5504 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.945366  5504 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 1.
I20260709 13:15:17.945377  5429 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 1.
I20260709 13:15:17.946619  5544 leader_election.cc:304] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 5c34feaa93fb41de9f1e2432ea566f6e; no voters: 
I20260709 13:15:17.947474  5627 raft_consensus.cc:2804] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.948498  5627 raft_consensus.cc:697] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 LEADER]: Becoming Leader. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Running, Role: LEADER
I20260709 13:15:17.949272  5627 consensus_queue.cc:237] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:17.956498  5325 catalog_manager.cc:5697] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 259d876b718d4b67a28f920e76440ea4 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "259d876b718d4b67a28f920e76440ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.076395  5623 raft_consensus.cc:493] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.076974  5623 raft_consensus.cc:515] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.078899  5623 leader_election.cc:290] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:18.079715  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c6d496a964466905ab99f8e07aff0" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" is_pre_election: true
I20260709 13:15:18.080050  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c6d496a964466905ab99f8e07aff0" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4" is_pre_election: true
I20260709 13:15:18.080382  5504 raft_consensus.cc:2468] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 0.
I20260709 13:15:18.080792  5578 raft_consensus.cc:2468] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 0.
I20260709 13:15:18.081511  5395 leader_election.cc:304] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:18.082270  5623 raft_consensus.cc:2804] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.082556  5623 raft_consensus.cc:493] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.082887  5623 raft_consensus.cc:3060] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.088155  5623 raft_consensus.cc:515] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.089953  5623 leader_election.cc:290] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 election: Requested vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:18.090790  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c6d496a964466905ab99f8e07aff0" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:18.090998  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5c6d496a964466905ab99f8e07aff0" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:18.091423  5504 raft_consensus.cc:3060] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.091564  5578 raft_consensus.cc:3060] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.096714  5504 raft_consensus.cc:2468] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 1.
I20260709 13:15:18.096710  5578 raft_consensus.cc:2468] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 1.
I20260709 13:15:18.098021  5393 leader_election.cc:304] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:18.098858  5623 raft_consensus.cc:2804] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.099363  5623 raft_consensus.cc:697] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Becoming Leader. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:18.100098  5623 consensus_queue.cc:237] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.107861  5325 catalog_manager.cc:5697] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "7f542979433b4bf0b10ff1cea4a28634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.112670  5623 consensus_queue.cc:1048] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.126186  5623 consensus_queue.cc:1048] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.150400  5625 consensus_queue.cc:1048] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.153651  5504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "730bc77061854aadbafee8dce30b298c"
dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
mode: GRACEFUL
new_leader_uuid: "7f542979433b4bf0b10ff1cea4a28634"
 from {username='slave'} at 127.0.0.1:55484
I20260709 13:15:18.154299  5504 raft_consensus.cc:606] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 LEADER]: Received request to transfer leadership to TS 7f542979433b4bf0b10ff1cea4a28634
I20260709 13:15:18.159399  5660 raft_consensus.cc:993] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: : Instructing follower 7f542979433b4bf0b10ff1cea4a28634 to start an election
I20260709 13:15:18.161206  5660 raft_consensus.cc:1081] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 LEADER]: Signalling peer 7f542979433b4bf0b10ff1cea4a28634 to start an election
I20260709 13:15:18.163846  5428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "730bc77061854aadbafee8dce30b298c"
dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:15:18.164492  5428 raft_consensus.cc:493] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.164880  5428 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.167089  5661 consensus_queue.cc:1048] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.173907  5428 raft_consensus.cc:515] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.176258  5428 leader_election.cc:290] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 2 election: Requested vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:18.178561  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:18.179194  5504 raft_consensus.cc:3055] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.179565  5504 raft_consensus.cc:740] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Running, Role: LEADER
I20260709 13:15:18.180461  5504 consensus_queue.cc:260] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
W20260709 13:15:18.181458  5625 consensus_queue.cc:1175] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "259d876b718d4b67a28f920e76440ea4" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:15:18.181663  5504 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.181239  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730bc77061854aadbafee8dce30b298c" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:18.182849  5578 raft_consensus.cc:3060] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.183414  5428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47"
dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
mode: GRACEFUL
new_leader_uuid: "259d876b718d4b67a28f920e76440ea4"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:15:18.184096  5428 raft_consensus.cc:606] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Received request to transfer leadership to TS 259d876b718d4b67a28f920e76440ea4
I20260709 13:15:18.190228  5504 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 2.
I20260709 13:15:18.190223  5578 raft_consensus.cc:2468] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 2.
I20260709 13:15:18.191659  5395 leader_election.cc:304] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:18.192646  5623 raft_consensus.cc:2804] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.193118  5623 raft_consensus.cc:697] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Becoming Leader. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:18.193900  5623 consensus_queue.cc:237] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.200783  5325 catalog_manager.cc:5697] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 reported cstate change: term changed from 1 to 2, leader changed from 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130) to 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "7f542979433b4bf0b10ff1cea4a28634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.205245  5578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1"
dest_uuid: "259d876b718d4b67a28f920e76440ea4"
mode: GRACEFUL
new_leader_uuid: "7f542979433b4bf0b10ff1cea4a28634"
 from {username='slave'} at 127.0.0.1:54578
I20260709 13:15:18.205912  5578 raft_consensus.cc:606] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 LEADER]: Received request to transfer leadership to TS 7f542979433b4bf0b10ff1cea4a28634
I20260709 13:15:18.364500  5627 consensus_queue.cc:1048] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.372879  5650 consensus_queue.cc:1048] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.378517  5666 raft_consensus.cc:993] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: : Instructing follower 7f542979433b4bf0b10ff1cea4a28634 to start an election
I20260709 13:15:18.379312  5666 raft_consensus.cc:1081] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 LEADER]: Signalling peer 7f542979433b4bf0b10ff1cea4a28634 to start an election
I20260709 13:15:18.381671  5429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1"
dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:15:18.382444  5429 raft_consensus.cc:493] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.382979  5429 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.393601  5429 raft_consensus.cc:515] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.394672  5428 raft_consensus.cc:1240] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Rejecting Update request from peer 259d876b718d4b67a28f920e76440ea4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:18.396322  5429 leader_election.cc:290] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 2 election: Requested vote from peers 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:18.397269  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:18.397735  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "7f542979433b4bf0b10ff1cea4a28634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:18.398128  5504 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.398398  5578 raft_consensus.cc:3055] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.398854  5578 raft_consensus.cc:740] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Running, Role: LEADER
I20260709 13:15:18.398866  5627 consensus_queue.cc:1059] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.400171  5578 consensus_queue.cc:260] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.401700  5578 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.408283  5504 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 2.
I20260709 13:15:18.410131  5395 leader_election.cc:304] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c34feaa93fb41de9f1e2432ea566f6e, 7f542979433b4bf0b10ff1cea4a28634; no voters: 
I20260709 13:15:18.411048  5623 raft_consensus.cc:2804] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.411516  5623 raft_consensus.cc:697] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Becoming Leader. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:18.412287  5623 consensus_queue.cc:237] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.414021  5578 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f542979433b4bf0b10ff1cea4a28634 in term 2.
I20260709 13:15:18.420493  5325 catalog_manager.cc:5697] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 reported cstate change: term changed from 1 to 2, leader changed from 259d876b718d4b67a28f920e76440ea4 (127.28.62.131) to 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "7f542979433b4bf0b10ff1cea4a28634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.642653  5623 consensus_queue.cc:1048] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.666764  5632 raft_consensus.cc:993] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: : Instructing follower 259d876b718d4b67a28f920e76440ea4 to start an election
I20260709 13:15:18.667625  5632 consensus_queue.cc:1048] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.668610  5670 raft_consensus.cc:1081] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Signalling peer 259d876b718d4b67a28f920e76440ea4 to start an election
I20260709 13:15:18.672012  5578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47"
dest_uuid: "259d876b718d4b67a28f920e76440ea4"
 from {username='slave'} at 127.0.0.1:54562
I20260709 13:15:18.672628  5578 raft_consensus.cc:493] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.673018  5578 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.681128  5578 raft_consensus.cc:515] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.684046  5428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
I20260709 13:15:18.684790  5428 raft_consensus.cc:3055] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.684679  5504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820ed8d8dfae4292b719e7d940f5cf47" candidate_uuid: "259d876b718d4b67a28f920e76440ea4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
I20260709 13:15:18.685262  5428 raft_consensus.cc:740] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:18.685536  5504 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.686269  5428 consensus_queue.cc:260] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.687608  5428 raft_consensus.cc:3060] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.683519  5578 leader_election.cc:290] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 2 election: Requested vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130:45341)
I20260709 13:15:18.694275  5504 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 2.
I20260709 13:15:18.695708  5428 raft_consensus.cc:2468] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 259d876b718d4b67a28f920e76440ea4 in term 2.
I20260709 13:15:18.695847  5544 leader_election.cc:304] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 5c34feaa93fb41de9f1e2432ea566f6e; no voters: 
I20260709 13:15:18.696905  5627 raft_consensus.cc:2804] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.697448  5627 raft_consensus.cc:697] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 2 LEADER]: Becoming Leader. State: Replica: 259d876b718d4b67a28f920e76440ea4, State: Running, Role: LEADER
I20260709 13:15:18.698187  5627 consensus_queue.cc:237] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:18.704309  5325 catalog_manager.cc:5697] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 reported cstate change: term changed from 1 to 2, leader changed from 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129) to 259d876b718d4b67a28f920e76440ea4 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "259d876b718d4b67a28f920e76440ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.753885  5578 raft_consensus.cc:1275] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Refusing update from remote peer 7f542979433b4bf0b10ff1cea4a28634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.755306  5672 consensus_queue.cc:1048] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.764194  5504 raft_consensus.cc:1275] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Refusing update from remote peer 7f542979433b4bf0b10ff1cea4a28634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.765926  5632 consensus_queue.cc:1048] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.878104  5504 raft_consensus.cc:1275] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Refusing update from remote peer 7f542979433b4bf0b10ff1cea4a28634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.879554  5632 consensus_queue.cc:1048] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.889969  5578 raft_consensus.cc:1275] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Refusing update from remote peer 7f542979433b4bf0b10ff1cea4a28634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:18.892346  5672 consensus_queue.cc:1048] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:18.956205 28922 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:15:18.957924 28922 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:15:18.958388 28922 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:15:18.971525  5428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1"
dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
mode: GRACEFUL
new_leader_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
 from {username='slave'} at 127.0.0.1:48154
I20260709 13:15:18.972184  5428 raft_consensus.cc:606] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Received request to transfer leadership to TS 5c34feaa93fb41de9f1e2432ea566f6e
I20260709 13:15:18.973369 28922 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:15:19.120558  5428 raft_consensus.cc:1275] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Refusing update from remote peer 259d876b718d4b67a28f920e76440ea4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.121906  5627 consensus_queue.cc:1048] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.130923  5504 raft_consensus.cc:1275] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Refusing update from remote peer 259d876b718d4b67a28f920e76440ea4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.132640  5666 consensus_queue.cc:1048] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.290449  5672 raft_consensus.cc:993] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: : Instructing follower 5c34feaa93fb41de9f1e2432ea566f6e to start an election
I20260709 13:15:19.291002  5671 raft_consensus.cc:1081] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Signalling peer 5c34feaa93fb41de9f1e2432ea566f6e to start an election
I20260709 13:15:19.292733  5504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1"
dest_uuid: "5c34feaa93fb41de9f1e2432ea566f6e"
 from {username='slave'} at 127.0.0.1:55464
I20260709 13:15:19.293325  5504 raft_consensus.cc:493] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.293709  5504 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.299484  5504 raft_consensus.cc:515] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:19.301159  5504 leader_election.cc:290] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 3 election: Requested vote from peers 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129:34975), 259d876b718d4b67a28f920e76440ea4 (127.28.62.131:33685)
I20260709 13:15:19.302171  5428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f542979433b4bf0b10ff1cea4a28634"
I20260709 13:15:19.302464  5578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f872c33afd24ebf8294ad1f65155ee1" candidate_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "259d876b718d4b67a28f920e76440ea4"
I20260709 13:15:19.302866  5428 raft_consensus.cc:3055] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:19.303061  5578 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.303246  5428 raft_consensus.cc:740] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f542979433b4bf0b10ff1cea4a28634, State: Running, Role: LEADER
I20260709 13:15:19.304121  5428 consensus_queue.cc:260] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:19.305109  5428 raft_consensus.cc:3060] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.308594  5578 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 3.
I20260709 13:15:19.310057  5468 leader_election.cc:304] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 259d876b718d4b67a28f920e76440ea4, 5c34feaa93fb41de9f1e2432ea566f6e; no voters: 
I20260709 13:15:19.310617  5428 raft_consensus.cc:2468] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c34feaa93fb41de9f1e2432ea566f6e in term 3.
I20260709 13:15:19.310834  5625 raft_consensus.cc:2804] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:19.312188  5625 raft_consensus.cc:697] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 LEADER]: Becoming Leader. State: Replica: 5c34feaa93fb41de9f1e2432ea566f6e, State: Running, Role: LEADER
I20260709 13:15:19.312983  5625 consensus_queue.cc:237] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } }
I20260709 13:15:19.318797  5325 catalog_manager.cc:5697] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e reported cstate change: term changed from 2 to 3, leader changed from 7f542979433b4bf0b10ff1cea4a28634 (127.28.62.129) to 5c34feaa93fb41de9f1e2432ea566f6e (127.28.62.130). New cstate: current_term: 3 leader_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f542979433b4bf0b10ff1cea4a28634" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c34feaa93fb41de9f1e2432ea566f6e" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "259d876b718d4b67a28f920e76440ea4" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.331352 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:15:19.353960 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.354784 28922 tablet_replica.cc:333] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634: stopping tablet replica
I20260709 13:15:19.355285 28922 raft_consensus.cc:2243] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.356025 28922 raft_consensus.cc:2272] T 6c5c6d496a964466905ab99f8e07aff0 P 7f542979433b4bf0b10ff1cea4a28634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.358263 28922 tablet_replica.cc:333] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634: stopping tablet replica
I20260709 13:15:19.358807 28922 raft_consensus.cc:2243] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.359203 28922 raft_consensus.cc:2272] T 3f872c33afd24ebf8294ad1f65155ee1 P 7f542979433b4bf0b10ff1cea4a28634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.361522 28922 tablet_replica.cc:333] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634: stopping tablet replica
I20260709 13:15:19.362109 28922 raft_consensus.cc:2243] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.362541 28922 raft_consensus.cc:2272] T 820ed8d8dfae4292b719e7d940f5cf47 P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.364734 28922 tablet_replica.cc:333] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634: stopping tablet replica
I20260709 13:15:19.365233 28922 raft_consensus.cc:2243] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.366117 28922 raft_consensus.cc:2272] T 730bc77061854aadbafee8dce30b298c P 7f542979433b4bf0b10ff1cea4a28634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.381089 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
I20260709 13:15:19.393226 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:15:19.413609 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.414250 28922 tablet_replica.cc:333] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e: stopping tablet replica
I20260709 13:15:19.414841 28922 raft_consensus.cc:2243] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.415297 28922 raft_consensus.cc:2272] T 6c5c6d496a964466905ab99f8e07aff0 P 5c34feaa93fb41de9f1e2432ea566f6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.417666 28922 tablet_replica.cc:333] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: stopping tablet replica
I20260709 13:15:19.418185 28922 raft_consensus.cc:2243] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.418789 28922 pending_rounds.cc:70] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Trying to abort 1 pending ops.
I20260709 13:15:19.418985 28922 pending_rounds.cc:77] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637557512916992 op_type: NO_OP noop_request { }
I20260709 13:15:19.419317 28922 raft_consensus.cc:2889] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:19.419592 28922 raft_consensus.cc:2272] T 3f872c33afd24ebf8294ad1f65155ee1 P 5c34feaa93fb41de9f1e2432ea566f6e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.421720 28922 tablet_replica.cc:333] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e: stopping tablet replica
I20260709 13:15:19.422225 28922 raft_consensus.cc:2243] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.422648 28922 raft_consensus.cc:2272] T 820ed8d8dfae4292b719e7d940f5cf47 P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.424924 28922 tablet_replica.cc:333] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e: stopping tablet replica
I20260709 13:15:19.425438 28922 raft_consensus.cc:2243] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.425870 28922 raft_consensus.cc:2272] T 730bc77061854aadbafee8dce30b298c P 5c34feaa93fb41de9f1e2432ea566f6e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.449604 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
I20260709 13:15:19.462229 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
I20260709 13:15:19.482045 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.482678 28922 tablet_replica.cc:333] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4: stopping tablet replica
I20260709 13:15:19.483237 28922 raft_consensus.cc:2243] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.483675 28922 raft_consensus.cc:2272] T 6c5c6d496a964466905ab99f8e07aff0 P 259d876b718d4b67a28f920e76440ea4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.486056 28922 tablet_replica.cc:333] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4: stopping tablet replica
I20260709 13:15:19.486591 28922 raft_consensus.cc:2243] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.487030 28922 raft_consensus.cc:2272] T 730bc77061854aadbafee8dce30b298c P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.490005 28922 tablet_replica.cc:333] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4: stopping tablet replica
I20260709 13:15:19.490511 28922 raft_consensus.cc:2243] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.490926 28922 raft_consensus.cc:2272] T 3f872c33afd24ebf8294ad1f65155ee1 P 259d876b718d4b67a28f920e76440ea4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.493296 28922 tablet_replica.cc:333] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4: stopping tablet replica
I20260709 13:15:19.493880 28922 raft_consensus.cc:2243] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.494817 28922 raft_consensus.cc:2272] T 820ed8d8dfae4292b719e7d940f5cf47 P 259d876b718d4b67a28f920e76440ea4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.520517 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:15:19.532605 28922 master.cc:562] Master@127.28.62.190:45651 shutting down...
I20260709 13:15:19.549930 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.550457 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.550734 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 21b96d353f3241a9b300f13daed961e4: stopping tablet replica
I20260709 13:15:19.562435 28922 master.cc:584] Master@127.28.62.190:45651 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2878 ms)
[----------] 6 tests from LeaderRebalancerTest (284706 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:15:19.590622 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:44959
I20260709 13:15:19.591744 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:19.597015  5684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.597224  5685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.598407  5687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:19.599493 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:19.600303 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:19.600468 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:19.600577 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602919600567 us; error 0 us; skew 500 ppm
I20260709 13:15:19.601037 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:19.603580 28922 webserver.cc:533] Webserver started at http://127.28.62.190:35139/ using document root <none> and password file <none>
I20260709 13:15:19.604043 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:19.604195 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:19.604420 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:19.605541 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "16dfbcb15de54dbaa2db2b9247e04476"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.610039 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:15:19.613997  5692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.614809 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:19.615110 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "16dfbcb15de54dbaa2db2b9247e04476"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.615430 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:19.630249 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:19.631282 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:19.668954 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:44959
I20260709 13:15:19.669062  5743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:44959 every 8 connection(s)
I20260709 13:15:19.673010  5744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.684504  5744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: Bootstrap starting.
I20260709 13:15:19.689564  5744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.693785  5744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: No bootstrap required, opened a new log
I20260709 13:15:19.695876  5744 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER }
I20260709 13:15:19.696255  5744 raft_consensus.cc:385] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.696516  5744 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16dfbcb15de54dbaa2db2b9247e04476, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.697175  5744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER }
I20260709 13:15:19.697659  5744 raft_consensus.cc:399] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:19.697892  5744 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:19.698189  5744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.703264  5744 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER }
I20260709 13:15:19.703820  5744 leader_election.cc:304] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16dfbcb15de54dbaa2db2b9247e04476; no voters: 
I20260709 13:15:19.704994  5744 leader_election.cc:290] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:19.705350  5747 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.706907  5747 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 1 LEADER]: Becoming Leader. State: Replica: 16dfbcb15de54dbaa2db2b9247e04476, State: Running, Role: LEADER
I20260709 13:15:19.707573  5747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER }
I20260709 13:15:19.707948  5744 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:19.710556  5749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16dfbcb15de54dbaa2db2b9247e04476. Latest consensus state: current_term: 1 leader_uuid: "16dfbcb15de54dbaa2db2b9247e04476" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER } }
I20260709 13:15:19.710520  5748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16dfbcb15de54dbaa2db2b9247e04476" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dfbcb15de54dbaa2db2b9247e04476" member_type: VOTER } }
I20260709 13:15:19.711393  5749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:19.711494  5748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:19.717367  5752 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:19.724931  5752 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:19.725998 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:19.734061  5752 catalog_manager.cc:1383] Generated new cluster ID: d2dcaccdf906400e87adf1eac75976d0
I20260709 13:15:19.734381  5752 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:19.756920  5752 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:19.758265  5752 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:19.774286  5752 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: Generated new TSK 0
I20260709 13:15:19.774976  5752 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:19.793226 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:19.799875  5765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.800881  5766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.802665  5768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:19.803825 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:19.804646 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:19.804824 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:19.804945 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602919804935 us; error 0 us; skew 500 ppm
I20260709 13:15:19.805506 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:19.807766 28922 webserver.cc:533] Webserver started at http://127.28.62.129:43007/ using document root <none> and password file <none>
I20260709 13:15:19.808208 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:19.808368 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:19.808576 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:19.809851 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "f9904405e5b34e2f8959e4466bafd719"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.814525 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:15:19.818589  5773 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.819497 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:19.819864 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "f9904405e5b34e2f8959e4466bafd719"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.820182 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:19.836393 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:19.837777 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:19.839421 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:19.842078 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:19.842337 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.842620 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:19.842839 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.887820 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:34391
I20260709 13:15:19.887928  5835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:34391 every 8 connection(s)
I20260709 13:15:19.893059 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:19.901023  5840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.903509  5841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.905153  5843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:19.906333 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:19.907292 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:19.907555 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:19.907763 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602919907747 us; error 0 us; skew 500 ppm
I20260709 13:15:19.908339 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:19.909068  5836 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44959
I20260709 13:15:19.909466  5836 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:19.910364  5836 heartbeater.cc:507] Master 127.28.62.190:44959 requested a full tablet report, sending...
I20260709 13:15:19.911281 28922 webserver.cc:533] Webserver started at http://127.28.62.130:43609/ using document root <none> and password file <none>
I20260709 13:15:19.911989 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:19.912232 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:19.912539 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:19.912671  5709 ts_manager.cc:194] Registered new tserver with Master: f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391)
I20260709 13:15:19.913981 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "457c66bee59943bb9eec876c57217880"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.914747  5709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45520
I20260709 13:15:19.919315 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:19.923090  5848 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.923951 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:19.924258 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "457c66bee59943bb9eec876c57217880"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-50cs"
I20260709 13:15:19.924564 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:19.941959 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:19.943045 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:19.944487 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:19.947089 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:19.947448 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:19.947718 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:19.947860 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.991506 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:45083
I20260709 13:15:19.991634  5910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:45083 every 8 connection(s)
I20260709 13:15:19.996563 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:20.004761  5915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.005164  5914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.008798  5911 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44959
I20260709 13:15:20.009382  5911 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:20.009394 28922 server_base.cc:1061] running on GCE node
W20260709 13:15:20.010308  5917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.010751  5911 heartbeater.cc:507] Master 127.28.62.190:44959 requested a full tablet report, sending...
I20260709 13:15:20.011436 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:20.011747 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:20.011968 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602920011928 us; error 0 us; skew 500 ppm
I20260709 13:15:20.012596 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:20.013388  5709 ts_manager.cc:194] Registered new tserver with Master: 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.015493 28922 webserver.cc:533] Webserver started at http://127.28.62.131:33429/ using document root <none> and password file <none>
I20260709 13:15:20.015493  5709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45536
I20260709 13:15:20.016355 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:20.016722 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:20.017105 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:20.018527 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "0e70316d89b848e3bef9eef69289fe16"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-50cs"
I20260709 13:15:20.023370 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:20.027287  5922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.028141 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:20.028415 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "0e70316d89b848e3bef9eef69289fe16"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-50cs"
I20260709 13:15:20.028653 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:20.046181 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:20.047401 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:20.049074 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:20.051977 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:20.052297 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.052642 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:20.052807 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.100025 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:41569
I20260709 13:15:20.100150  5984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:41569 every 8 connection(s)
I20260709 13:15:20.115360  5985 heartbeater.cc:344] Connected to a master server at 127.28.62.190:44959
I20260709 13:15:20.115927  5985 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:20.117213  5985 heartbeater.cc:507] Master 127.28.62.190:44959 requested a full tablet report, sending...
I20260709 13:15:20.119580  5709 ts_manager.cc:194] Registered new tserver with Master: 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.119984 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016285311s
I20260709 13:15:20.121099  5709 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45546
I20260709 13:15:20.147914  5709 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45554:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:20.150610  5709 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:20.219308  5801 tablet_service.cc:1511] Processing CreateTablet for tablet ab618523bbab4ce79ed14444ed2c4455 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.222219  5801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab618523bbab4ce79ed14444ed2c4455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.228355  5800 tablet_service.cc:1511] Processing CreateTablet for tablet 253e2b31349f43d6a620793fad5a3748 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.229971  5800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253e2b31349f43d6a620793fad5a3748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.229637  5950 tablet_service.cc:1511] Processing CreateTablet for tablet ab618523bbab4ce79ed14444ed2c4455 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.231132  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab618523bbab4ce79ed14444ed2c4455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.231863  5799 tablet_service.cc:1511] Processing CreateTablet for tablet 8960c3262d8a48cc8fca2c7d4993886f (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.233523  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 253e2b31349f43d6a620793fad5a3748 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.234508  5798 tablet_service.cc:1511] Processing CreateTablet for tablet a4d6a9a05e4643b5b2a3713f6b9496ef (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.235014  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253e2b31349f43d6a620793fad5a3748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.237903  5876 tablet_service.cc:1511] Processing CreateTablet for tablet ab618523bbab4ce79ed14444ed2c4455 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.238595  5873 tablet_service.cc:1511] Processing CreateTablet for tablet a4d6a9a05e4643b5b2a3713f6b9496ef (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.238866  5948 tablet_service.cc:1511] Processing CreateTablet for tablet 8960c3262d8a48cc8fca2c7d4993886f (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.239384  5876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab618523bbab4ce79ed14444ed2c4455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.240410  5948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960c3262d8a48cc8fca2c7d4993886f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.242552  5875 tablet_service.cc:1511] Processing CreateTablet for tablet 253e2b31349f43d6a620793fad5a3748 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.242681  5947 tablet_service.cc:1511] Processing CreateTablet for tablet a4d6a9a05e4643b5b2a3713f6b9496ef (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.243984  5875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253e2b31349f43d6a620793fad5a3748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.244356  5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d6a9a05e4643b5b2a3713f6b9496ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.240794  5874 tablet_service.cc:1511] Processing CreateTablet for tablet 8960c3262d8a48cc8fca2c7d4993886f (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.246565  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960c3262d8a48cc8fca2c7d4993886f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.249862  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d6a9a05e4643b5b2a3713f6b9496ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.233273  5799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8960c3262d8a48cc8fca2c7d4993886f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.257819  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d6a9a05e4643b5b2a3713f6b9496ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.263478  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4993ed1544f46a9d2f98d9750acd6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.265175  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4993ed1544f46a9d2f98d9750acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.289330  6000 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.296718  5950 tablet_service.cc:1511] Processing CreateTablet for tablet 61328a6f4dca43098ec02f9aa155ac49 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.299034  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61328a6f4dca43098ec02f9aa155ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.304718  6000 tablet_bootstrap.cc:654] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.307487  5797 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4993ed1544f46a9d2f98d9750acd6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.309257  5876 tablet_service.cc:1511] Processing CreateTablet for tablet 61328a6f4dca43098ec02f9aa155ac49 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.310842  5876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61328a6f4dca43098ec02f9aa155ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.311412  5796 tablet_service.cc:1511] Processing CreateTablet for tablet 61328a6f4dca43098ec02f9aa155ac49 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.309289  5797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4993ed1544f46a9d2f98d9750acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.313191  5872 tablet_service.cc:1511] Processing CreateTablet for tablet 8e326a0ffae549d1961dfbead862502c (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.313731  5795 tablet_service.cc:1511] Processing CreateTablet for tablet 8e326a0ffae549d1961dfbead862502c (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.314877  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e326a0ffae549d1961dfbead862502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.315263  5795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e326a0ffae549d1961dfbead862502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.316939  5945 tablet_service.cc:1511] Processing CreateTablet for tablet 8e326a0ffae549d1961dfbead862502c (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.319262  5796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61328a6f4dca43098ec02f9aa155ac49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.323971  5794 tablet_service.cc:1511] Processing CreateTablet for tablet a2380be395ee4191914e5e1a66aceaa6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.325233  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e326a0ffae549d1961dfbead862502c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.325695  5794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2380be395ee4191914e5e1a66aceaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.326212  5944 tablet_service.cc:1511] Processing CreateTablet for tablet a2380be395ee4191914e5e1a66aceaa6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.327622  5944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2380be395ee4191914e5e1a66aceaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.331092  5875 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4993ed1544f46a9d2f98d9750acd6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.332865  5875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4993ed1544f46a9d2f98d9750acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.348613  6001 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.363298  5871 tablet_service.cc:1511] Processing CreateTablet for tablet a2380be395ee4191914e5e1a66aceaa6 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.365123  5871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2380be395ee4191914e5e1a66aceaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.367012  6001 tablet_bootstrap.cc:654] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.405002  6003 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.401503  6000 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.410812  6000 ts_tablet_manager.cc:1403] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.003s
I20260709 13:15:20.411527  5874 tablet_service.cc:1511] Processing CreateTablet for tablet ab50f69c63604e76a6016c58e8e38d29 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.413048  5950 tablet_service.cc:1511] Processing CreateTablet for tablet ab50f69c63604e76a6016c58e8e38d29 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.414618  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab50f69c63604e76a6016c58e8e38d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.414423  6000 raft_consensus.cc:359] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.415321  6000 raft_consensus.cc:385] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.415660  6000 raft_consensus.cc:740] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.424401  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab50f69c63604e76a6016c58e8e38d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.426388  5799 tablet_service.cc:1511] Processing CreateTablet for tablet ab50f69c63604e76a6016c58e8e38d29 (DEFAULT_TABLE table=test-workload [id=50cbc773b0b54515a49549887546f8f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.431607  5799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab50f69c63604e76a6016c58e8e38d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.437623  6003 tablet_bootstrap.cc:654] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.443708  6001 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.447639  6001 ts_tablet_manager.cc:1403] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.025s
I20260709 13:15:20.450593  6001 raft_consensus.cc:359] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.451413  6001 raft_consensus.cc:385] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.451761  6001 raft_consensus.cc:740] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.452641  6001 consensus_queue.cc:260] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.456290  6000 consensus_queue.cc:260] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.467085  5985 heartbeater.cc:499] Master 127.28.62.190:44959 was elected leader, sending a full tablet report...
I20260709 13:15:20.468766  6001 ts_tablet_manager.cc:1434] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.006s
I20260709 13:15:20.469164  5911 heartbeater.cc:499] Master 127.28.62.190:44959 was elected leader, sending a full tablet report...
I20260709 13:15:20.473680  6000 ts_tablet_manager.cc:1434] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.001s
I20260709 13:15:20.475512  6001 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.473727  6003 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.476557  6003 ts_tablet_manager.cc:1403] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.017s
I20260709 13:15:20.479597  6003 raft_consensus.cc:359] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.480139  6003 raft_consensus.cc:385] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.480332  6003 raft_consensus.cc:740] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.480978  6003 consensus_queue.cc:260] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.475576  6000 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.483966  6001 tablet_bootstrap.cc:654] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.487694  6000 tablet_bootstrap.cc:654] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.501709  6000 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.502506  6000 ts_tablet_manager.cc:1403] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:15:20.506681  6000 raft_consensus.cc:359] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.507673  6000 raft_consensus.cc:385] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.508167  6000 raft_consensus.cc:740] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.509598  6000 consensus_queue.cc:260] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.513130  6000 ts_tablet_manager.cc:1434] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:20.514720  6000 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.524849  6000 tablet_bootstrap.cc:654] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.531024  5836 heartbeater.cc:499] Master 127.28.62.190:44959 was elected leader, sending a full tablet report...
I20260709 13:15:20.534089  6001 tablet_bootstrap.cc:492] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.534848  6001 ts_tablet_manager.cc:1403] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.033s
I20260709 13:15:20.538461  6001 raft_consensus.cc:359] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.539458  6001 raft_consensus.cc:385] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.539923  6001 raft_consensus.cc:740] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.541172  6001 consensus_queue.cc:260] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.542958  6003 ts_tablet_manager.cc:1434] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.066s	user 0.027s	sys 0.023s
I20260709 13:15:20.544113  6001 ts_tablet_manager.cc:1434] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:20.544677  6003 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.545637  6001 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.551949  6003 tablet_bootstrap.cc:654] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.554095  6001 tablet_bootstrap.cc:654] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.556912  6000 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.557884  6000 ts_tablet_manager.cc:1403] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.004s
I20260709 13:15:20.562070  6000 raft_consensus.cc:359] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.563396  6000 raft_consensus.cc:385] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.563906  6000 raft_consensus.cc:740] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.565276  6000 consensus_queue.cc:260] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.568043  6001 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.568589  6003 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.569420  6003 ts_tablet_manager.cc:1403] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 13:15:20.570408  6000 ts_tablet_manager.cc:1434] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:20.571285  6000 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.568662  6001 ts_tablet_manager.cc:1403] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:15:20.572907  6003 raft_consensus.cc:359] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.573879  6003 raft_consensus.cc:385] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.574271  6007 raft_consensus.cc:493] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.574265  6003 raft_consensus.cc:740] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.574965  6007 raft_consensus.cc:515] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.575515  6003 consensus_queue.cc:260] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.578186  6000 tablet_bootstrap.cc:654] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.578382  6003 ts_tablet_manager.cc:1434] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:15:20.579653  6003 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.584021  6007 leader_election.cc:290] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.584898  6007 raft_consensus.cc:493] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.585467  6007 raft_consensus.cc:515] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.587872  6003 tablet_bootstrap.cc:654] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.588711  6007 leader_election.cc:290] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.589993  6001 raft_consensus.cc:359] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.590873  6001 raft_consensus.cc:385] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.591217  6001 raft_consensus.cc:740] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.592279  6000 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.592208  6001 consensus_queue.cc:260] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.592866  6000 ts_tablet_manager.cc:1403] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:15:20.596187  6000 raft_consensus.cc:359] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.596985  6000 raft_consensus.cc:385] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.597299  6000 raft_consensus.cc:740] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.598207  6001 ts_tablet_manager.cc:1434] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:15:20.599364  6001 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.603807  6006 raft_consensus.cc:493] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.604427  6006 raft_consensus.cc:515] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.605784  6001 tablet_bootstrap.cc:654] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.610211  6006 leader_election.cc:290] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.617971  6001 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.618933  6001 ts_tablet_manager.cc:1403] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:15:20.623087  6001 raft_consensus.cc:359] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.624322  6001 raft_consensus.cc:385] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.624804  6001 raft_consensus.cc:740] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.625955  6001 consensus_queue.cc:260] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.631718  6001 ts_tablet_manager.cc:1434] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:15:20.632925  6001 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.634354  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:20.635160  5960 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.636405  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:20.637176  5959 raft_consensus.cc:2468] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.638794  5850 leader_election.cc:304] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.639894  5850 leader_election.cc:304] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.640905  6007 raft_consensus.cc:2804] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.641283  6007 raft_consensus.cc:493] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.641654  6007 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.642047  6001 tablet_bootstrap.cc:654] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.649832  6017 raft_consensus.cc:2804] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.650594  6017 raft_consensus.cc:493] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.650957  6017 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.652978  6007 raft_consensus.cc:515] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.662137  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:20.662815  5959 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.669205  6001 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.669938  6001 ts_tablet_manager.cc:1403] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.002s
I20260709 13:15:20.670900  5959 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:20.672322  5850 leader_election.cc:304] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.675194  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.675706  5810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.676493  5811 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.677369  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.678110  5809 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.678411  6001 raft_consensus.cc:359] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.679177  6001 raft_consensus.cc:385] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.679489  6001 raft_consensus.cc:740] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.680325  6001 consensus_queue.cc:260] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
W20260709 13:15:20.682379  5852 leader_election.cc:343] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.682813  6001 ts_tablet_manager.cc:1434] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:15:20.687009  6017 raft_consensus.cc:515] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.688656  5809 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:20.689999  6017 leader_election.cc:290] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.690250  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.654038  6000 consensus_queue.cc:260] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
W20260709 13:15:20.691773  5852 leader_election.cc:343] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.693037  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:20.693547  6000 ts_tablet_manager.cc:1434] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:15:20.693766  5960 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.694691  6000 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.700848  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:20.701493  6007 leader_election.cc:290] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.701725  5886 raft_consensus.cc:2468] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:20.703651  6023 raft_consensus.cc:2804] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.703750  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.703991  6001 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.704624  6023 raft_consensus.cc:697] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:20.705770  6023 consensus_queue.cc:237] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.710666  6000 tablet_bootstrap.cc:654] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.711949  6003 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.712586  6003 ts_tablet_manager.cc:1403] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.133s	user 0.033s	sys 0.078s
I20260709 13:15:20.703603  5926 leader_election.cc:304] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.713714  6001 tablet_bootstrap.cc:654] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.715214  6006 raft_consensus.cc:2804] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.715708  6006 raft_consensus.cc:493] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.716147  6006 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.717845  5960 raft_consensus.cc:2468] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
W20260709 13:15:20.719019  5757 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:20.719321  5850 leader_election.cc:304] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:20.720428  6007 raft_consensus.cc:2804] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.721055  6007 raft_consensus.cc:697] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:20.722208  6007 consensus_queue.cc:237] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.730165  6006 raft_consensus.cc:515] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
W20260709 13:15:20.726052  5926 leader_election.cc:343] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.730973  6003 raft_consensus.cc:359] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.733105  6003 raft_consensus.cc:385] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.734107  6003 raft_consensus.cc:740] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.735633  6000 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.735391  6003 consensus_queue.cc:260] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.736218  6000 ts_tablet_manager.cc:1403] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.012s
I20260709 13:15:20.737943  6003 ts_tablet_manager.cc:1434] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:15:20.739020  6003 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.739326  6000 raft_consensus.cc:359] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.738958  5709 catalog_manager.cc:5697] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.740087  6000 raft_consensus.cc:385] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.740434  6000 raft_consensus.cc:740] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.741303  6000 consensus_queue.cc:260] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.743654  6000 ts_tablet_manager.cc:1434] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:20.744037  6006 leader_election.cc:290] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.744653  6000 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.746954  6003 tablet_bootstrap.cc:654] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.747128  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.749568  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:20.750154  5886 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.758168  6001 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.758858  6001 ts_tablet_manager.cc:1403] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.010s
W20260709 13:15:20.758893  5926 leader_election.cc:343] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.758111  5886 raft_consensus.cc:2468] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:20.760586  5926 leader_election.cc:304] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:20.762456  6001 raft_consensus.cc:359] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.763353  6001 raft_consensus.cc:385] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.763712  6001 raft_consensus.cc:740] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.764648  6001 consensus_queue.cc:260] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.767119  6001 ts_tablet_manager.cc:1434] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:20.769476  6001 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.770314  6003 tablet_bootstrap.cc:492] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.770918  6003 ts_tablet_manager.cc:1403] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.011s
I20260709 13:15:20.774170  6003 raft_consensus.cc:359] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.774946  6003 raft_consensus.cc:385] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.775262  6003 raft_consensus.cc:740] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.776114  6003 consensus_queue.cc:260] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.778141  6001 tablet_bootstrap.cc:654] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.767755  6000 tablet_bootstrap.cc:654] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.768278  6006 raft_consensus.cc:2804] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.781369  6003 ts_tablet_manager.cc:1434] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:20.794060  6006 raft_consensus.cc:697] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:20.797509  6003 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.797698  6006 consensus_queue.cc:237] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.803234  6000 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.803139  6001 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.804049  6000 ts_tablet_manager.cc:1403] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.007s
I20260709 13:15:20.804039  6001 ts_tablet_manager.cc:1403] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.010s
I20260709 13:15:20.807485  6000 raft_consensus.cc:359] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.807695  6001 raft_consensus.cc:359] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.808405  6000 raft_consensus.cc:385] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.808416  6001 raft_consensus.cc:385] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.809723  6000 raft_consensus.cc:740] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.809803  6001 raft_consensus.cc:740] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.811070  6001 consensus_queue.cc:260] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.812806  6000 consensus_queue.cc:260] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.814268  6001 ts_tablet_manager.cc:1434] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:15:20.815390  6001 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.815918  6000 ts_tablet_manager.cc:1434] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:20.816800  6000 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.807731  6003 tablet_bootstrap.cc:654] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.822757  6000 tablet_bootstrap.cc:654] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.824157  6003 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.824899  6003 ts_tablet_manager.cc:1403] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 13:15:20.824084  5709 catalog_manager.cc:5697] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.828404  6003 raft_consensus.cc:359] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.829183  6003 raft_consensus.cc:385] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.829514  6003 raft_consensus.cc:740] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.829628  6001 tablet_bootstrap.cc:654] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.829943  6023 raft_consensus.cc:493] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.838057  5704 catalog_manager.cc:5697] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.838403  6023 raft_consensus.cc:515] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.830438  6003 consensus_queue.cc:260] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.842397  6003 ts_tablet_manager.cc:1434] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:20.842849  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:20.843609  5960 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.836869  6000 tablet_bootstrap.cc:492] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.844740  6000 ts_tablet_manager.cc:1403] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.000s
I20260709 13:15:20.846662  5850 leader_election.cc:304] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.847674  6007 raft_consensus.cc:2804] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.848085  6007 raft_consensus.cc:493] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.848487  6007 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.848680  6000 raft_consensus.cc:359] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.843708  6003 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.849797  6000 raft_consensus.cc:385] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.850276  6000 raft_consensus.cc:740] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.851553  6000 consensus_queue.cc:260] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.854987  6000 ts_tablet_manager.cc:1434] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:20.856633  6000 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.857647  6003 tablet_bootstrap.cc:654] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.844990  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.859817  5809 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.865564  6023 leader_election.cc:290] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.867486  6000 tablet_bootstrap.cc:654] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.870613  6007 raft_consensus.cc:515] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.873762  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.874389  5809 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.874389  6006 raft_consensus.cc:493] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.878275  6006 raft_consensus.cc:515] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.879355  6000 tablet_bootstrap.cc:492] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.879918  6000 ts_tablet_manager.cc:1403] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:15:20.880874  6006 leader_election.cc:290] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.882715  6003 tablet_bootstrap.cc:492] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.882815  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.884593  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:20.885556  5886 raft_consensus.cc:2468] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:20.883299  6003 ts_tablet_manager.cc:1403] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.008s
I20260709 13:15:20.887681  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:20.888276  5960 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.888447  5809 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
W20260709 13:15:20.889736  5926 leader_election.cc:343] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.889766  5852 leader_election.cc:304] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:20.890722  5926 leader_election.cc:304] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:20.890983  6023 raft_consensus.cc:2804] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.891486  6023 raft_consensus.cc:697] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:20.891585  6000 raft_consensus.cc:359] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.892655  6000 raft_consensus.cc:385] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.892365  6023 consensus_queue.cc:237] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.893010  6000 raft_consensus.cc:740] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.893657  6006 raft_consensus.cc:2804] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.894150  6006 raft_consensus.cc:493] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.894531  6000 consensus_queue.cc:260] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.896333  6007 leader_election.cc:290] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.897423  6006 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.898137  6003 raft_consensus.cc:359] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.901207  6003 raft_consensus.cc:385] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.901703  6003 raft_consensus.cc:740] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.902788  6003 consensus_queue.cc:260] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.903636  5960 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:20.900506  6000 ts_tablet_manager.cc:1434] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:15:20.905253  6000 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:20.907698  6006 raft_consensus.cc:515] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.909909  6003 ts_tablet_manager.cc:1434] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:15:20.911104  6003 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.911446  6001 tablet_bootstrap.cc:492] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.911947  6001 ts_tablet_manager.cc:1403] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.033s
I20260709 13:15:20.912216  6000 tablet_bootstrap.cc:654] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.914887  6001 raft_consensus.cc:359] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.915788  6001 raft_consensus.cc:385] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.916090  6001 raft_consensus.cc:740] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.917012  6001 consensus_queue.cc:260] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.918869  6006 leader_election.cc:290] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.919991  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:20.920986  5886 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.923493  6001 ts_tablet_manager.cc:1434] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:20.924844  6001 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:20.923691  6006 raft_consensus.cc:493] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.926046  6006 raft_consensus.cc:515] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.929240  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.929926  5811 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:20.930861  6008 raft_consensus.cc:493] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.931308  5926 leader_election.cc:304] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:20.931696  6008 raft_consensus.cc:515] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.932421  6031 raft_consensus.cc:2804] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.933677  6031 raft_consensus.cc:493] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.934245  6031 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.934850  6003 tablet_bootstrap.cc:654] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.937511  6006 leader_election.cc:290] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.941355  6001 tablet_bootstrap.cc:654] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.943245  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:20.944502  5885 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:20.947302  6003 tablet_bootstrap.cc:492] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:20.947479  6000 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:20.948024  6000 ts_tablet_manager.cc:1403] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.016s
I20260709 13:15:20.948024  6003 ts_tablet_manager.cc:1403] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.010s
I20260709 13:15:20.950929  6000 raft_consensus.cc:359] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.951413  6001 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:20.951668  6000 raft_consensus.cc:385] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.951953  6000 raft_consensus.cc:740] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.952083  6001 ts_tablet_manager.cc:1403] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.006s
I20260709 13:15:20.952045  6003 raft_consensus.cc:359] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.952932  6000 consensus_queue.cc:260] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.953328  6003 raft_consensus.cc:385] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.953862  6003 raft_consensus.cc:740] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.926163  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.955062  6000 ts_tablet_manager.cc:1434] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:20.966686  5886 raft_consensus.cc:2468] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:20.960017  6031 raft_consensus.cc:515] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.957958  5809 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.968168  5926 leader_election.cc:304] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:20.966116  5704 catalog_manager.cc:5697] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.969004  6006 raft_consensus.cc:2804] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.970367  6006 raft_consensus.cc:697] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:20.971257  6006 consensus_queue.cc:237] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.973300  6023 raft_consensus.cc:493] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.954789  6008 leader_election.cc:290] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.973924  6023 raft_consensus.cc:515] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.975678  5809 raft_consensus.cc:2468] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:20.978261  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e326a0ffae549d1961dfbead862502c" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:20.957633  6001 raft_consensus.cc:359] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.978953  5811 raft_consensus.cc:2468] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.979068  6001 raft_consensus.cc:385] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.979122  6023 leader_election.cc:290] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:20.979538  6001 raft_consensus.cc:740] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.980949  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e326a0ffae549d1961dfbead862502c" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:20.981313  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:20.981715  6031 leader_election.cc:290] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:20.981688  5960 raft_consensus.cc:2468] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:20.954710  6003 consensus_queue.cc:260] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.982743  5852 leader_election.cc:304] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:20.984645  6003 ts_tablet_manager.cc:1434] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:15:20.984727  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:20.985775  6003 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:20.986618  6023 raft_consensus.cc:2804] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.987073  6023 raft_consensus.cc:493] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.987398  6023 raft_consensus.cc:3060] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.981758  6001 consensus_queue.cc:260] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.991791  6001 ts_tablet_manager.cc:1434] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:15:20.982017  5811 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.996893  6003 tablet_bootstrap.cc:654] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.996770  6023 raft_consensus.cc:515] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:20.999179  5704 catalog_manager.cc:5697] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.000006  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e326a0ffae549d1961dfbead862502c" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:21.000936  5809 raft_consensus.cc:3060] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.012115  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e326a0ffae549d1961dfbead862502c" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.013093  5960 raft_consensus.cc:3060] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.013849  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.015434  5886 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.021730  6023 leader_election.cc:290] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.024499  5811 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:21.024952  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:21.026050  5885 raft_consensus.cc:2393] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9904405e5b34e2f8959e4466bafd719 in current term 1: Already voted for candidate 0e70316d89b848e3bef9eef69289fe16 in this term.
I20260709 13:15:21.027045  5926 leader_election.cc:304] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.027863  5777 leader_election.cc:304] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.028896  6006 raft_consensus.cc:2804] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.029233  6008 raft_consensus.cc:2749] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.029739  6006 raft_consensus.cc:697] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:21.030882  5886 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:21.030846  6006 consensus_queue.cc:237] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.033769  5809 raft_consensus.cc:2468] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:21.034425  6003 tablet_bootstrap.cc:492] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:21.031431  5960 raft_consensus.cc:2468] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:21.035043  6003 ts_tablet_manager.cc:1403] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.013s
I20260709 13:15:21.035211  5852 leader_election.cc:304] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.036267  6023 raft_consensus.cc:2804] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.036964  6023 raft_consensus.cc:697] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.038174  6003 raft_consensus.cc:359] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.038206  6023 consensus_queue.cc:237] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.039130  6003 raft_consensus.cc:385] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.039507  6003 raft_consensus.cc:740] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.040303  6003 consensus_queue.cc:260] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.042567  6003 ts_tablet_manager.cc:1434] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:21.043704  6003 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:21.044922  5707 catalog_manager.cc:5697] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.052590  6003 tablet_bootstrap.cc:654] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.057495  5704 catalog_manager.cc:5697] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.062649  6003 tablet_bootstrap.cc:492] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:21.063167  6003 ts_tablet_manager.cc:1403] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:15:21.065351  6003 raft_consensus.cc:359] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.065968  6003 raft_consensus.cc:385] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.066227  6003 raft_consensus.cc:740] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.066887  6003 consensus_queue.cc:260] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.068761  6003 ts_tablet_manager.cc:1434] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:15:21.096990  6023 raft_consensus.cc:493] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.097595  6023 raft_consensus.cc:515] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.099387  6023 leader_election.cc:290] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.100207  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:21.100456  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:21.100863  6006 raft_consensus.cc:493] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.101032  5960 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:21.100960  5809 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:21.101475  6006 raft_consensus.cc:515] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.102360  5850 leader_election.cc:304] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:21.103216  6023 raft_consensus.cc:2804] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.103579  6023 raft_consensus.cc:493] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.103647  6006 leader_election.cc:290] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:21.104005  6023 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.104285  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab50f69c63604e76a6016c58e8e38d29" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:21.104769  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab50f69c63604e76a6016c58e8e38d29" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:21.104923  5809 raft_consensus.cc:2468] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:21.105448  5886 raft_consensus.cc:2468] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:21.106258  5926 leader_election.cc:304] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.107017  6006 raft_consensus.cc:2804] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.107403  6006 raft_consensus.cc:493] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.107740  6006 raft_consensus.cc:3060] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.111471  6023 raft_consensus.cc:515] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.113744  6023 leader_election.cc:290] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.114843  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:21.114905  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.114966  6006 raft_consensus.cc:515] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.115610  5809 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.116048  5960 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.119354  6006 leader_election.cc:290] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:21.120540  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab50f69c63604e76a6016c58e8e38d29" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:21.121016  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab50f69c63604e76a6016c58e8e38d29" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.121331  5811 raft_consensus.cc:3060] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.121749  5886 raft_consensus.cc:3060] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.122788  5809 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:21.126055  5852 leader_election.cc:304] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.126987  6023 raft_consensus.cc:2804] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.127769  6023 raft_consensus.cc:697] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.128666  6023 consensus_queue.cc:237] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.129288  5811 raft_consensus.cc:2468] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:21.130620  5926 leader_election.cc:304] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.131731  6006 raft_consensus.cc:2804] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.132220  6006 raft_consensus.cc:697] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:21.132501  5886 raft_consensus.cc:2468] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:21.133136  6006 consensus_queue.cc:237] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.130620  5960 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:21.139271  5704 catalog_manager.cc:5697] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.143594  5706 catalog_manager.cc:5697] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.149767  6008 raft_consensus.cc:493] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.150349  6008 raft_consensus.cc:515] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.152451  6008 leader_election.cc:290] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.153760  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:21.154402  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:21.155210  5960 raft_consensus.cc:2393] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9904405e5b34e2f8959e4466bafd719 in current term 1: Already voted for candidate 457c66bee59943bb9eec876c57217880 in this term.
I20260709 13:15:21.156340  5775 leader_election.cc:304] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.157205  6008 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.158538  6055 raft_consensus.cc:493] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.159160  6055 raft_consensus.cc:515] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.161856  6055 leader_election.cc:290] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.162341  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:21.162957  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:21.163286  5886 raft_consensus.cc:2393] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9904405e5b34e2f8959e4466bafd719 in current term 1: Already voted for candidate 0e70316d89b848e3bef9eef69289fe16 in this term.
I20260709 13:15:21.164242  6023 consensus_queue.cc:1048] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.164691  5775 leader_election.cc:304] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.165599  6055 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.166661  6008 raft_consensus.cc:2749] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.179698  6007 consensus_queue.cc:1048] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.180311  6055 raft_consensus.cc:2749] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.230028  6007 consensus_queue.cc:1048] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.242633  6007 consensus_queue.cc:1048] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.288538  5886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:48812
I20260709 13:15:21.289225  5886 raft_consensus.cc:606] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:21.295032  5886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:48812
I20260709 13:15:21.295694  5886 raft_consensus.cc:606] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:21.301847  5886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:48812
I20260709 13:15:21.302490  5886 raft_consensus.cc:606] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:21.316363  5960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:15:21.317005  5960 raft_consensus.cc:606] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:21.323079  5960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
mode: GRACEFUL
new_leader_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:15:21.323621  5960 raft_consensus.cc:606] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Received request to transfer leadership to TS 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.329228  5960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
mode: GRACEFUL
new_leader_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:15:21.330215  5960 raft_consensus.cc:606] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Received request to transfer leadership to TS 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.346488  6006 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.353209  6007 consensus_queue.cc:1048] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.354473  6047 raft_consensus.cc:993] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.354984  6047 raft_consensus.cc:1081] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.356745  5809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58032
I20260709 13:15:21.357472  5809 raft_consensus.cc:493] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.357899  5809 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.360445  6006 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.366580  5809 raft_consensus.cc:515] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.367908  5811 raft_consensus.cc:1240] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Rejecting Update request from peer 0e70316d89b848e3bef9eef69289fe16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:21.371975  6006 consensus_queue.cc:1059] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.373798  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.377221  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.371989  5809 leader_election.cc:290] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.377952  5959 raft_consensus.cc:3055] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.378377  5959 raft_consensus.cc:740] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:21.379261  5959 consensus_queue.cc:260] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.380080  6023 consensus_queue.cc:1048] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.380862  5959 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.391984  5959 raft_consensus.cc:2468] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.393208  5775 leader_election.cc:304] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:21.394481  6055 raft_consensus.cc:2804] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.395056  6055 raft_consensus.cc:697] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:21.395143  6023 raft_consensus.cc:993] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.395754  6023 raft_consensus.cc:1081] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.395943  6055 consensus_queue.cc:237] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.399622  6031 consensus_queue.cc:1048] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.400661  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:15:21.401298  5811 raft_consensus.cc:493] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.401708  5811 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.408599  5811 raft_consensus.cc:515] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.411888  5811 leader_election.cc:290] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.412981  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.413866  5885 raft_consensus.cc:3055] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.413739  6047 consensus_queue.cc:1048] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.414065  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8960c3262d8a48cc8fca2c7d4993886f" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.414341  5885 raft_consensus.cc:740] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.414844  5959 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.415439  5885 consensus_queue.cc:260] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.416923  5885 raft_consensus.cc:3060] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.422518  5959 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.423887  5775 leader_election.cc:304] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.425647  6055 raft_consensus.cc:2804] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.426189  6055 raft_consensus.cc:697] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:21.425964  5706 catalog_manager.cc:5697] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.427142  6055 consensus_queue.cc:237] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.427453  5885 raft_consensus.cc:2468] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.437027  6006 raft_consensus.cc:993] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: : Instructing follower 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:21.437593  6006 raft_consensus.cc:1081] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Signalling peer 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:21.439420  5886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49"
dest_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:48796
I20260709 13:15:21.440007  5886 raft_consensus.cc:493] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.440423  5886 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.444599  5704 catalog_manager.cc:5697] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.446358  5886 raft_consensus.cc:515] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.448805  5886 leader_election.cc:290] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.449194  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:21.449898  5811 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.451159  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61328a6f4dca43098ec02f9aa155ac49" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.451781  5959 raft_consensus.cc:3055] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.452099  5959 raft_consensus.cc:740] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:21.452998  5959 consensus_queue.cc:260] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.454347  5959 raft_consensus.cc:3060] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.457458  5811 raft_consensus.cc:2468] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:21.459173  5852 leader_election.cc:304] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.460049  6007 raft_consensus.cc:2804] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.460623  6007 raft_consensus.cc:697] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.461081  6006 consensus_queue.cc:1048] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.461616  6007 consensus_queue.cc:237] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.463992  5959 raft_consensus.cc:2468] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:21.471470  5706 catalog_manager.cc:5697] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 1 to 2, leader changed from 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131) to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.472920  6007 consensus_queue.cc:1048] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.477272  6031 consensus_queue.cc:1048] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.492709  6031 raft_consensus.cc:993] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: : Instructing follower 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:21.493229  6031 raft_consensus.cc:1081] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Signalling peer 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:21.496595  5886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6"
dest_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:48796
I20260709 13:15:21.497279  5886 raft_consensus.cc:493] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.497462  6023 consensus_queue.cc:1048] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.497810  5886 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.508605  5886 raft_consensus.cc:515] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.512141  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:21.512854  5811 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.513257  5886 leader_election.cc:290] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.513515  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4993ed1544f46a9d2f98d9750acd6" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.514194  5959 raft_consensus.cc:3055] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.514552  5959 raft_consensus.cc:740] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:21.515342  5959 consensus_queue.cc:260] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.516726  5959 raft_consensus.cc:3060] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.521934  5811 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:21.523265  5852 leader_election.cc:304] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.524058  6023 raft_consensus.cc:2804] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.524611  6023 raft_consensus.cc:697] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.524628  5959 raft_consensus.cc:2468] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:21.525835  6023 consensus_queue.cc:237] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.533175  5706 catalog_manager.cc:5697] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 1 to 2, leader changed from 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131) to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.573027  6023 consensus_queue.cc:1048] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.583791  6007 consensus_queue.cc:1048] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.617444  6006 consensus_queue.cc:1048] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.628547  6047 consensus_queue.cc:1048] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.683276  6007 raft_consensus.cc:993] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.683763  6023 raft_consensus.cc:1081] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.685252  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:15:21.685832  5811 raft_consensus.cc:493] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.686138  5811 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.691490  5811 raft_consensus.cc:515] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.693804  5811 leader_election.cc:290] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.694814  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.694965  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253e2b31349f43d6a620793fad5a3748" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.695602  5886 raft_consensus.cc:3055] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.695628  5959 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.696115  5886 raft_consensus.cc:740] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.696964  5886 consensus_queue.cc:260] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.698009  5886 raft_consensus.cc:3060] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.702829  5959 raft_consensus.cc:2468] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.703362  5886 raft_consensus.cc:2468] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.704213  5775 leader_election.cc:304] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.705160  6055 raft_consensus.cc:2804] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.705665  6055 raft_consensus.cc:697] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:21.706689  6055 consensus_queue.cc:237] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.713230  5704 catalog_manager.cc:5697] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.769126  6007 raft_consensus.cc:993] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.769601  6023 raft_consensus.cc:1081] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:21.771319  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:15:21.771790  5811 raft_consensus.cc:493] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.772037  5811 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.776957  5811 raft_consensus.cc:515] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.778640  5811 leader_election.cc:290] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:21.779791  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:21.779801  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab618523bbab4ce79ed14444ed2c4455" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:21.780504  5959 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.780686  5886 raft_consensus.cc:3055] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.781116  5886 raft_consensus.cc:740] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:21.781967  5886 consensus_queue.cc:260] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.783035  5886 raft_consensus.cc:3060] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.786366  5959 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.787863  5775 leader_election.cc:304] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:21.789112  6055 raft_consensus.cc:2804] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.789867  6055 raft_consensus.cc:697] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:21.790028  5886 raft_consensus.cc:2468] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:21.790781  6055 consensus_queue.cc:237] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:21.797732  5704 catalog_manager.cc:5697] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.922964  5886 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.924433  5959 raft_consensus.cc:1275] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.926122  6055 consensus_queue.cc:1048] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.929883  5886 raft_consensus.cc:1275] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.931823  6055 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:21.942515  5886 raft_consensus.cc:1275] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.946658  6079 consensus_queue.cc:1048] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.947530  5811 raft_consensus.cc:1275] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.949178  6023 consensus_queue.cc:1048] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.952526  5959 raft_consensus.cc:1275] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.954067  6079 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.963198  5959 raft_consensus.cc:1275] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.964649  6017 consensus_queue.cc:1048] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.967319  5811 raft_consensus.cc:1275] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.969758  6017 consensus_queue.cc:1048] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.979956  5959 raft_consensus.cc:1275] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.982847  6017 consensus_queue.cc:1048] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.207442  5959 raft_consensus.cc:1275] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.208998  6079 consensus_queue.cc:1048] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.217612  5886 raft_consensus.cc:1275] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.219388  6056 consensus_queue.cc:1048] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.397270  5886 raft_consensus.cc:1275] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.398828  6056 consensus_queue.cc:1048] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.408653  5959 raft_consensus.cc:1275] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.411067  6055 consensus_queue.cc:1048] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.373790  5704 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45556:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:24.376595  5704 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:24.436932  5798 tablet_service.cc:1511] Processing CreateTablet for tablet bb6707d1e9bb416bad904c78772b04e2 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:24.438650  5874 tablet_service.cc:1511] Processing CreateTablet for tablet bb6707d1e9bb416bad904c78772b04e2 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:24.439260  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6707d1e9bb416bad904c78772b04e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.440604  5874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6707d1e9bb416bad904c78772b04e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.442791  5950 tablet_service.cc:1511] Processing CreateTablet for tablet bb6707d1e9bb416bad904c78772b04e2 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:24.444799  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6707d1e9bb416bad904c78772b04e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.447099  5799 tablet_service.cc:1511] Processing CreateTablet for tablet e59453c032604f5a82b489bac8621232 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:24.448709  5799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59453c032604f5a82b489bac8621232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.451833  5945 tablet_service.cc:1511] Processing CreateTablet for tablet e59453c032604f5a82b489bac8621232 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:24.462440  5875 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3a9a3e52734ac096ed420a3ce00122 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:24.465838  5946 tablet_service.cc:1511] Processing CreateTablet for tablet 2a144825570b43b78138a5f0b358def0 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:24.458715  5800 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3a9a3e52734ac096ed420a3ce00122 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:24.473966  5875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3a9a3e52734ac096ed420a3ce00122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.464520  5944 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3a9a3e52734ac096ed420a3ce00122 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:24.474347  5800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3a9a3e52734ac096ed420a3ce00122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.462324  5873 tablet_service.cc:1511] Processing CreateTablet for tablet 2a144825570b43b78138a5f0b358def0 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:24.453337  5945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59453c032604f5a82b489bac8621232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.476538  5873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a144825570b43b78138a5f0b358def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.468096  5948 tablet_service.cc:1511] Processing CreateTablet for tablet ab16d0f8adaa49c29bb666ab7a654ee4 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:24.480715  5948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16d0f8adaa49c29bb666ab7a654ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.482992  5795 tablet_service.cc:1511] Processing CreateTablet for tablet ab16d0f8adaa49c29bb666ab7a654ee4 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:24.484483  5944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3a9a3e52734ac096ed420a3ce00122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.456550  5872 tablet_service.cc:1511] Processing CreateTablet for tablet e59453c032604f5a82b489bac8621232 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:24.487011  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a144825570b43b78138a5f0b358def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.487473  5872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59453c032604f5a82b489bac8621232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.487360  5801 tablet_service.cc:1511] Processing CreateTablet for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:24.490864  5794 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed478ca7854e5f976e48f63212768f (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:24.491353  5871 tablet_service.cc:1511] Processing CreateTablet for tablet ab16d0f8adaa49c29bb666ab7a654ee4 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:24.492790  5871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16d0f8adaa49c29bb666ab7a654ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.495435  5876 tablet_service.cc:1511] Processing CreateTablet for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:24.495854  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:24.497064  5876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.497356  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.499220  5947 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed478ca7854e5f976e48f63212768f (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:24.500097  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 03093499b5494aa99079ab5f14d30923 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:24.500660  5947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed478ca7854e5f976e48f63212768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.500509  5943 tablet_service.cc:1511] Processing CreateTablet for tablet 8a208d14a7ba4196b12f785ff725e95b (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:24.485149  5795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16d0f8adaa49c29bb666ab7a654ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.501601  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03093499b5494aa99079ab5f14d30923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.503345  5943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a208d14a7ba4196b12f785ff725e95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.506819  5797 tablet_service.cc:1511] Processing CreateTablet for tablet 8a208d14a7ba4196b12f785ff725e95b (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:24.508842  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 03093499b5494aa99079ab5f14d30923 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:24.510233  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03093499b5494aa99079ab5f14d30923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.509989  5793 tablet_service.cc:1511] Processing CreateTablet for tablet 03093499b5494aa99079ab5f14d30923 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:24.507364  5870 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed478ca7854e5f976e48f63212768f (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:24.513374  5870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed478ca7854e5f976e48f63212768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.460726  5796 tablet_service.cc:1511] Processing CreateTablet for tablet 2a144825570b43b78138a5f0b358def0 (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:24.517693  5869 tablet_service.cc:1511] Processing CreateTablet for tablet 8a208d14a7ba4196b12f785ff725e95b (DEFAULT_TABLE table=soft_deleted_table [id=d8e228beefec43c280db46ceab36223a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:24.519392  5869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a208d14a7ba4196b12f785ff725e95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.521859  5801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34df2bf2fb1b41f6a42cbcc8c15298fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.523586  5796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a144825570b43b78138a5f0b358def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.524544  5793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03093499b5494aa99079ab5f14d30923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.525949  5797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a208d14a7ba4196b12f785ff725e95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.527181  5794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed478ca7854e5f976e48f63212768f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.647029  6097 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.655869  6097 tablet_bootstrap.cc:654] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.678367  6098 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.686510  6098 tablet_bootstrap.cc:654] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.693835  6097 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.701958  6097 ts_tablet_manager.cc:1403] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.009s
I20260709 13:15:24.706176  6098 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.706768  6098 ts_tablet_manager.cc:1403] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.029s	user 0.000s	sys 0.019s
I20260709 13:15:24.710003  6098 raft_consensus.cc:359] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.711040  6098 raft_consensus.cc:385] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.711445  6098 raft_consensus.cc:740] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.712432  6098 consensus_queue.cc:260] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.713340  6097 raft_consensus.cc:359] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.715421  6098 ts_tablet_manager.cc:1434] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:15:24.716048  6101 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:24.716687  6098 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.723699  6098 tablet_bootstrap.cc:654] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.714596  6097 raft_consensus.cc:385] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.724844  6097 raft_consensus.cc:740] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.725719  6097 consensus_queue.cc:260] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.728369  6097 ts_tablet_manager.cc:1434] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:15:24.729417  6097 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.732914  6098 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.733675  6098 ts_tablet_manager.cc:1403] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 13:15:24.736475  6097 tablet_bootstrap.cc:654] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.736418  6098 raft_consensus.cc:359] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.737422  6098 raft_consensus.cc:385] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.737818  6098 raft_consensus.cc:740] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.738725  6098 consensus_queue.cc:260] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.740139  6101 tablet_bootstrap.cc:654] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.741628  6098 ts_tablet_manager.cc:1434] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:24.742887  6098 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.752907  6098 tablet_bootstrap.cc:654] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.754601  6101 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:24.755348  6101 ts_tablet_manager.cc:1403] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.008s
W20260709 13:15:24.760963  5757 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:24.763706  6101 raft_consensus.cc:359] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.765000  6101 raft_consensus.cc:385] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.765463  6101 raft_consensus.cc:740] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.766760  6101 consensus_queue.cc:260] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.776618  6101 ts_tablet_manager.cc:1434] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:15:24.779426  6101 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:24.780537  6098 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.781183  6098 ts_tablet_manager.cc:1403] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.019s
I20260709 13:15:24.785116  6098 raft_consensus.cc:359] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.786005  6098 raft_consensus.cc:385] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.786345  6098 raft_consensus.cc:740] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.787719  6101 tablet_bootstrap.cc:654] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.787304  6098 consensus_queue.cc:260] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.789907  6098 ts_tablet_manager.cc:1434] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:24.791054  6098 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.794442  6097 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.795009  6097 ts_tablet_manager.cc:1403] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.035s
I20260709 13:15:24.798256  6097 raft_consensus.cc:359] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.798681  6098 tablet_bootstrap.cc:654] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.798976  6097 raft_consensus.cc:385] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.799333  6097 raft_consensus.cc:740] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.800222  6097 consensus_queue.cc:260] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.802778  6097 ts_tablet_manager.cc:1434] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:24.803800  6097 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.810842  6097 tablet_bootstrap.cc:654] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.811273  6101 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:24.812103  6101 ts_tablet_manager.cc:1403] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.004s
I20260709 13:15:24.816447  6101 raft_consensus.cc:359] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.819144  6101 raft_consensus.cc:385] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.819463  6101 raft_consensus.cc:740] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.820591  6098 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.820304  6101 consensus_queue.cc:260] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.821154  6098 ts_tablet_manager.cc:1403] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:15:24.823040  6101 ts_tablet_manager.cc:1434] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:15:24.824083  6101 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:24.824378  6098 raft_consensus.cc:359] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.825099  6098 raft_consensus.cc:385] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.825412  6098 raft_consensus.cc:740] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.826129  6098 consensus_queue.cc:260] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.828510  6098 ts_tablet_manager.cc:1434] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:24.829568  6098 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.833729  6097 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.834339  6097 ts_tablet_manager.cc:1403] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.011s
I20260709 13:15:24.836607  6098 tablet_bootstrap.cc:654] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.837231  6101 tablet_bootstrap.cc:654] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.837949  6097 raft_consensus.cc:359] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.838769  6097 raft_consensus.cc:385] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.839111  6097 raft_consensus.cc:740] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.839959  6097 consensus_queue.cc:260] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.842559  6097 ts_tablet_manager.cc:1434] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:15:24.843650  6097 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.848970  6098 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.849023  6101 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:24.849773  6098 ts_tablet_manager.cc:1403] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:15:24.849812  6101 ts_tablet_manager.cc:1403] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
I20260709 13:15:24.853807  6098 raft_consensus.cc:359] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.854609  6098 raft_consensus.cc:385] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.854948  6098 raft_consensus.cc:740] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.855716  6098 consensus_queue.cc:260] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.855911  6101 raft_consensus.cc:359] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.856659  6101 raft_consensus.cc:385] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.856976  6101 raft_consensus.cc:740] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.858142  6097 tablet_bootstrap.cc:654] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.857795  6101 consensus_queue.cc:260] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.858350  6098 ts_tablet_manager.cc:1434] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:24.859535  6098 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.860262  6101 ts_tablet_manager.cc:1434] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:15:24.861323  6101 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:24.867305  6098 tablet_bootstrap.cc:654] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.868135  6101 tablet_bootstrap.cc:654] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.873255  6097 tablet_bootstrap.cc:492] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.873817  6097 ts_tablet_manager.cc:1403] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.010s
I20260709 13:15:24.874135  6079 raft_consensus.cc:493] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.874758  6079 raft_consensus.cc:515] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.877137  6097 raft_consensus.cc:359] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.878036  6097 raft_consensus.cc:385] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.878350  6097 raft_consensus.cc:740] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.878444  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:24.879598  6097 consensus_queue.cc:260] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.882519  6097 ts_tablet_manager.cc:1434] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 13:15:24.882717  5777 leader_election.cc:343] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.883453  6079 leader_election.cc:290] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:24.883769  6097 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.884138  6079 raft_consensus.cc:493] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.887970  6079 raft_consensus.cc:515] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.898396  6079 leader_election.cc:290] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:24.900241  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3a9a3e52734ac096ed420a3ce00122" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:24.891709  6097 tablet_bootstrap.cc:654] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:24.901978  5777 leader_election.cc:343] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.907905  6097 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.908210  6098 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.908507  6097 ts_tablet_manager.cc:1403] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 13:15:24.908777  6098 ts_tablet_manager.cc:1403] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.015s
I20260709 13:15:24.908835  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:24.912021  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3a9a3e52734ac096ed420a3ce00122" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
W20260709 13:15:24.912146  5775 leader_election.cc:343] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.912245  6098 raft_consensus.cc:359] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.912899  5960 raft_consensus.cc:2468] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 0.
I20260709 13:15:24.912575  6097 raft_consensus.cc:359] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.912932  5775 leader_election.cc:304] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:24.913133  6098 raft_consensus.cc:385] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.913532  6097 raft_consensus.cc:385] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.913880  6098 raft_consensus.cc:740] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.913961  6097 raft_consensus.cc:740] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.914752  6114 raft_consensus.cc:2749] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:24.914886  6098 consensus_queue.cc:260] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.914913  5775 leader_election.cc:304] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:24.915329  6097 consensus_queue.cc:260] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.917208  6114 raft_consensus.cc:493] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.918893  6079 raft_consensus.cc:2804] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.918231  6101 tablet_bootstrap.cc:492] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:24.919338  6079 raft_consensus.cc:493] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.919090  6114 raft_consensus.cc:515] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.919694  6101 ts_tablet_manager.cc:1403] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.020s
I20260709 13:15:24.919745  6079 raft_consensus.cc:3060] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.922518  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:24.923610  6101 raft_consensus.cc:359] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
W20260709 13:15:24.924175  5777 leader_election.cc:343] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.926141  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:24.926885  5960 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 0.
I20260709 13:15:24.928498  6079 raft_consensus.cc:515] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.924474  6101 raft_consensus.cc:385] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.917665  6098 ts_tablet_manager.cc:1434] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:15:24.921594  6114 leader_election.cc:290] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:24.929626  6097 ts_tablet_manager.cc:1434] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:15:24.931455  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3a9a3e52734ac096ed420a3ce00122" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:24.932508  6097 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:24.931633  6079 leader_election.cc:290] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:24.930825  5775 leader_election.cc:304] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:24.937481  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3a9a3e52734ac096ed420a3ce00122" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:24.938115  5960 raft_consensus.cc:3060] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.940158  6097 tablet_bootstrap.cc:654] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.931005  6098 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:24.950896  6098 tablet_bootstrap.cc:654] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.929966  6101 raft_consensus.cc:740] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.957019  6114 raft_consensus.cc:2804] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.957527  6114 raft_consensus.cc:493] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.957883  6114 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.960656  6079 raft_consensus.cc:493] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.955798  6101 consensus_queue.cc:260] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.964800  5886 raft_consensus.cc:3060] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.968269  5960 raft_consensus.cc:2468] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 1.
I20260709 13:15:24.961445  6079 raft_consensus.cc:515] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.970878  6098 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:24.970878  5775 leader_election.cc:304] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:24.971825  6098 ts_tablet_manager.cc:1403] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.008s
I20260709 13:15:24.974561  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:24.976662  6098 raft_consensus.cc:359] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.977967  6098 raft_consensus.cc:385] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.978519  6098 raft_consensus.cc:740] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.979820  6098 consensus_queue.cc:260] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.978168  6079 leader_election.cc:290] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:24.984980  5886 raft_consensus.cc:2468] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 1.
I20260709 13:15:24.974838  6116 raft_consensus.cc:2804] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.974599  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:24.993355  6116 raft_consensus.cc:697] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:24.995002  6116 consensus_queue.cc:237] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:24.995725  6097 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:24.997448  6097 ts_tablet_manager.cc:1403] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.031s
I20260709 13:15:25.004426  6114 raft_consensus.cc:515] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.008621  6079 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.008724  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.009419  5959 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.009196  6079 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.013068  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.015821  6079 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
W20260709 13:15:25.016893  5775 leader_election.cc:343] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.005637  6101 ts_tablet_manager.cc:1434] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.006s
I20260709 13:15:25.018653  6101 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:25.019659  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:25.022603  6114 leader_election.cc:290] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.022727  6084 raft_consensus.cc:493] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.023442  6079 raft_consensus.cc:493] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.024876  6084 raft_consensus.cc:515] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
W20260709 13:15:25.027863  5777 leader_election.cc:343] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.025869  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
W20260709 13:15:25.031613  5777 leader_election.cc:343] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.024871  6079 raft_consensus.cc:515] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.034268  6079 leader_election.cc:290] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.035609  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
W20260709 13:15:25.035871  5777 leader_election.cc:343] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.036334  5777 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.037264  6119 raft_consensus.cc:2749] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:25.037261  5775 leader_election.cc:343] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.993371  5960 raft_consensus.cc:2468] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 0.
I20260709 13:15:25.047185  6101 tablet_bootstrap.cc:654] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.047700  5775 leader_election.cc:304] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.040302  6084 leader_election.cc:290] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.039528  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:25.041746  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a208d14a7ba4196b12f785ff725e95b" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.049185  5958 raft_consensus.cc:2468] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.043522  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a208d14a7ba4196b12f785ff725e95b" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.049942  6098 ts_tablet_manager.cc:1434] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.078s	user 0.039s	sys 0.037s
I20260709 13:15:25.050441  5809 raft_consensus.cc:2468] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.050707  5850 leader_election.cc:304] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:25.050566  6097 raft_consensus.cc:359] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.051223  6098 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:25.051561  6097 raft_consensus.cc:385] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.051960  6097 raft_consensus.cc:740] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
W20260709 13:15:25.052681  5777 leader_election.cc:343] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.053452  5777 leader_election.cc:304] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.047773  5959 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 1.
I20260709 13:15:25.058611  6084 raft_consensus.cc:2804] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.059223  6084 raft_consensus.cc:493] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.059652  6084 raft_consensus.cc:3060] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.063519  6047 raft_consensus.cc:493] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.064383  6047 raft_consensus.cc:515] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.070044  6096 raft_consensus.cc:493] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.070804  6096 raft_consensus.cc:515] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.073681  6120 raft_consensus.cc:2804] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.073681  6121 raft_consensus.cc:2749] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.074440  6120 raft_consensus.cc:493] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.074806  6120 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.077667  6096 leader_election.cc:290] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.078900  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.079430  6047 leader_election.cc:290] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
W20260709 13:15:25.080991  5926 leader_election.cc:343] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.080826  6097 consensus_queue.cc:260] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.082448  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:25.082650  5775 leader_election.cc:304] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.083078  5886 raft_consensus.cc:2468] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:25.084136  6119 raft_consensus.cc:2804] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.084626  6119 raft_consensus.cc:697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:25.087476  6119 consensus_queue.cc:237] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.089721  5926 leader_election.cc:304] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.090929  6098 tablet_bootstrap.cc:654] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.093302  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.093382  6047 raft_consensus.cc:2804] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.094941  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.095450  5959 raft_consensus.cc:2468] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.097747  6047 raft_consensus.cc:493] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.098342  6047 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.098394  5852 leader_election.cc:343] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.100867  5850 leader_election.cc:304] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.101902  6096 raft_consensus.cc:2804] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.102317  6096 raft_consensus.cc:493] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.102733  6096 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.103192  6098 tablet_bootstrap.cc:492] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:25.103773  6098 ts_tablet_manager.cc:1403] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.018s
I20260709 13:15:25.106954  6120 raft_consensus.cc:515] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.107005  6098 raft_consensus.cc:359] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.109130  6047 raft_consensus.cc:515] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.111599  6097 ts_tablet_manager.cc:1434] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.004s
I20260709 13:15:25.114338  6098 raft_consensus.cc:385] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.114735  6098 raft_consensus.cc:740] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.115232  6097 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:25.115869  6047 leader_election.cc:290] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:25.115634  6098 consensus_queue.cc:260] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.118920  6101 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:25.119588  6101 ts_tablet_manager.cc:1403] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.001s
I20260709 13:15:25.118813  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.120168  5809 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.122072  6098 ts_tablet_manager.cc:1434] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:15:25.123389  6098 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: Bootstrap starting.
I20260709 13:15:25.127936  6120 leader_election.cc:290] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.127241  5709 catalog_manager.cc:5697] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.132548  6097 tablet_bootstrap.cc:654] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.132699  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.133584  5958 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.134342  6096 raft_consensus.cc:515] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.129896  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:25.130736  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:25.136757  6096 leader_election.cc:290] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.137980  5885 raft_consensus.cc:2393] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e70316d89b848e3bef9eef69289fe16 in current term 1: Already voted for candidate 457c66bee59943bb9eec876c57217880 in this term.
I20260709 13:15:25.138132  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
W20260709 13:15:25.139483  5777 leader_election.cc:343] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.131399  6101 raft_consensus.cc:359] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.141743  6101 raft_consensus.cc:385] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.142104  6101 raft_consensus.cc:740] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.132381  6098 tablet_bootstrap.cc:654] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.143481  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.144661  5959 raft_consensus.cc:2393] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 457c66bee59943bb9eec876c57217880 in current term 1: Already voted for candidate 0e70316d89b848e3bef9eef69289fe16 in this term.
I20260709 13:15:25.148592  5850 leader_election.cc:304] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 457c66bee59943bb9eec876c57217880; no voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.149647  6096 raft_consensus.cc:2749] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.155174  6101 consensus_queue.cc:260] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.156909  6084 raft_consensus.cc:515] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.157792  6101 ts_tablet_manager.cc:1434] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.002s
I20260709 13:15:25.161749  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a208d14a7ba4196b12f785ff725e95b" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.162649  5811 raft_consensus.cc:3060] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.157536  5809 raft_consensus.cc:2468] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:25.166635  5926 leader_election.cc:304] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.167935  6101 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:25.167894  6047 raft_consensus.cc:2804] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.171975  6084 leader_election.cc:290] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.165156  5958 raft_consensus.cc:2468] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 1.
I20260709 13:15:25.173247  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a208d14a7ba4196b12f785ff725e95b" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.174019  5959 raft_consensus.cc:3060] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.174471  5775 leader_election.cc:304] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.175732  6120 raft_consensus.cc:2804] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.176211  6120 raft_consensus.cc:697] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:25.177071  6120 consensus_queue.cc:237] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.187651  5959 raft_consensus.cc:2468] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.188477  6097 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:25.189038  6097 ts_tablet_manager.cc:1403] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.006s
I20260709 13:15:25.189139  5850 leader_election.cc:304] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:25.181218  6096 raft_consensus.cc:493] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.199210  6098 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: No bootstrap required, opened a new log
I20260709 13:15:25.199733  6098 ts_tablet_manager.cc:1403] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.008s
I20260709 13:15:25.198107  6084 raft_consensus.cc:2804] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.200246  6047 raft_consensus.cc:697] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:25.202744  5811 raft_consensus.cc:2468] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.202898  6047 consensus_queue.cc:237] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.207649  6101 tablet_bootstrap.cc:654] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.205091  6084 raft_consensus.cc:697] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:25.210412  6084 consensus_queue.cc:237] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.210438  6098 raft_consensus.cc:359] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.213369  6098 raft_consensus.cc:385] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.197310  6096 raft_consensus.cc:515] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.215960  6096 leader_election.cc:290] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.213743  6098 raft_consensus.cc:740] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.224062  6132 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.225126  6132 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.230243  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.230432  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.231160  5811 raft_consensus.cc:2468] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.232779  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:25.228224  6132 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
W20260709 13:15:25.234488  5850 leader_election.cc:343] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:25.246330  5926 leader_election.cc:343] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.236104  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.247274  6098 consensus_queue.cc:260] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.252475  5809 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 0.
I20260709 13:15:25.254297  5852 leader_election.cc:304] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:25.256099  6101 tablet_bootstrap.cc:492] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:25.256016  6096 raft_consensus.cc:2804] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.256004  6098 ts_tablet_manager.cc:1434] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: Time spent starting tablet: real 0.056s	user 0.002s	sys 0.007s
I20260709 13:15:25.256839  5926 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.256848  6101 ts_tablet_manager.cc:1403] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.019s
I20260709 13:15:25.256877  6096 raft_consensus.cc:493] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.258226  6096 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.259967  6097 raft_consensus.cc:359] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.260741  6097 raft_consensus.cc:385] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.261498  6097 raft_consensus.cc:740] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.260720  6132 raft_consensus.cc:2804] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.262301  6132 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.262761  6132 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.262449  6097 consensus_queue.cc:260] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.260943  6101 raft_consensus.cc:359] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.268610  6101 raft_consensus.cc:385] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.268985  6101 raft_consensus.cc:740] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.269068  6096 raft_consensus.cc:515] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.272399  6097 ts_tablet_manager.cc:1434] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:15:25.273111  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.273651  6097 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:25.273895  5809 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.278281  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.279284  6096 leader_election.cc:290] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.279664  5709 catalog_manager.cc:5697] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.280817  6101 consensus_queue.cc:260] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.282023  5709 catalog_manager.cc:5697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:25.284192  5850 leader_election.cc:343] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.284837  5809 raft_consensus.cc:2468] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.285005  6101 ts_tablet_manager.cc:1434] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:15:25.287180  6101 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:25.289139  6084 raft_consensus.cc:493] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.289824  6084 raft_consensus.cc:515] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.292142  6084 leader_election.cc:290] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.279975  5704 catalog_manager.cc:5697] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.295473  5852 leader_election.cc:304] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:25.297323  6097 tablet_bootstrap.cc:654] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.297814  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed478ca7854e5f976e48f63212768f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.298522  5809 raft_consensus.cc:2468] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.299775  5852 leader_election.cc:304] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:25.300719  6096 raft_consensus.cc:2804] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.300424  6132 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.301532  6126 raft_consensus.cc:2804] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.301911  6126 raft_consensus.cc:493] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.302264  6126 raft_consensus.cc:3060] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.303074  6132 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:25.303267  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed478ca7854e5f976e48f63212768f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.304230  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.304940  5811 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.305166  5850 leader_election.cc:343] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.309659  6096 raft_consensus.cc:697] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:25.310757  6096 consensus_queue.cc:237] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.312618  5811 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 1.
I20260709 13:15:25.315563  6126 raft_consensus.cc:515] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.318006  6101 tablet_bootstrap.cc:654] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.318164  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:25.329900  5706 catalog_manager.cc:5697] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.334908  6097 tablet_bootstrap.cc:492] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:25.337769  6126 leader_election.cc:290] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.337760  6097 ts_tablet_manager.cc:1403] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.014s
I20260709 13:15:25.339690  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed478ca7854e5f976e48f63212768f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.340413  5809 raft_consensus.cc:3060] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.347893  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed478ca7854e5f976e48f63212768f" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.345240  5926 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:25.348912  5809 raft_consensus.cc:2468] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
W20260709 13:15:25.349751  5926 leader_election.cc:343] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.350317  5852 leader_election.cc:304] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:25.351250  6096 raft_consensus.cc:2804] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.351749  6096 raft_consensus.cc:697] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:25.352499  6096 consensus_queue.cc:237] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.354391  6097 raft_consensus.cc:359] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.355188  6097 raft_consensus.cc:385] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.355465  6097 raft_consensus.cc:740] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.356184  6097 consensus_queue.cc:260] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.356007  5704 catalog_manager.cc:5697] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.357515  6047 raft_consensus.cc:2804] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.358054  6047 raft_consensus.cc:697] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:25.358994  6047 consensus_queue.cc:237] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.359768  5959 raft_consensus.cc:3060] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.365504  6097 ts_tablet_manager.cc:1434] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:15:25.366618  6097 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: Bootstrap starting.
I20260709 13:15:25.368335  5959 raft_consensus.cc:2468] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.371253  6101 tablet_bootstrap.cc:492] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:25.371870  6101 ts_tablet_manager.cc:1403] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.015s
I20260709 13:15:25.373652  6097 tablet_bootstrap.cc:654] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.378616  6097 tablet_bootstrap.cc:492] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: No bootstrap required, opened a new log
I20260709 13:15:25.379153  6097 ts_tablet_manager.cc:1403] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:15:25.378804  6101 raft_consensus.cc:359] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.379700  6101 raft_consensus.cc:385] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.379994  6101 raft_consensus.cc:740] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.380726  6101 consensus_queue.cc:260] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.382514  6097 raft_consensus.cc:359] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.383312  6097 raft_consensus.cc:385] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.383462  6101 ts_tablet_manager.cc:1434] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:15:25.383687  6097 raft_consensus.cc:740] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.384728  6101 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:25.384611  6097 consensus_queue.cc:260] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.384420  5704 catalog_manager.cc:5697] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 1 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.386823  6097 ts_tablet_manager.cc:1434] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:25.391381  6101 tablet_bootstrap.cc:654] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.393654  5709 catalog_manager.cc:5697] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.396749  6101 tablet_bootstrap.cc:492] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:25.397368  6101 ts_tablet_manager.cc:1403] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:15:25.400087  6101 raft_consensus.cc:359] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.400846  6101 raft_consensus.cc:385] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.401096  6101 raft_consensus.cc:740] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.401736  6101 consensus_queue.cc:260] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.403942  6101 ts_tablet_manager.cc:1434] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:25.404937  6101 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: Bootstrap starting.
I20260709 13:15:25.412103  6101 tablet_bootstrap.cc:654] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.418166  6101 tablet_bootstrap.cc:492] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: No bootstrap required, opened a new log
I20260709 13:15:25.418634  6101 ts_tablet_manager.cc:1403] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:15:25.420744  6101 raft_consensus.cc:359] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.421322  6101 raft_consensus.cc:385] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.421644  6101 raft_consensus.cc:740] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.422205  6101 consensus_queue.cc:260] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.423952  6101 ts_tablet_manager.cc:1434] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:25.459314  6126 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.459849  6126 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.461921  6126 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.462743  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.462960  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.463555  5811 raft_consensus.cc:2393] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 457c66bee59943bb9eec876c57217880 in current term 1: Already voted for candidate 0e70316d89b848e3bef9eef69289fe16 in this term.
I20260709 13:15:25.464721  5852 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 457c66bee59943bb9eec876c57217880; no voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.465456  6126 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.467330  6120 consensus_queue.cc:1048] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.472883  6126 raft_consensus.cc:2749] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.481351  6120 consensus_queue.cc:1048] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.497169  5885 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.508348  6119 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.520327  6119 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.560060  6047 raft_consensus.cc:493] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.560681  6047 raft_consensus.cc:515] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.563205  6047 leader_election.cc:290] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:25.564414  6121 consensus_queue.cc:1048] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.564539  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "457c66bee59943bb9eec876c57217880" is_pre_election: true
I20260709 13:15:25.564528  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.565866  5811 raft_consensus.cc:2393] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e70316d89b848e3bef9eef69289fe16 in current term 1: Already voted for candidate 457c66bee59943bb9eec876c57217880 in this term.
I20260709 13:15:25.566949  5926 leader_election.cc:304] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16; no voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.567914  6132 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.570950  6126 raft_consensus.cc:493] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.571511  6126 raft_consensus.cc:515] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.573700  6126 leader_election.cc:290] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.574468  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.577062  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.578773  5850 leader_election.cc:304] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 457c66bee59943bb9eec876c57217880; no voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.579082  5885 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.580960  6132 raft_consensus.cc:2749] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.587986  6126 raft_consensus.cc:2749] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.589085  6119 consensus_queue.cc:1048] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.606775  6126 raft_consensus.cc:493] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.607250  6126 raft_consensus.cc:515] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.609030  6126 leader_election.cc:290] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.609977  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719" is_pre_election: true
I20260709 13:15:25.610244  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16" is_pre_election: true
I20260709 13:15:25.610532  5811 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.610918  5958 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 0.
I20260709 13:15:25.611528  5852 leader_election.cc:304] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:25.612391  6126 raft_consensus.cc:2804] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.612838  6126 raft_consensus.cc:493] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.613133  6126 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.618357  6126 raft_consensus.cc:515] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.620007  6126 leader_election.cc:290] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:25.620849  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:25.620987  5958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:25.621589  5811 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.621778  5958 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.627189  5811 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.627884  5958 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 1.
I20260709 13:15:25.628305  5852 leader_election.cc:304] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:25.629129  6126 raft_consensus.cc:2804] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.629751  6126 raft_consensus.cc:697] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:25.630489  6126 consensus_queue.cc:237] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:25.633703  6132 consensus_queue.cc:1048] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.639062  5709 catalog_manager.cc:5697] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.649128  6047 consensus_queue.cc:1048] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.701668  6126 consensus_queue.cc:1048] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.707636  6126 consensus_queue.cc:1048] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.714124  6084 consensus_queue.cc:1048] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.736094  6084 consensus_queue.cc:1048] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.752830  6047 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.769912  6132 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.786130  5885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:48812
I20260709 13:15:25.786876  5885 raft_consensus.cc:606] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.793179  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e59453c032604f5a82b489bac8621232"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:15:25.793802  5958 raft_consensus.cc:606] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.801995  5885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a144825570b43b78138a5f0b358def0"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:48812
I20260709 13:15:25.802561  5885 raft_consensus.cc:606] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS f9904405e5b34e2f8959e4466bafd719
I20260709 13:15:25.807869  5958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
mode: GRACEFUL
new_leader_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:15:25.808471  5958 raft_consensus.cc:606] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Received request to transfer leadership to TS 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.825213  5809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
mode: GRACEFUL
new_leader_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:56180
I20260709 13:15:25.825906  5809 raft_consensus.cc:606] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Received request to transfer leadership to TS 457c66bee59943bb9eec876c57217880
I20260709 13:15:25.842100  5809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03093499b5494aa99079ab5f14d30923"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
mode: GRACEFUL
new_leader_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:56180
I20260709 13:15:25.842993  5809 raft_consensus.cc:606] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Received request to transfer leadership to TS 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:25.847765  6084 consensus_queue.cc:1048] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.867233  6126 consensus_queue.cc:1048] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.021076  6084 consensus_queue.cc:1048] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.028380  6126 raft_consensus.cc:993] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.028883  6126 raft_consensus.cc:1081] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.031829  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a144825570b43b78138a5f0b358def0"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:15:26.033247  5811 raft_consensus.cc:493] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.033656  5811 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.035710  6126 consensus_queue.cc:1048] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.039772  5811 raft_consensus.cc:515] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.042042  5811 leader_election.cc:290] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:26.044873  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:26.044934  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a144825570b43b78138a5f0b358def0" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:26.045491  5959 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.045740  5885 raft_consensus.cc:3055] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.046221  5885 raft_consensus.cc:740] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:26.047091  5885 consensus_queue.cc:260] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.048400  5885 raft_consensus.cc:3060] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.054941  5959 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.055850  5885 raft_consensus.cc:2468] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.056571  5775 leader_election.cc:304] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:26.057837  6119 raft_consensus.cc:2804] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.058373  6119 raft_consensus.cc:697] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:26.059125  6119 consensus_queue.cc:237] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.069700  5709 catalog_manager.cc:5697] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.112198  6120 raft_consensus.cc:993] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: : Instructing follower 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:26.112761  6119 raft_consensus.cc:1081] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Signalling peer 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:26.114287  5885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe"
dest_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:48798
I20260709 13:15:26.114871  5885 raft_consensus.cc:493] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.115285  5885 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.121160  5885 raft_consensus.cc:515] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.123000  5885 leader_election.cc:290] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:26.123786  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:26.123970  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:26.124431  5811 raft_consensus.cc:3055] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.124583  5959 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.124732  5811 raft_consensus.cc:740] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:26.125643  5811 consensus_queue.cc:260] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.126927  5811 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.131729  5959 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:26.133065  5850 leader_election.cc:304] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:26.133703  5811 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:26.133983  6126 raft_consensus.cc:2804] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.134680  6126 raft_consensus.cc:697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:26.135633  6126 consensus_queue.cc:237] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.143245  5709 catalog_manager.cc:5697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 1 to 2, leader changed from f9904405e5b34e2f8959e4466bafd719 (127.28.62.129) to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.156767  6120 raft_consensus.cc:993] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: : Instructing follower 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:26.157263  6119 raft_consensus.cc:1081] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Signalling peer 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:26.158989  5959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03093499b5494aa99079ab5f14d30923"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:44412
I20260709 13:15:26.159425  5959 raft_consensus.cc:493] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.159678  5959 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.164552  5959 raft_consensus.cc:515] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.166275  5959 leader_election.cc:290] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:26.167110  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:26.167410  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03093499b5494aa99079ab5f14d30923" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:26.167778  5811 raft_consensus.cc:3055] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.168020  5885 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.168123  5811 raft_consensus.cc:740] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:26.168958  5811 consensus_queue.cc:260] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.170178  5811 raft_consensus.cc:3060] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.175297  5885 raft_consensus.cc:2468] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 2.
I20260709 13:15:26.176602  5926 leader_election.cc:304] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:26.176884  5811 raft_consensus.cc:2468] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 2.
I20260709 13:15:26.177520  6130 raft_consensus.cc:2804] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.178025  6130 raft_consensus.cc:697] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 2 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:26.179032  6047 raft_consensus.cc:993] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: : Instructing follower 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:26.179013  6130 consensus_queue.cc:237] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.179630  6132 raft_consensus.cc:1081] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Signalling peer 457c66bee59943bb9eec876c57217880 to start an election
I20260709 13:15:26.181231  5886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4"
dest_uuid: "457c66bee59943bb9eec876c57217880"
 from {username='slave'} at 127.0.0.1:48796
I20260709 13:15:26.181829  5886 raft_consensus.cc:493] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.182152  5886 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.186916  5886 raft_consensus.cc:515] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.186728  5709 catalog_manager.cc:5697] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 1 to 2, leader changed from f9904405e5b34e2f8959e4466bafd719 (127.28.62.129) to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.188988  5886 leader_election.cc:290] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:26.189728  5811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:26.190347  5811 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.190814  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16d0f8adaa49c29bb666ab7a654ee4" candidate_uuid: "457c66bee59943bb9eec876c57217880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:26.191308  5959 raft_consensus.cc:3055] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.191566  5959 raft_consensus.cc:740] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:26.192219  5959 consensus_queue.cc:260] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.193931  5959 raft_consensus.cc:3060] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.197155  5811 raft_consensus.cc:2468] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:26.198719  5852 leader_election.cc:304] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:26.199514  6126 raft_consensus.cc:2804] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.199999  6126 raft_consensus.cc:697] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Becoming Leader. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:26.200361  5959 raft_consensus.cc:2468] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 457c66bee59943bb9eec876c57217880 in term 2.
I20260709 13:15:26.200866  6126 consensus_queue.cc:237] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.207841  5709 catalog_manager.cc:5697] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 reported cstate change: term changed from 1 to 2, leader changed from 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131) to 457c66bee59943bb9eec876c57217880 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "457c66bee59943bb9eec876c57217880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.260404  6132 raft_consensus.cc:993] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.260877  6130 raft_consensus.cc:1081] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.262740  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e59453c032604f5a82b489bac8621232"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58032
I20260709 13:15:26.263314  5811 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.263666  5811 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.269958  5811 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.271421  5811 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:26.272330  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:26.272503  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:26.272991  5886 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.273128  5959 raft_consensus.cc:3055] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.273564  5959 raft_consensus.cc:740] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:26.274173  5959 consensus_queue.cc:260] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.275027  5959 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.278013  5886 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.279088  5777 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:26.279886  5959 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.279948  6119 raft_consensus.cc:2804] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.280504  6119 raft_consensus.cc:697] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:26.281378  6119 consensus_queue.cc:237] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.288268  5709 catalog_manager.cc:5697] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.327371  6084 raft_consensus.cc:993] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: : Instructing follower f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.327816  6126 raft_consensus.cc:1081] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer f9904405e5b34e2f8959e4466bafd719 to start an election
I20260709 13:15:26.329213  5811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
 from {username='slave'} at 127.0.0.1:58016
I20260709 13:15:26.329710  5811 raft_consensus.cc:493] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.329977  5811 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.334769  5811 raft_consensus.cc:515] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.336220  5811 leader_election.cc:290] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Requested vote from peers 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083), 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131:41569)
I20260709 13:15:26.337256  5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:26.337334  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb6707d1e9bb416bad904c78772b04e2" candidate_uuid: "f9904405e5b34e2f8959e4466bafd719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
I20260709 13:15:26.337884  5886 raft_consensus.cc:3055] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.338148  5959 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.338231  5886 raft_consensus.cc:740] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:26.339092  5886 consensus_queue.cc:260] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.339965  5886 raft_consensus.cc:3060] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.344872  5886 raft_consensus.cc:2468] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.345157  5959 raft_consensus.cc:2468] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9904405e5b34e2f8959e4466bafd719 in term 2.
I20260709 13:15:26.345906  5777 leader_election.cc:304] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 457c66bee59943bb9eec876c57217880, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:26.346760  6120 raft_consensus.cc:2804] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.347237  6120 raft_consensus.cc:697] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Leader. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:26.348012  6120 consensus_queue.cc:237] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:26.355134  5709 catalog_manager.cc:5697] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to f9904405e5b34e2f8959e4466bafd719 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "f9904405e5b34e2f8959e4466bafd719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.466843  5959 raft_consensus.cc:1275] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.468158  6120 consensus_queue.cc:1048] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.476076  5886 raft_consensus.cc:1275] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.477605  6120 consensus_queue.cc:1048] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.563205  5886 raft_consensus.cc:1275] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.564523  6130 consensus_queue.cc:1048] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.572192  5811 raft_consensus.cc:1275] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.573688  6132 consensus_queue.cc:1048] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.670348  5959 raft_consensus.cc:1275] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.670939  5886 raft_consensus.cc:1275] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.671725  6120 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.672488  6121 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.737310  5811 raft_consensus.cc:1275] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.738722  6084 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.750121  5959 raft_consensus.cc:1275] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.751662  6126 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.782377  5811 raft_consensus.cc:1275] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.783955  6126 consensus_queue.cc:1048] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.793257  5958 raft_consensus.cc:1275] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer 457c66bee59943bb9eec876c57217880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.795316  6126 consensus_queue.cc:1048] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.796628  5886 raft_consensus.cc:1275] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.798135  6121 consensus_queue.cc:1048] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.820649  5958 raft_consensus.cc:1275] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Refusing update from remote peer f9904405e5b34e2f8959e4466bafd719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.824759  6119 consensus_queue.cc:1048] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.848058  5704 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45556:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:28.872439  5704 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45556:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:28.938864 28922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:15:29.017501  5777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:45083, user_credentials={real_user=slave}} blocked reactor thread for 54912.1us
W20260709 13:15:29.097543  5850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:41569, user_credentials={real_user=slave}} blocked reactor thread for 51412.5us
W20260709 13:15:29.124146  5852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:34391, user_credentials={real_user=slave}} blocked reactor thread for 68016.4us
I20260709 13:15:29.186529  6234 tablet.cc:1724] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.215018  6224 log.cc:927] Time spent T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:15:29.202935  6208 log.cc:927] Time spent T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Append to log took a long time: real 0.164s	user 0.005s	sys 0.000s
I20260709 13:15:29.240382  6230 tablet.cc:1724] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.274487  6232 tablet.cc:1724] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.278357  6225 log.cc:927] Time spent T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:15:29.277900  6239 tablet.cc:1724] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.280223  6240 tablet.cc:1724] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.298156  6246 tablet.cc:1724] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.295459  5852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:34391, user_credentials={real_user=slave}} blocked reactor thread for 98101.1us
I20260709 13:15:29.320014  6236 tablet.cc:1724] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.321736  6240 tablet.cc:1724] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.330487  6233 log.cc:927] Time spent T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:15:29.340332  5837 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:8b3a9a3e52734ac096ed420a3ce00122)
W20260709 13:15:29.354506  5837 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:8b3a9a3e52734ac096ed420a3ce00122)
W20260709 13:15:29.364225  5912 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:8a208d14a7ba4196b12f785ff725e95b)
I20260709 13:15:29.371095  6234 tablet.cc:1724] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.372782  6230 tablet.cc:1724] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.356778  6249 tablet.cc:1724] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.397607  6239 tablet.cc:1724] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.374472  6232 tablet.cc:1724] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.414693  6244 tablet.cc:1724] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.416183  6245 tablet.cc:1724] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.422461  6236 tablet.cc:1724] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.425132  5884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:51206
I20260709 13:15:29.425952  5884 raft_consensus.cc:606] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Received request to transfer leadership to TS 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:29.373775  6240 tablet.cc:1724] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.463167  6234 tablet.cc:1724] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.480827  6246 tablet.cc:1724] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.493782  6239 tablet.cc:1724] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.425981  6248 tablet.cc:1724] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.495268  6244 tablet.cc:1724] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.502799  6243 raft_consensus.cc:993] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: : Instructing follower 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:29.503466  6096 raft_consensus.cc:1081] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Signalling peer 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:29.505625  5956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:44408
I20260709 13:15:29.506496  5956 raft_consensus.cc:493] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.507026  5956 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.480736  6251 tablet.cc:1724] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.527021  5926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:34391, user_credentials={real_user=slave}} blocked reactor thread for 62700.4us
I20260709 13:15:29.512660  6236 tablet.cc:1724] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.460836  6230 tablet.cc:1724] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.544550  6232 tablet.cc:1724] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.564090  5956 raft_consensus.cc:515] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.569067  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:29.569314  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34df2bf2fb1b41f6a42cbcc8c15298fe" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:29.570387  5809 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.569792  5883 raft_consensus.cc:3055] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:29.576462  5883 raft_consensus.cc:740] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:29.577520  5883 consensus_queue.cc:260] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.578297  5809 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:29.578699  5883 raft_consensus.cc:3060] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.580586  5926 leader_election.cc:304] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:29.581744  6254 raft_consensus.cc:2804] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.582211  6254 raft_consensus.cc:697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:29.567466  5956 leader_election.cc:290] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:29.582845  6249 tablet.cc:1724] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.583041  6254 consensus_queue.cc:237] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.595083  5809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e59453c032604f5a82b489bac8621232"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
mode: GRACEFUL
new_leader_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:56182
I20260709 13:15:29.595754  5809 raft_consensus.cc:606] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Received request to transfer leadership to TS 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:29.596837 28922 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:15:29.597532 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:29.601192  5883 raft_consensus.cc:2468] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:29.605036  5709 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: soft_deleted_table [id=d8e228beefec43c280db46ceab36223a] alter complete (version 1)
I20260709 13:15:29.610664  5883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6"
dest_uuid: "457c66bee59943bb9eec876c57217880"
mode: GRACEFUL
new_leader_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:51206
I20260709 13:15:29.611373  5883 raft_consensus.cc:606] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Received request to transfer leadership to TS 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:29.615698  5809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef"
dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
mode: GRACEFUL
new_leader_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:56182
I20260709 13:15:29.616277  5809 raft_consensus.cc:606] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Received request to transfer leadership to TS 0e70316d89b848e3bef9eef69289fe16
I20260709 13:15:29.616865  5704 catalog_manager.cc:5697] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 2 to 3, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.617753 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:29.618402 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:29.644891  6204 raft_consensus.cc:993] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: : Instructing follower 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:29.645612  6217 raft_consensus.cc:1081] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Signalling peer 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:29.647871  5960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:44412
I20260709 13:15:29.648434  5960 raft_consensus.cc:493] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.648708  5960 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.655186  5960 raft_consensus.cc:515] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.656980  5960 leader_election.cc:290] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:29.657752  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:29.658252  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d6a9a05e4643b5b2a3713f6b9496ef" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:29.658427  5809 raft_consensus.cc:3055] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:29.658850  5809 raft_consensus.cc:740] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:29.658879  5883 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.659588  5809 consensus_queue.cc:260] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.660539  5809 raft_consensus.cc:3060] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.664331  5883 raft_consensus.cc:2468] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:29.664991  5809 raft_consensus.cc:2468] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:29.665738  5926 leader_election.cc:304] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:29.666508  6254 raft_consensus.cc:2804] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.666970  6254 raft_consensus.cc:697] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:29.667912  6254 consensus_queue.cc:237] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:29.675899  5709 catalog_manager.cc:5697] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 2 to 3, leader changed from f9904405e5b34e2f8959e4466bafd719 (127.28.62.129) to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.009157  6204 raft_consensus.cc:993] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: : Instructing follower 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:30.009852  6217 raft_consensus.cc:1081] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Signalling peer 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:30.011524  5960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e59453c032604f5a82b489bac8621232"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:44412
I20260709 13:15:30.012050  5960 raft_consensus.cc:493] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.012365  5960 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.018643  5960 raft_consensus.cc:515] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.020324  5960 leader_election.cc:290] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:30.021483  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:30.021729  5883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59453c032604f5a82b489bac8621232" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:30.022138  5809 raft_consensus.cc:3055] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.022506  5809 raft_consensus.cc:740] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9904405e5b34e2f8959e4466bafd719, State: Running, Role: LEADER
I20260709 13:15:30.022544  5883 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.023243  5809 consensus_queue.cc:260] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.024161  5809 raft_consensus.cc:3060] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.030067  5883 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:30.030866  5809 raft_consensus.cc:2468] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 3.
I20260709 13:15:30.031757  5926 leader_election.cc:304] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, 457c66bee59943bb9eec876c57217880; no voters: 
I20260709 13:15:30.032541  6254 raft_consensus.cc:2804] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.033022  6254 raft_consensus.cc:697] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:30.033815  6254 consensus_queue.cc:237] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.040541  5709 catalog_manager.cc:5697] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 2 to 3, leader changed from f9904405e5b34e2f8959e4466bafd719 (127.28.62.129) to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 3 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.112906  5809 raft_consensus.cc:1275] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.114253  6254 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.128911  6096 raft_consensus.cc:993] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: : Instructing follower 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:30.129387  6096 raft_consensus.cc:1081] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Signalling peer 0e70316d89b848e3bef9eef69289fe16 to start an election
I20260709 13:15:30.131716  5883 raft_consensus.cc:1275] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.132984  5960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6"
dest_uuid: "0e70316d89b848e3bef9eef69289fe16"
 from {username='slave'} at 127.0.0.1:44408
I20260709 13:15:30.133663  5960 raft_consensus.cc:493] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.134598  5960 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.135520  6254 consensus_queue.cc:1048] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.150920  5960 raft_consensus.cc:515] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.152769  5960 leader_election.cc:290] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 2 election: Requested vote from peers f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391), 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083)
I20260709 13:15:30.153725  5809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9904405e5b34e2f8959e4466bafd719"
I20260709 13:15:30.154008  5885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2380be395ee4191914e5e1a66aceaa6" candidate_uuid: "0e70316d89b848e3bef9eef69289fe16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "457c66bee59943bb9eec876c57217880"
I20260709 13:15:30.154366  5809 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.154662  5885 raft_consensus.cc:3055] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:30.155004  5885 raft_consensus.cc:740] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 457c66bee59943bb9eec876c57217880, State: Running, Role: LEADER
I20260709 13:15:30.155920  5811 raft_consensus.cc:1275] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.155864  5885 consensus_queue.cc:260] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.157238  5885 raft_consensus.cc:3060] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:30.157619  6254 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.162070  5809 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 2.
I20260709 13:15:30.163295  5926 leader_election.cc:304] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e70316d89b848e3bef9eef69289fe16, f9904405e5b34e2f8959e4466bafd719; no voters: 
I20260709 13:15:30.164182  6254 raft_consensus.cc:2804] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:30.164474  5885 raft_consensus.cc:2468] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e70316d89b848e3bef9eef69289fe16 in term 2.
I20260709 13:15:30.164922  6254 raft_consensus.cc:697] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 LEADER]: Becoming Leader. State: Replica: 0e70316d89b848e3bef9eef69289fe16, State: Running, Role: LEADER
I20260709 13:15:30.165849  6254 consensus_queue.cc:237] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } }
I20260709 13:15:30.175614  5885 raft_consensus.cc:1275] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.177549  6254 consensus_queue.cc:1048] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.179029  5706 catalog_manager.cc:5697] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 reported cstate change: term changed from 1 to 2, leader changed from 457c66bee59943bb9eec876c57217880 (127.28.62.130) to 0e70316d89b848e3bef9eef69289fe16 (127.28.62.131). New cstate: current_term: 2 leader_uuid: "0e70316d89b848e3bef9eef69289fe16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e70316d89b848e3bef9eef69289fe16" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 41569 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.588706  5885 raft_consensus.cc:1275] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.590059  6254 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.598546  5811 raft_consensus.cc:1275] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.599916  6268 consensus_queue.cc:1048] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.623154  5811 raft_consensus.cc:1275] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.625629  6268 consensus_queue.cc:1048] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9904405e5b34e2f8959e4466bafd719" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.638866  5885 raft_consensus.cc:1275] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Refusing update from remote peer 0e70316d89b848e3bef9eef69289fe16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.644407  6268 consensus_queue.cc:1048] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "457c66bee59943bb9eec876c57217880" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 45083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.701491 28922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:15:30.707273 28922 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:15:30.707774 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:30.713423 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:15:30.713865 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:31.747224 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
W20260709 13:15:31.764346  5852 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:15:31.769723  5852 consensus_peers.cc:597] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.778416 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:31.779346 28922 tablet_replica.cc:333] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.779978 28922 raft_consensus.cc:2243] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.780483 28922 raft_consensus.cc:2272] T 43ed478ca7854e5f976e48f63212768f P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.783092 28922 tablet_replica.cc:333] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.783845 28922 raft_consensus.cc:2243] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.784448 28922 raft_consensus.cc:2272] T 34df2bf2fb1b41f6a42cbcc8c15298fe P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.786377 28922 tablet_replica.cc:333] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.786895 28922 raft_consensus.cc:2243] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.787277 28922 raft_consensus.cc:2272] T 8a208d14a7ba4196b12f785ff725e95b P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.788977 28922 tablet_replica.cc:333] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.789603 28922 raft_consensus.cc:2243] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.789973 28922 raft_consensus.cc:2272] T e59453c032604f5a82b489bac8621232 P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.791957 28922 tablet_replica.cc:333] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.792670 28922 raft_consensus.cc:2243] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.793161 28922 raft_consensus.cc:2272] T a4d6a9a05e4643b5b2a3713f6b9496ef P f9904405e5b34e2f8959e4466bafd719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.795271 28922 tablet_replica.cc:333] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.796025 28922 raft_consensus.cc:2243] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:31.796495  5926 consensus_peers.cc:597] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.796581 28922 raft_consensus.cc:2272] T 61328a6f4dca43098ec02f9aa155ac49 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.798851 28922 tablet_replica.cc:333] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.799456 28922 raft_consensus.cc:2243] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.799917 28922 raft_consensus.cc:2272] T ab50f69c63604e76a6016c58e8e38d29 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.802673 28922 tablet_replica.cc:333] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.803362 28922 raft_consensus.cc:2243] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.804287 28922 raft_consensus.cc:2272] T bb6707d1e9bb416bad904c78772b04e2 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.806478 28922 tablet_replica.cc:333] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.807107 28922 raft_consensus.cc:2243] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.807984 28922 raft_consensus.cc:2272] T 253e2b31349f43d6a620793fad5a3748 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.810451 28922 tablet_replica.cc:333] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.811228 28922 raft_consensus.cc:2243] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.811758 28922 raft_consensus.cc:2272] T ab16d0f8adaa49c29bb666ab7a654ee4 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.813782 28922 tablet_replica.cc:333] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.814461 28922 raft_consensus.cc:2243] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.814973 28922 raft_consensus.cc:2272] T 8e326a0ffae549d1961dfbead862502c P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.817351 28922 tablet_replica.cc:333] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.818081 28922 raft_consensus.cc:2243] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.818574 28922 raft_consensus.cc:2272] T a2380be395ee4191914e5e1a66aceaa6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.820709 28922 tablet_replica.cc:333] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.821341 28922 raft_consensus.cc:2243] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.822360 28922 raft_consensus.cc:2272] T 8b3a9a3e52734ac096ed420a3ce00122 P f9904405e5b34e2f8959e4466bafd719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.824921 28922 tablet_replica.cc:333] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.825559 28922 raft_consensus.cc:2243] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.826045 28922 raft_consensus.cc:2272] T 03093499b5494aa99079ab5f14d30923 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.828178 28922 tablet_replica.cc:333] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.829094 28922 raft_consensus.cc:2243] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.830252 28922 raft_consensus.cc:2272] T 8960c3262d8a48cc8fca2c7d4993886f P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:31.831249  5852 consensus_peers.cc:597] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:31.831902  5852 consensus_peers.cc:597] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.832939 28922 tablet_replica.cc:333] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.833640 28922 raft_consensus.cc:2243] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.834524 28922 raft_consensus.cc:2272] T 2a144825570b43b78138a5f0b358def0 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.836566 28922 tablet_replica.cc:333] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.837188 28922 raft_consensus.cc:2243] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.837836 28922 raft_consensus.cc:2272] T 64f4993ed1544f46a9d2f98d9750acd6 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.839984 28922 tablet_replica.cc:333] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719: stopping tablet replica
I20260709 13:15:31.840518 28922 raft_consensus.cc:2243] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.841358 28922 raft_consensus.cc:2272] T ab618523bbab4ce79ed14444ed2c4455 P f9904405e5b34e2f8959e4466bafd719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.884341 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:15:31.907963  5852 consensus_peers.cc:597] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:31.913571  5926 consensus_peers.cc:597] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.922708 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:15:31.958350 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:31.959115 28922 tablet_replica.cc:333] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.959764 28922 raft_consensus.cc:2243] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.960276 28922 raft_consensus.cc:2272] T e59453c032604f5a82b489bac8621232 P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.962234 28922 tablet_replica.cc:333] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.962841 28922 raft_consensus.cc:2243] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.963303 28922 raft_consensus.cc:2272] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.965116 28922 tablet_replica.cc:333] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.965739 28922 raft_consensus.cc:2243] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.966476 28922 raft_consensus.cc:2272] T 43ed478ca7854e5f976e48f63212768f P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.968251 28922 tablet_replica.cc:333] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.968770 28922 raft_consensus.cc:2243] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.969632 28922 raft_consensus.cc:2272] T 8e326a0ffae549d1961dfbead862502c P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.971519 28922 tablet_replica.cc:333] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.972079 28922 raft_consensus.cc:2243] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.972827 28922 raft_consensus.cc:2272] T ab16d0f8adaa49c29bb666ab7a654ee4 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.974677 28922 tablet_replica.cc:333] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.975296 28922 raft_consensus.cc:2243] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.976081 28922 raft_consensus.cc:2272] T 61328a6f4dca43098ec02f9aa155ac49 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.978340 28922 tablet_replica.cc:333] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.978969 28922 raft_consensus.cc:2243] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.979435 28922 raft_consensus.cc:2272] T ab50f69c63604e76a6016c58e8e38d29 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:31.979964  5926 consensus_peers.cc:597] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.981673 28922 tablet_replica.cc:333] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.982347 28922 raft_consensus.cc:2243] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.983178 28922 raft_consensus.cc:2272] T 8a208d14a7ba4196b12f785ff725e95b P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.985819 28922 tablet_replica.cc:333] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.986696 28922 raft_consensus.cc:2243] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.987262 28922 raft_consensus.cc:2272] T 2a144825570b43b78138a5f0b358def0 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.989166 28922 tablet_replica.cc:333] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.989779 28922 raft_consensus.cc:2243] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.990624 28922 raft_consensus.cc:2272] T 64f4993ed1544f46a9d2f98d9750acd6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.992650 28922 tablet_replica.cc:333] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.993209 28922 raft_consensus.cc:2243] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.993688 28922 raft_consensus.cc:2272] T a4d6a9a05e4643b5b2a3713f6b9496ef P 457c66bee59943bb9eec876c57217880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.995555 28922 tablet_replica.cc:333] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.996074 28922 raft_consensus.cc:2243] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.996826 28922 raft_consensus.cc:2272] T 8b3a9a3e52734ac096ed420a3ce00122 P 457c66bee59943bb9eec876c57217880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.998795 28922 tablet_replica.cc:333] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:31.999477 28922 raft_consensus.cc:2243] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.000017 28922 raft_consensus.cc:2272] T a2380be395ee4191914e5e1a66aceaa6 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.001984 28922 tablet_replica.cc:333] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:32.002521 28922 raft_consensus.cc:2243] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.002951 28922 raft_consensus.cc:2272] T 03093499b5494aa99079ab5f14d30923 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.004701 28922 tablet_replica.cc:333] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:32.005759 28922 raft_consensus.cc:2243] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.006314 28922 raft_consensus.cc:2272] T 8960c3262d8a48cc8fca2c7d4993886f P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.008435 28922 tablet_replica.cc:333] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:32.009004 28922 raft_consensus.cc:2243] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.009514 28922 raft_consensus.cc:2272] T bb6707d1e9bb416bad904c78772b04e2 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.011643 28922 tablet_replica.cc:333] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:32.012235 28922 raft_consensus.cc:2243] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.012739 28922 raft_consensus.cc:2272] T 253e2b31349f43d6a620793fad5a3748 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.015004 28922 tablet_replica.cc:333] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880: stopping tablet replica
I20260709 13:15:32.015516 28922 raft_consensus.cc:2243] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.016016 28922 raft_consensus.cc:2272] T ab618523bbab4ce79ed14444ed2c4455 P 457c66bee59943bb9eec876c57217880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.057806 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
W20260709 13:15:32.084817  5926 consensus_peers.cc:597] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 -> Peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Couldn't send request to peer 457c66bee59943bb9eec876c57217880. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:45083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.087860  5926 consensus_peers.cc:597] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 -> Peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Couldn't send request to peer 457c66bee59943bb9eec876c57217880. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:45083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.094389 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
W20260709 13:15:32.116742  5926 consensus_peers.cc:597] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 -> Peer 457c66bee59943bb9eec876c57217880 (127.28.62.130:45083): Couldn't send request to peer 457c66bee59943bb9eec876c57217880. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:45083: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.118391  5926 consensus_peers.cc:597] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.119107  5926 consensus_peers.cc:597] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.134016 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:32.134718 28922 tablet_replica.cc:333] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.135586 28922 raft_consensus.cc:2243] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.136173 28922 raft_consensus.cc:2272] T 43ed478ca7854e5f976e48f63212768f P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.138154 28922 tablet_replica.cc:333] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.138772 28922 raft_consensus.cc:2243] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.139559 28922 raft_consensus.cc:2272] T e59453c032604f5a82b489bac8621232 P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.141459 28922 tablet_replica.cc:333] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.142040 28922 raft_consensus.cc:2243] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.142489 28922 raft_consensus.cc:2272] T 8a208d14a7ba4196b12f785ff725e95b P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.144882 28922 tablet_replica.cc:333] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.145721 28922 raft_consensus.cc:2243] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.146579 28922 raft_consensus.cc:2272] T 34df2bf2fb1b41f6a42cbcc8c15298fe P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.148869 28922 tablet_replica.cc:333] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.149642 28922 raft_consensus.cc:2243] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.150103 28922 raft_consensus.cc:2272] T 8e326a0ffae549d1961dfbead862502c P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.152933 28922 tablet_replica.cc:333] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
W20260709 13:15:32.153506  5926 consensus_peers.cc:597] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 -> Peer f9904405e5b34e2f8959e4466bafd719 (127.28.62.129:34391): Couldn't send request to peer f9904405e5b34e2f8959e4466bafd719. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:34391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.153788 28922 raft_consensus.cc:2243] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.154349 28922 raft_consensus.cc:2272] T ab16d0f8adaa49c29bb666ab7a654ee4 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.156145 28922 tablet_replica.cc:333] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.156733 28922 raft_consensus.cc:2243] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.157137 28922 raft_consensus.cc:2272] T 61328a6f4dca43098ec02f9aa155ac49 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.159108 28922 tablet_replica.cc:333] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.159595 28922 raft_consensus.cc:2243] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.160305 28922 raft_consensus.cc:2272] T ab50f69c63604e76a6016c58e8e38d29 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.162379 28922 tablet_replica.cc:333] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.163019 28922 raft_consensus.cc:2243] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.163403 28922 raft_consensus.cc:2272] T 2a144825570b43b78138a5f0b358def0 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.165482 28922 tablet_replica.cc:333] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.166045 28922 raft_consensus.cc:2243] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.166455 28922 raft_consensus.cc:2272] T 64f4993ed1544f46a9d2f98d9750acd6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.168656 28922 tablet_replica.cc:333] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.169176 28922 raft_consensus.cc:2243] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.169680 28922 raft_consensus.cc:2272] T 8b3a9a3e52734ac096ed420a3ce00122 P 0e70316d89b848e3bef9eef69289fe16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.171417 28922 tablet_replica.cc:333] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.171955 28922 raft_consensus.cc:2243] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.172667 28922 raft_consensus.cc:2272] T a2380be395ee4191914e5e1a66aceaa6 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.174691 28922 tablet_replica.cc:333] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.175196 28922 raft_consensus.cc:2243] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.175911 28922 raft_consensus.cc:2272] T 03093499b5494aa99079ab5f14d30923 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.177700 28922 tablet_replica.cc:333] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.178202 28922 raft_consensus.cc:2243] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.178619 28922 raft_consensus.cc:2272] T 8960c3262d8a48cc8fca2c7d4993886f P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.180541 28922 tablet_replica.cc:333] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.181070 28922 raft_consensus.cc:2243] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.181568 28922 raft_consensus.cc:2272] T bb6707d1e9bb416bad904c78772b04e2 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.183327 28922 tablet_replica.cc:333] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.183815 28922 raft_consensus.cc:2243] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.184197 28922 raft_consensus.cc:2272] T 253e2b31349f43d6a620793fad5a3748 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.186192 28922 tablet_replica.cc:333] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.186694 28922 raft_consensus.cc:2243] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.187088 28922 raft_consensus.cc:2272] T ab618523bbab4ce79ed14444ed2c4455 P 0e70316d89b848e3bef9eef69289fe16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.189005 28922 tablet_replica.cc:333] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16: stopping tablet replica
I20260709 13:15:32.189520 28922 raft_consensus.cc:2243] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.190253 28922 raft_consensus.cc:2272] T a4d6a9a05e4643b5b2a3713f6b9496ef P 0e70316d89b848e3bef9eef69289fe16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.233196 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:15:32.264288 28922 master.cc:562] Master@127.28.62.190:44959 shutting down...
I20260709 13:15:32.286559 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.287436 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.287914 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 16dfbcb15de54dbaa2db2b9247e04476: stopping tablet replica
I20260709 13:15:32.310309 28922 master.cc:584] Master@127.28.62.190:44959 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12771 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:15:32.362100 28922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.62.190:43473
I20260709 13:15:32.363369 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.370178  6280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.370446  6281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.370950  6283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.371451 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:32.372382 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.372562 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.372679 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602932372668 us; error 0 us; skew 500 ppm
I20260709 13:15:32.373158 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.375844 28922 webserver.cc:533] Webserver started at http://127.28.62.190:32937/ using document root <none> and password file <none>
I20260709 13:15:32.376300 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.376452 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.376685 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.377856 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/master-0-root/instance:
uuid: "a28874fbf83843989dbc78ef43a3d2bf"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.382779 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:15:32.386579  6288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.387485 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:32.387866 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/master-0-root
uuid: "a28874fbf83843989dbc78ef43a3d2bf"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.388162 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.403056 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.404237 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.444264 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.190:43473
I20260709 13:15:32.444350  6339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.190:43473 every 8 connection(s)
I20260709 13:15:32.448658  6340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.460331  6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: Bootstrap starting.
I20260709 13:15:32.465663  6340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.470661  6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: No bootstrap required, opened a new log
I20260709 13:15:32.473145  6340 raft_consensus.cc:359] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER }
I20260709 13:15:32.473623  6340 raft_consensus.cc:385] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.473944  6340 raft_consensus.cc:740] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a28874fbf83843989dbc78ef43a3d2bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.474611  6340 consensus_queue.cc:260] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER }
I20260709 13:15:32.475136  6340 raft_consensus.cc:399] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:32.475380  6340 raft_consensus.cc:493] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:32.475715  6340 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.480998  6340 raft_consensus.cc:515] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER }
I20260709 13:15:32.481681  6340 leader_election.cc:304] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a28874fbf83843989dbc78ef43a3d2bf; no voters: 
I20260709 13:15:32.482918  6340 leader_election.cc:290] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:32.483294  6343 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.485219  6343 raft_consensus.cc:697] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 1 LEADER]: Becoming Leader. State: Replica: a28874fbf83843989dbc78ef43a3d2bf, State: Running, Role: LEADER
I20260709 13:15:32.485970  6343 consensus_queue.cc:237] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER }
I20260709 13:15:32.486307  6340 sys_catalog.cc:565] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:32.491204  6345 sys_catalog.cc:455] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a28874fbf83843989dbc78ef43a3d2bf. Latest consensus state: current_term: 1 leader_uuid: "a28874fbf83843989dbc78ef43a3d2bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER } }
I20260709 13:15:32.491456  6344 sys_catalog.cc:455] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a28874fbf83843989dbc78ef43a3d2bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a28874fbf83843989dbc78ef43a3d2bf" member_type: VOTER } }
I20260709 13:15:32.492295  6345 sys_catalog.cc:458] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:32.492347  6344 sys_catalog.cc:458] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:32.495639  6350 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:32.500625  6350 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:32.505183 28922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:32.509797  6350 catalog_manager.cc:1383] Generated new cluster ID: 5484c56dd265427494d6a1374cc0a01b
I20260709 13:15:32.510098  6350 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:32.530967  6350 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:32.532405  6350 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:32.551990  6350 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: Generated new TSK 0
I20260709 13:15:32.552595  6350 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:32.571982 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.578815  6361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.580106  6362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.584556  6364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.584617 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:32.586022 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.586282 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.586472 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602932586451 us; error 0 us; skew 500 ppm
I20260709 13:15:32.587085 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.589856 28922 webserver.cc:533] Webserver started at http://127.28.62.129:35323/ using document root <none> and password file <none>
I20260709 13:15:32.590435 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.590672 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.590965 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.592175 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-0-root/instance:
uuid: "1846555dc6194afda53312d1bdfb3375"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.597074 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:15:32.600878  6369 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.601794 28922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:32.602202 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-0-root
uuid: "1846555dc6194afda53312d1bdfb3375"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.602510 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.637970 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.639174 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.640640 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.643019 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.643210 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.643517 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.643694 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.689127 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.129:33549
I20260709 13:15:32.689304  6431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.129:33549 every 8 connection(s)
I20260709 13:15:32.694682 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.703058  6436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.703394  6437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.707366  6432 heartbeater.cc:344] Connected to a master server at 127.28.62.190:43473
I20260709 13:15:32.707357 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:32.708004  6432 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:32.708026  6440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.709167  6432 heartbeater.cc:507] Master 127.28.62.190:43473 requested a full tablet report, sending...
I20260709 13:15:32.709298 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.709787 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.710021 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602932710006 us; error 0 us; skew 500 ppm
I20260709 13:15:32.710776 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.711722  6305 ts_manager.cc:194] Registered new tserver with Master: 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549)
I20260709 13:15:32.713668  6305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55854
I20260709 13:15:32.715883 28922 webserver.cc:533] Webserver started at http://127.28.62.130:35753/ using document root <none> and password file <none>
I20260709 13:15:32.716584 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.716818 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.717093 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.718266 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-1-root/instance:
uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.722921 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:15:32.726706  6444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.727689 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:32.728077 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-1-root
uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.728451 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.747365 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.748706 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.750320 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.752570 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.752808 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.753049 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.753225 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.801225 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.130:43193
I20260709 13:15:32.801327  6506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.130:43193 every 8 connection(s)
I20260709 13:15:32.806470 28922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.814703  6510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.816700  6511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.820398  6507 heartbeater.cc:344] Connected to a master server at 127.28.62.190:43473
I20260709 13:15:32.821132  6507 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:32.821365  6513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.822511  6507 heartbeater.cc:507] Master 127.28.62.190:43473 requested a full tablet report, sending...
I20260709 13:15:32.823334 28922 server_base.cc:1061] running on GCE node
I20260709 13:15:32.824626 28922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.824887 28922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.824977  6305 ts_manager.cc:194] Registered new tserver with Master: ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:32.825232 28922 hybrid_clock.cc:648] HybridClock initialized: now 1783602932825208 us; error 0 us; skew 500 ppm
I20260709 13:15:32.826258 28922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.827026  6305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55856
I20260709 13:15:32.829991 28922 webserver.cc:533] Webserver started at http://127.28.62.131:43295/ using document root <none> and password file <none>
I20260709 13:15:32.830693 28922 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.830883 28922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.831168 28922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.832425 28922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-2-root/instance:
uuid: "5bd40b8e45db41a0b96771832c564a0f"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.837620 28922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:15:32.841492  6518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.842355 28922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:32.842700 28922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-2-root
uuid: "5bd40b8e45db41a0b96771832c564a0f"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-50cs"
I20260709 13:15:32.842983 28922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRFsHCE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602634710825-28922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.863368 28922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.864722 28922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.866427 28922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.868865 28922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.869122 28922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.869433 28922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.869650 28922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:32.920387 28922 rpc_server.cc:307] RPC server started. Bound to: 127.28.62.131:33963
I20260709 13:15:32.920859  6580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.62.131:33963 every 8 connection(s)
I20260709 13:15:32.939764  6581 heartbeater.cc:344] Connected to a master server at 127.28.62.190:43473
I20260709 13:15:32.940212  6581 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:32.940945  6581 heartbeater.cc:507] Master 127.28.62.190:43473 requested a full tablet report, sending...
I20260709 13:15:32.943764  6305 ts_manager.cc:194] Registered new tserver with Master: 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:32.944525 28922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020566508s
I20260709 13:15:32.945665  6305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55872
I20260709 13:15:32.973505  6305 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55878:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:32.976353  6305 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:33.064509  6397 tablet_service.cc:1511] Processing CreateTablet for tablet 5e705997065b4701a6757a88838b96de (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:33.066133  6397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e705997065b4701a6757a88838b96de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.068612  6396 tablet_service.cc:1511] Processing CreateTablet for tablet cb2b3963bf784fab998b9225c3dd7f1b (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:33.070333  6396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2b3963bf784fab998b9225c3dd7f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.074645  6394 tablet_service.cc:1511] Processing CreateTablet for tablet bba9991a7eb646b28cbce1157472e0bc (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:33.076359  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba9991a7eb646b28cbce1157472e0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.078665  6393 tablet_service.cc:1511] Processing CreateTablet for tablet 36d144aacaed4ff590234c0e227341e8 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:33.080958  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d144aacaed4ff590234c0e227341e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.068612  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 466de93f2c444805802af09382fc9f86 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:33.083985  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466de93f2c444805802af09382fc9f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.086393  6546 tablet_service.cc:1511] Processing CreateTablet for tablet 5e705997065b4701a6757a88838b96de (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:33.085376  6392 tablet_service.cc:1511] Processing CreateTablet for tablet 450d7b2e49734f5cb93930e2e4906e6a (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:33.087927  6546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e705997065b4701a6757a88838b96de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.088546  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450d7b2e49734f5cb93930e2e4906e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.092707  6545 tablet_service.cc:1511] Processing CreateTablet for tablet cb2b3963bf784fab998b9225c3dd7f1b (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:33.094307  6545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2b3963bf784fab998b9225c3dd7f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.095834  6472 tablet_service.cc:1511] Processing CreateTablet for tablet 5e705997065b4701a6757a88838b96de (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:33.097359  6472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e705997065b4701a6757a88838b96de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.100162  6470 tablet_service.cc:1511] Processing CreateTablet for tablet 466de93f2c444805802af09382fc9f86 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:33.111018  6470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466de93f2c444805802af09382fc9f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.100364  6544 tablet_service.cc:1511] Processing CreateTablet for tablet 466de93f2c444805802af09382fc9f86 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:33.115163  6544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466de93f2c444805802af09382fc9f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.101325  6469 tablet_service.cc:1511] Processing CreateTablet for tablet bba9991a7eb646b28cbce1157472e0bc (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:33.102515  6542 tablet_service.cc:1511] Processing CreateTablet for tablet 36d144aacaed4ff590234c0e227341e8 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:33.119324  6542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d144aacaed4ff590234c0e227341e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.102571  6468 tablet_service.cc:1511] Processing CreateTablet for tablet 36d144aacaed4ff590234c0e227341e8 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:33.121596  6468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d144aacaed4ff590234c0e227341e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.104353  6543 tablet_service.cc:1511] Processing CreateTablet for tablet bba9991a7eb646b28cbce1157472e0bc (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:33.123847  6543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba9991a7eb646b28cbce1157472e0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.098898  6471 tablet_service.cc:1511] Processing CreateTablet for tablet cb2b3963bf784fab998b9225c3dd7f1b (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:33.127199  6471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2b3963bf784fab998b9225c3dd7f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.105545  6467 tablet_service.cc:1511] Processing CreateTablet for tablet 450d7b2e49734f5cb93930e2e4906e6a (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:33.129503  6467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450d7b2e49734f5cb93930e2e4906e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.131395  6469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba9991a7eb646b28cbce1157472e0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.147325  6541 tablet_service.cc:1511] Processing CreateTablet for tablet 450d7b2e49734f5cb93930e2e4906e6a (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:33.148900  6541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450d7b2e49734f5cb93930e2e4906e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.162842  6597 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.165287  6391 tablet_service.cc:1511] Processing CreateTablet for tablet b87681389e8c4656ba8d06a85ecab72c (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:33.167081  6466 tablet_service.cc:1511] Processing CreateTablet for tablet b87681389e8c4656ba8d06a85ecab72c (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:33.168641  6540 tablet_service.cc:1511] Processing CreateTablet for tablet b87681389e8c4656ba8d06a85ecab72c (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:33.175058  6540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87681389e8c4656ba8d06a85ecab72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.179579  6466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87681389e8c4656ba8d06a85ecab72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.185773  6397 tablet_service.cc:1511] Processing CreateTablet for tablet 217b89a783ea446da690b161ea9b3999 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:33.197587  6465 tablet_service.cc:1511] Processing CreateTablet for tablet 217b89a783ea446da690b161ea9b3999 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:33.199295  6465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b89a783ea446da690b161ea9b3999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.202764  6539 tablet_service.cc:1511] Processing CreateTablet for tablet 217b89a783ea446da690b161ea9b3999 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:33.204422  6539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b89a783ea446da690b161ea9b3999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.208453  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87681389e8c4656ba8d06a85ecab72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.210510  6597 tablet_bootstrap.cc:654] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.220697  6397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b89a783ea446da690b161ea9b3999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.211881  6396 tablet_service.cc:1511] Processing CreateTablet for tablet 20fc7db35e864e71a3ca5ac9d5ff4580 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:33.215862  6464 tablet_service.cc:1511] Processing CreateTablet for tablet 20fc7db35e864e71a3ca5ac9d5ff4580 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:33.220444  6546 tablet_service.cc:1511] Processing CreateTablet for tablet 20fc7db35e864e71a3ca5ac9d5ff4580 (DEFAULT_TABLE table=test-workload [id=cc33f4fca1e44dfab379a84d534db483]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:33.221940  6464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fc7db35e864e71a3ca5ac9d5ff4580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.222062  6546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fc7db35e864e71a3ca5ac9d5ff4580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.266129  6598 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.288726  6597 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.289418  6597 ts_tablet_manager.cc:1403] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.000s
I20260709 13:15:33.293061  6597 raft_consensus.cc:359] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.293900  6597 raft_consensus.cc:385] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.294274  6597 raft_consensus.cc:740] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.295032  6600 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.295200  6597 consensus_queue.cc:260] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.297712  6598 tablet_bootstrap.cc:654] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.329205  6432 heartbeater.cc:499] Master 127.28.62.190:43473 was elected leader, sending a full tablet report...
I20260709 13:15:33.330302  6396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fc7db35e864e71a3ca5ac9d5ff4580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.371898  6597 ts_tablet_manager.cc:1434] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:15:33.398459  6600 tablet_bootstrap.cc:654] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.399199  6597 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.419504  6597 tablet_bootstrap.cc:654] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.420940  6598 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.421936  6598 ts_tablet_manager.cc:1403] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.156s	user 0.017s	sys 0.015s
I20260709 13:15:33.433924  6600 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.434777  6600 ts_tablet_manager.cc:1403] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.014s
I20260709 13:15:33.438378  6598 raft_consensus.cc:359] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.439357  6600 raft_consensus.cc:359] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.439903  6598 raft_consensus.cc:385] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.440018  6597 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.440297  6600 raft_consensus.cc:385] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.440325  6598 raft_consensus.cc:740] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.440726  6597 ts_tablet_manager.cc:1403] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 13:15:33.440867  6600 raft_consensus.cc:740] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.441610  6598 consensus_queue.cc:260] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.441813  6600 consensus_queue.cc:260] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
W20260709 13:15:33.444145  6433 tablet.cc:2406] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:33.444679  6597 raft_consensus.cc:359] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.445744  6597 raft_consensus.cc:385] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.445788  6581 heartbeater.cc:499] Master 127.28.62.190:43473 was elected leader, sending a full tablet report...
I20260709 13:15:33.446125  6597 raft_consensus.cc:740] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.447059  6597 consensus_queue.cc:260] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.450311  6597 ts_tablet_manager.cc:1434] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:15:33.451327  6598 ts_tablet_manager.cc:1434] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:15:33.451424  6597 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.452874  6598 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.456753  6600 ts_tablet_manager.cc:1434] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 13:15:33.458082  6507 heartbeater.cc:499] Master 127.28.62.190:43473 was elected leader, sending a full tablet report...
I20260709 13:15:33.458627  6600 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.460147  6597 tablet_bootstrap.cc:654] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.461513  6598 tablet_bootstrap.cc:654] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.471182  6600 tablet_bootstrap.cc:654] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.474812  6598 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.475585  6598 ts_tablet_manager.cc:1403] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:15:33.480094  6598 raft_consensus.cc:359] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.481168  6598 raft_consensus.cc:385] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.482563  6598 raft_consensus.cc:740] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.484011  6598 consensus_queue.cc:260] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.485332  6597 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.486053  6597 ts_tablet_manager.cc:1403] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 13:15:33.486440  6600 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.487020  6600 ts_tablet_manager.cc:1403] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:15:33.487596  6598 ts_tablet_manager.cc:1434] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:15:33.488744  6598 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.489825  6597 raft_consensus.cc:359] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.490795  6597 raft_consensus.cc:385] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.490535  6600 raft_consensus.cc:359] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.491209  6597 raft_consensus.cc:740] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.491662  6600 raft_consensus.cc:385] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.492077  6600 raft_consensus.cc:740] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.492159  6597 consensus_queue.cc:260] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.493187  6600 consensus_queue.cc:260] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.496017  6600 ts_tablet_manager.cc:1434] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:15:33.497304  6600 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.497525  6598 tablet_bootstrap.cc:654] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.499485  6601 raft_consensus.cc:493] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.500183  6601 raft_consensus.cc:515] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.507884  6600 tablet_bootstrap.cc:654] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.508242  6601 leader_election.cc:290] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.512007  6598 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.512770  6598 ts_tablet_manager.cc:1403] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.014s
W20260709 13:15:33.516558  6353 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:33.516988  6598 raft_consensus.cc:359] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.518308  6598 raft_consensus.cc:385] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.518630  6598 raft_consensus.cc:740] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.519721  6598 consensus_queue.cc:260] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.520759  6600 tablet_bootstrap.cc:492] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.521391  6600 ts_tablet_manager.cc:1403] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 13:15:33.521739  6597 ts_tablet_manager.cc:1434] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:15:33.523070  6597 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.525007  6600 raft_consensus.cc:359] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.522483  6598 ts_tablet_manager.cc:1434] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:15:33.525914  6600 raft_consensus.cc:385] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.526497  6600 raft_consensus.cc:740] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.527302  6598 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.527624  6600 consensus_queue.cc:260] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.533532  6600 ts_tablet_manager.cc:1434] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:33.534752  6600 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.535537  6598 tablet_bootstrap.cc:654] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.538301  6606 raft_consensus.cc:493] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.538932  6597 tablet_bootstrap.cc:654] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.538923  6606 raft_consensus.cc:515] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.542344  6600 tablet_bootstrap.cc:654] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.559468  6606 leader_election.cc:290] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:33.566794  6597 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.567296  6597 ts_tablet_manager.cc:1403] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.009s
I20260709 13:15:33.560395  6606 raft_consensus.cc:493] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.568068  6606 raft_consensus.cc:515] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.570255  6597 raft_consensus.cc:359] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.571265  6597 raft_consensus.cc:385] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.571677  6597 raft_consensus.cc:740] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.573063  6597 consensus_queue.cc:260] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.575412  6606 leader_election.cc:290] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:33.579340  6597 ts_tablet_manager.cc:1434] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:15:33.581118  6597 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.586251  6601 raft_consensus.cc:493] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.586998  6601 raft_consensus.cc:515] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.591624  6601 leader_election.cc:290] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:33.597044  6598 tablet_bootstrap.cc:492] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.597886  6598 ts_tablet_manager.cc:1403] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.006s
I20260709 13:15:33.599826  6597 tablet_bootstrap.cc:654] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.602759  6598 raft_consensus.cc:359] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.604118  6598 raft_consensus.cc:385] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.604727  6598 raft_consensus.cc:740] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.604395  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.605796  6556 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.605937  6598 consensus_queue.cc:260] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.608314  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.611676  6556 raft_consensus.cc:2468] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.611725  6598 ts_tablet_manager.cc:1434] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.002s
I20260709 13:15:33.613624  6598 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.614058  6597 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.614738  6597 ts_tablet_manager.cc:1403] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.000s
I20260709 13:15:33.616303  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.617144  6482 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.618530  6597 raft_consensus.cc:359] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.619014  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.619472  6597 raft_consensus.cc:385] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.619840  6597 raft_consensus.cc:740] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.620813  6372 leader_election.cc:304] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:33.620970  6597 consensus_queue.cc:260] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.621968  6601 raft_consensus.cc:2804] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.622437  6601 raft_consensus.cc:493] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.622951  6601 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.623493  6598 tablet_bootstrap.cc:654] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.631124  6597 ts_tablet_manager.cc:1434] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.016s	user 0.016s	sys 0.000s
I20260709 13:15:33.637693  6371 leader_election.cc:304] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
W20260709 13:15:33.639827  6372 leader_election.cc:343] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.640264  6597 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.646287  6622 raft_consensus.cc:2804] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.646591  6598 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.646945  6622 raft_consensus.cc:493] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.647421  6598 ts_tablet_manager.cc:1403] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 13:15:33.647424  6622 raft_consensus.cc:3060] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.654856  6601 raft_consensus.cc:515] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.660903  6598 raft_consensus.cc:359] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.662180  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:33.662885  6482 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.662251  6598 raft_consensus.cc:385] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.665606  6598 raft_consensus.cc:740] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.665818  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:33.666488  6556 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.666745  6601 leader_election.cc:290] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.668226  6622 raft_consensus.cc:515] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.667970  6598 consensus_queue.cc:260] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.671888  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:33.672034  6598 ts_tablet_manager.cc:1434] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.003s
I20260709 13:15:33.672078  6597 tablet_bootstrap.cc:654] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.672676  6555 raft_consensus.cc:3060] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.673494  6622 leader_election.cc:290] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:33.677073  6598 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.677723  6605 raft_consensus.cc:493] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.678380  6605 raft_consensus.cc:515] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.681773  6605 leader_election.cc:290] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.690837  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:33.689945  6555 raft_consensus.cc:2468] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
W20260709 13:15:33.692754  6372 leader_election.cc:343] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.695261  6371 leader_election.cc:304] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.696507  6601 raft_consensus.cc:493] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.696976  6601 raft_consensus.cc:515] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.699219  6601 leader_election.cc:290] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.699760  6601 raft_consensus.cc:2804] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.701581  6601 raft_consensus.cc:697] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:33.702503  6601 consensus_queue.cc:237] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.704259  6600 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.705581  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.706156  6482 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:33.706427  6555 raft_consensus.cc:2468] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.704999  6600 ts_tablet_manager.cc:1403] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.171s	user 0.071s	sys 0.071s
I20260709 13:15:33.707923  6556 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:33.708149  6371 leader_election.cc:304] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:33.692788  6598 tablet_bootstrap.cc:654] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.709694  6624 raft_consensus.cc:2804] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.710460  6624 raft_consensus.cc:493] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.710819  6624 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.711664  6600 raft_consensus.cc:359] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.712668  6600 raft_consensus.cc:385] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.713065  6600 raft_consensus.cc:740] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.714314  6600 consensus_queue.cc:260] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.716728  6372 leader_election.cc:304] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:33.717975  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:33.719224  6622 raft_consensus.cc:2804] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.721295  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.722056  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
W20260709 13:15:33.722810  6372 leader_election.cc:343] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.732259  6597 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.733220  6597 ts_tablet_manager.cc:1403] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.093s	user 0.026s	sys 0.011s
I20260709 13:15:33.732409  6598 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.724886  6624 raft_consensus.cc:515] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.738166  6598 ts_tablet_manager.cc:1403] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.009s
W20260709 13:15:33.733309  6520 leader_election.cc:343] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.749075  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:33.750425  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
W20260709 13:15:33.750705  6372 leader_election.cc:343] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.742604  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.743450  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.751494  6556 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.744653  6597 raft_consensus.cc:359] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.752583  6597 raft_consensus.cc:385] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.752909  6597 raft_consensus.cc:740] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.748446  6304 catalog_manager.cc:5697] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:33.753841  6521 leader_election.cc:343] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.754374  6521 leader_election.cc:304] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f; no voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5
W20260709 13:15:33.755712  6521 leader_election.cc:343] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.747995  6624 leader_election.cc:290] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.753819  6597 consensus_queue.cc:260] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.758594  6605 raft_consensus.cc:493] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.759519  6618 raft_consensus.cc:2749] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.744315  6600 ts_tablet_manager.cc:1434] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.007s
I20260709 13:15:33.759162  6605 raft_consensus.cc:515] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.756211  6521 leader_election.cc:304] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f; no voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.761222  6618 raft_consensus.cc:2749] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.762032  6605 leader_election.cc:290] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.763283  6598 raft_consensus.cc:359] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.764088  6598 raft_consensus.cc:385] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.764406  6598 raft_consensus.cc:740] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.765379  6598 consensus_queue.cc:260] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.768086  6598 ts_tablet_manager.cc:1434] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:15:33.768906  6600 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.769531  6598 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.776722  6600 tablet_bootstrap.cc:654] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.740325  6622 raft_consensus.cc:697] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:33.778160  6622 consensus_queue.cc:237] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.778892  6556 raft_consensus.cc:2468] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:33.770668  6597 ts_tablet_manager.cc:1434] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 13:15:33.783916  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:33.784067  6598 tablet_bootstrap.cc:654] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.801798  6597 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.802925  6371 leader_election.cc:304] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.800482  6406 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 0.
I20260709 13:15:33.784852  6624 raft_consensus.cc:493] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.783916  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.804073  6624 raft_consensus.cc:515] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.804414  6629 raft_consensus.cc:2804] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.804903  6555 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 0.
I20260709 13:15:33.805276  6629 raft_consensus.cc:697] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:33.805366  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:33.785879  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.806376  6629 consensus_queue.cc:237] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.807377  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.807602  6624 leader_election.cc:290] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
W20260709 13:15:33.808923  6372 leader_election.cc:343] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.809715  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.810472  6554 raft_consensus.cc:2468] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.810581  6446 leader_election.cc:304] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:33.811838  6371 leader_election.cc:304] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.812691  6622 raft_consensus.cc:2804] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.813163  6622 raft_consensus.cc:493] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.813700  6605 raft_consensus.cc:2804] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.813743  6622 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.814287  6605 raft_consensus.cc:493] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.814838  6605 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.818746  6598 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.819569  6598 ts_tablet_manager.cc:1403] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.005s
I20260709 13:15:33.823683  6598 raft_consensus.cc:359] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.824678  6598 raft_consensus.cc:385] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:33.813862  6446 leader_election.cc:343] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:33.831449  6446 leader_election.cc:343] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.832134  6446 leader_election.cc:304] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:33.834254  6605 raft_consensus.cc:515] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.835876  6622 raft_consensus.cc:515] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.839193  6605 leader_election.cc:290] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.839937  6600 tablet_bootstrap.cc:492] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.839879  6605 raft_consensus.cc:2749] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.840674  6600 ts_tablet_manager.cc:1403] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.019s
I20260709 13:15:33.840796  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:33.825049  6598 raft_consensus.cc:740] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.841928  6597 tablet_bootstrap.cc:654] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:33.843083  6372 leader_election.cc:343] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.845920  6622 leader_election.cc:290] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.846215  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:33.846971  6554 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.843449  6598 consensus_queue.cc:260] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.849388  6600 raft_consensus.cc:359] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.850327  6600 raft_consensus.cc:385] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.850668  6600 raft_consensus.cc:740] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.850982  6598 ts_tablet_manager.cc:1434] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:15:33.852339  6598 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.852342  6600 consensus_queue.cc:260] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.856514  6554 raft_consensus.cc:2468] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:33.857915  6371 leader_election.cc:304] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.859171  6622 raft_consensus.cc:2804] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.859390  6600 ts_tablet_manager.cc:1434] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:15:33.859750  6622 raft_consensus.cc:697] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:33.861753  6622 consensus_queue.cc:237] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.862232  6600 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.869969  6598 tablet_bootstrap.cc:654] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.871483  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:33.872135  6406 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.872611  6597 tablet_bootstrap.cc:492] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.873126  6597 ts_tablet_manager.cc:1403] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.008s
I20260709 13:15:33.876480  6597 raft_consensus.cc:359] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.877758  6605 raft_consensus.cc:493] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.878327  6605 raft_consensus.cc:515] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } }
I20260709 13:15:33.880390  6605 leader_election.cc:290] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.877265  6597 raft_consensus.cc:385] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.885076  6597 raft_consensus.cc:740] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.886360  6598 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.886142  6597 consensus_queue.cc:260] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.888101  6598 ts_tablet_manager.cc:1403] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.005s
I20260709 13:15:33.888809  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:33.889871  6597 ts_tablet_manager.cc:1434] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:33.891067  6597 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.891601  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e705997065b4701a6757a88838b96de" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.892505  6555 raft_consensus.cc:2393] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3e91a2c1fe40bbba1679f08f379eb5 in current term 1: Already voted for candidate 1846555dc6194afda53312d1bdfb3375 in this term.
I20260709 13:15:33.893137  6598 raft_consensus.cc:359] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.894302  6598 raft_consensus.cc:385] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.894740  6598 raft_consensus.cc:740] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.896075  6598 consensus_queue.cc:260] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.884594  6600 tablet_bootstrap.cc:654] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.883128  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:33.897792  6554 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.881248  6406 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 1.
I20260709 13:15:33.902160  6597 tablet_bootstrap.cc:654] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.903491  6446 leader_election.cc:304] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:33.905140  6639 raft_consensus.cc:3060] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.907222  6554 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 1.
I20260709 13:15:33.909655  6598 ts_tablet_manager.cc:1434] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:15:33.911115  6598 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:33.917510  6446 leader_election.cc:304] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:33.918700  6598 tablet_bootstrap.cc:654] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.920609  6605 raft_consensus.cc:2804] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.925547  6605 raft_consensus.cc:697] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:33.928218  6622 raft_consensus.cc:493] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.929585  6622 raft_consensus.cc:515] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.926844  6605 consensus_queue.cc:237] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.928519  6600 tablet_bootstrap.cc:492] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.934393  6600 ts_tablet_manager.cc:1403] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.019s
I20260709 13:15:33.935884  6305 catalog_manager.cc:5697] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.938301  6600 raft_consensus.cc:359] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.939489  6600 raft_consensus.cc:385] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.939996  6600 raft_consensus.cc:740] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.939713  6305 catalog_manager.cc:5697] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.944118  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:33.944410  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:33.945072  6554 raft_consensus.cc:2468] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:33.941457  6600 consensus_queue.cc:260] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.945842  6305 catalog_manager.cc:5697] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.943280  6622 leader_election.cc:290] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.935915  6639 raft_consensus.cc:2749] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:33.945905  6372 leader_election.cc:343] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.951843  6371 leader_election.cc:304] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.952175  6600 ts_tablet_manager.cc:1434] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:15:33.952997  6622 raft_consensus.cc:2804] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.953329  6598 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:33.953426  6622 raft_consensus.cc:493] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.954077  6622 raft_consensus.cc:3060] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.954188  6598 ts_tablet_manager.cc:1403] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.019s
I20260709 13:15:33.956228  6597 tablet_bootstrap.cc:492] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.956776  6597 ts_tablet_manager.cc:1403] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.008s
I20260709 13:15:33.957253  6598 raft_consensus.cc:359] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.958065  6598 raft_consensus.cc:385] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.958400  6598 raft_consensus.cc:740] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.959295  6598 consensus_queue.cc:260] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.959025  6304 catalog_manager.cc:5697] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.959755  6597 raft_consensus.cc:359] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.960500  6597 raft_consensus.cc:385] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.960858  6597 raft_consensus.cc:740] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.962391  6600 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:33.962159  6622 raft_consensus.cc:515] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.961783  6597 consensus_queue.cc:260] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.970057  6598 ts_tablet_manager.cc:1434] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:33.970228  6600 tablet_bootstrap.cc:654] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.970511  6597 ts_tablet_manager.cc:1434] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:33.971648  6597 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:33.977867  6622 leader_election.cc:290] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:33.978287  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:33.979290  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
W20260709 13:15:33.979885  6372 leader_election.cc:343] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.979940  6554 raft_consensus.cc:3060] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.985280  6597 tablet_bootstrap.cc:654] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.990176  6554 raft_consensus.cc:2468] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:33.992066  6600 tablet_bootstrap.cc:492] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:33.992692  6600 ts_tablet_manager.cc:1403] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.008s
I20260709 13:15:33.992585  6371 leader_election.cc:304] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:33.993932  6622 raft_consensus.cc:2804] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.994418  6622 raft_consensus.cc:697] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:33.995416  6597 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:33.995237  6622 consensus_queue.cc:237] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.995795  6597 ts_tablet_manager.cc:1403] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:15:33.995996  6600 raft_consensus.cc:359] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.996747  6600 raft_consensus.cc:385] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.997025  6600 raft_consensus.cc:740] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.997830  6600 consensus_queue.cc:260] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.998320  6597 raft_consensus.cc:359] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:33.999172  6597 raft_consensus.cc:385] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.999455  6597 raft_consensus.cc:740] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.000140  6597 consensus_queue.cc:260] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.000975  6600 ts_tablet_manager.cc:1434] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:34.002337  6597 ts_tablet_manager.cc:1434] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:34.002640  6600 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:34.011201  6600 tablet_bootstrap.cc:654] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.012923  6305 catalog_manager.cc:5697] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.015940  6600 tablet_bootstrap.cc:492] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:34.016441  6600 ts_tablet_manager.cc:1403] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:15:34.018913  6600 raft_consensus.cc:359] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.019445  6605 raft_consensus.cc:493] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.019981  6605 raft_consensus.cc:515] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.020473  6600 raft_consensus.cc:385] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.020849  6600 raft_consensus.cc:740] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.021679  6600 consensus_queue.cc:260] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.022039  6605 leader_election.cc:290] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.023877  6600 ts_tablet_manager.cc:1434] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:34.024479  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:34.024897  6600 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:34.025941  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:34.026717  6554 raft_consensus.cc:2393] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3e91a2c1fe40bbba1679f08f379eb5 in current term 1: Already voted for candidate 1846555dc6194afda53312d1bdfb3375 in this term.
I20260709 13:15:34.029069  6446 leader_election.cc:304] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:34.030011  6639 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.031663  6600 tablet_bootstrap.cc:654] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.036460  6600 tablet_bootstrap.cc:492] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:34.036916  6639 raft_consensus.cc:2749] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.036986  6600 ts_tablet_manager.cc:1403] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:15:34.040011  6600 raft_consensus.cc:359] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.040532  6600 raft_consensus.cc:385] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.040792  6600 raft_consensus.cc:740] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.041450  6600 consensus_queue.cc:260] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.042812  6600 ts_tablet_manager.cc:1434] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:15:34.082808  6639 raft_consensus.cc:493] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.083350  6639 raft_consensus.cc:515] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.085227  6639 leader_election.cc:290] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.086077  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:34.086320  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:34.086716  6406 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 0.
I20260709 13:15:34.087211  6554 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 0.
I20260709 13:15:34.087909  6446 leader_election.cc:304] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.088821  6639 raft_consensus.cc:2804] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.089119  6639 raft_consensus.cc:493] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.089433  6639 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.094429  6639 raft_consensus.cc:515] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.096024  6639 leader_election.cc:290] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.096946  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.097270  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.097625  6406 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.097865  6554 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.105213  6406 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 1.
I20260709 13:15:34.105213  6554 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 1.
I20260709 13:15:34.106637  6446 leader_election.cc:304] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.107457  6639 raft_consensus.cc:2804] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.107960  6639 raft_consensus.cc:697] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.108877  6639 consensus_queue.cc:237] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.116115  6303 catalog_manager.cc:5697] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.166613  6618 raft_consensus.cc:493] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.167214  6618 raft_consensus.cc:515] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.169178  6618 leader_election.cc:290] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:34.170256  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:34.170286  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:34.171252  6406 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
I20260709 13:15:34.171252  6481 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
I20260709 13:15:34.172616  6520 leader_election.cc:304] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:34.173321  6618 raft_consensus.cc:2804] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.173739  6618 raft_consensus.cc:493] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.174026  6618 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.179679  6618 raft_consensus.cc:515] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.181368  6618 leader_election.cc:290] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:34.181928  6618 raft_consensus.cc:493] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.182368  6618 raft_consensus.cc:515] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.182552  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:34.183323  6481 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.182426  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.184420  6406 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.184701  6618 leader_election.cc:290] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:34.186563  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:34.187287  6482 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
I20260709 13:15:34.188586  6521 leader_election.cc:304] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.188637  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:34.189433  6407 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
I20260709 13:15:34.189592  6618 raft_consensus.cc:2804] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.190057  6618 raft_consensus.cc:493] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.190552  6618 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.192219  6406 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:34.192301  6481 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:34.193514  6520 leader_election.cc:304] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:34.194505  6654 raft_consensus.cc:2804] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.195515  6654 raft_consensus.cc:697] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:34.196360  6654 consensus_queue.cc:237] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.197211  6618 raft_consensus.cc:515] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.199854  6618 leader_election.cc:290] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:34.199959  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.200683  6406 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.201035  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:34.201725  6481 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.206224  6303 catalog_manager.cc:5697] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 1 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.209160  6481 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:34.210345  6406 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:34.211202  6521 leader_election.cc:304] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.212373  6618 raft_consensus.cc:2804] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.212836  6618 raft_consensus.cc:697] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:34.213605  6618 consensus_queue.cc:237] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.222023  6303 catalog_manager.cc:5697] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 1 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.248163  6622 consensus_queue.cc:1048] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.261391  6622 consensus_queue.cc:1048] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.261878  6629 consensus_queue.cc:1048] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.279188  6481 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.289593  6622 consensus_queue.cc:1048] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.312912  6622 consensus_queue.cc:1048] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.324317  6629 consensus_queue.cc:1048] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.334990  6639 consensus_queue.cc:1048] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.346626  6605 consensus_queue.cc:1048] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.379487  6629 consensus_queue.cc:1048] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.390949  6622 consensus_queue.cc:1048] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.466099  6622 consensus_queue.cc:1048] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.467123  6481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
mode: GRACEFUL
new_leader_uuid: "1846555dc6194afda53312d1bdfb3375"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:15:34.467944  6481 raft_consensus.cc:606] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Received request to transfer leadership to TS 1846555dc6194afda53312d1bdfb3375
I20260709 13:15:34.474910  6605 raft_consensus.cc:493] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.475498  6605 raft_consensus.cc:515] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.477917  6605 leader_election.cc:290] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.479631  6481 raft_consensus.cc:3060] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.480566  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:34.482581  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466de93f2c444805802af09382fc9f86" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:34.484604  6446 leader_election.cc:304] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:34.486888  6406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:15:34.487635  6406 raft_consensus.cc:606] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:34.493780  6605 raft_consensus.cc:2749] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.494791  6406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:15:34.495484  6406 raft_consensus.cc:606] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:34.495568  6622 consensus_queue.cc:1048] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.515123  6555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:43514
I20260709 13:15:34.515825  6555 raft_consensus.cc:606] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:34.521492  6555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b89a783ea446da690b161ea9b3999"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:43514
I20260709 13:15:34.522030  6555 raft_consensus.cc:606] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:34.527415  6481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
mode: GRACEFUL
new_leader_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:15:34.527961  6481 raft_consensus.cc:606] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Received request to transfer leadership to TS 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:34.665774  6618 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.674458  6654 raft_consensus.cc:993] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.674989  6655 raft_consensus.cc:1081] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.678298  6481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217b89a783ea446da690b161ea9b3999"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38222
I20260709 13:15:34.679173  6481 raft_consensus.cc:493] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.679751  6481 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.682041  6654 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.687675  6481 raft_consensus.cc:515] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.691227  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.691560  6481 leader_election.cc:290] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.691941  6407 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.692257  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.692866  6555 raft_consensus.cc:3055] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.693203  6555 raft_consensus.cc:740] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:34.694337  6555 consensus_queue.cc:260] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.695269  6555 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.701581  6407 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.702056  6555 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.702946  6446 leader_election.cc:304] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.704048  6605 raft_consensus.cc:2804] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.704584  6605 raft_consensus.cc:697] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.705025  6644 consensus_queue.cc:1048] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.705618  6605 consensus_queue.cc:237] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.713583  6644 raft_consensus.cc:993] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: : Instructing follower 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:34.714524  6605 raft_consensus.cc:1081] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Signalling peer 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:34.718108  6305 catalog_manager.cc:5697] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.718827  6680 consensus_queue.cc:1048] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.719264  6554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:15:34.719883  6554 raft_consensus.cc:493] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.720367  6554 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.728293  6554 raft_consensus.cc:515] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.732157  6554 leader_election.cc:290] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:34.733485  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:34.734193  6482 raft_consensus.cc:3055] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.734534  6482 raft_consensus.cc:740] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.735343  6482 consensus_queue.cc:260] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.736040  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fc7db35e864e71a3ca5ac9d5ff4580" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.736720  6482 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.736733  6407 raft_consensus.cc:3060] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.743635  6482 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:34.745249  6521 leader_election.cc:304] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.744719  6407 raft_consensus.cc:2468] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:34.746135  6654 raft_consensus.cc:2804] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.746711  6654 raft_consensus.cc:697] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:34.747596  6654 consensus_queue.cc:237] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.757840  6304 catalog_manager.cc:5697] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 1 to 2, leader changed from ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130) to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 2 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.816133  6624 raft_consensus.cc:993] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.816699  6601 raft_consensus.cc:1081] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.818189  6482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38210
I20260709 13:15:34.818655  6482 raft_consensus.cc:493] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.818926  6482 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.823907  6482 raft_consensus.cc:515] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.825537  6482 leader_election.cc:290] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.826556  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.826797  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450d7b2e49734f5cb93930e2e4906e6a" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.827148  6407 raft_consensus.cc:3055] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.827421  6554 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.827512  6407 raft_consensus.cc:740] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:34.828301  6407 consensus_queue.cc:260] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.829263  6407 raft_consensus.cc:3060] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.833675  6554 raft_consensus.cc:2468] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.835129  6446 leader_election.cc:304] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.836351  6680 raft_consensus.cc:2804] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.836916  6680 raft_consensus.cc:697] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.837764  6680 consensus_queue.cc:237] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.840406  6618 consensus_queue.cc:1048] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.835806  6407 raft_consensus.cc:2468] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.841976  6655 consensus_queue.cc:1048] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.851058  6304 catalog_manager.cc:5697] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.857232  6622 raft_consensus.cc:993] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.858165  6622 raft_consensus.cc:1081] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.866279  6481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38210
I20260709 13:15:34.866976  6481 raft_consensus.cc:493] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.867401  6481 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.869457  6654 raft_consensus.cc:993] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.870239  6655 raft_consensus.cc:1081] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:34.872574  6480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38222
I20260709 13:15:34.873196  6480 raft_consensus.cc:493] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.873641  6480 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.880661  6481 raft_consensus.cc:515] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.883129  6481 leader_election.cc:290] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.884037  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.884442  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d144aacaed4ff590234c0e227341e8" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.884778  6407 raft_consensus.cc:3055] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.885046  6554 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.885162  6407 raft_consensus.cc:740] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:34.886113  6407 consensus_queue.cc:260] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.886406  6480 raft_consensus.cc:515] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.887416  6407 raft_consensus.cc:3060] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.887488  6482 raft_consensus.cc:1240] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Rejecting Update request from peer 5bd40b8e45db41a0b96771832c564a0f for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:34.893543  6554 raft_consensus.cc:2468] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.894670  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:34.895037  6446 leader_election.cc:304] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.895349  6406 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.895437  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87681389e8c4656ba8d06a85ecab72c" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.895964  6680 raft_consensus.cc:2804] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.896457  6680 raft_consensus.cc:697] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.897318  6680 consensus_queue.cc:237] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.895370  6407 raft_consensus.cc:2468] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.897537  6618 consensus_queue.cc:1059] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.899400  6480 leader_election.cc:290] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.901547  6555 raft_consensus.cc:3055] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.902024  6555 raft_consensus.cc:740] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:34.903122  6555 consensus_queue.cc:260] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.904021  6406 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:34.904443  6555 raft_consensus.cc:3060] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.905323  6446 leader_election.cc:304] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:34.906090  6680 raft_consensus.cc:2804] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.906530  6680 raft_consensus.cc:697] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.907336  6680 consensus_queue.cc:237] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.909991  6305 catalog_manager.cc:5697] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.911949  6555 raft_consensus.cc:2468] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
W20260709 13:15:34.912587  6654 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:34.920406  6644 raft_consensus.cc:993] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: : Instructing follower 1846555dc6194afda53312d1bdfb3375 to start an election
I20260709 13:15:34.921195  6680 raft_consensus.cc:1081] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Signalling peer 1846555dc6194afda53312d1bdfb3375 to start an election
I20260709 13:15:34.922914  6406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
 from {username='slave'} at 127.0.0.1:35838
I20260709 13:15:34.923465  6406 raft_consensus.cc:493] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:34.923822  6406 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.926757  6305 catalog_manager.cc:5697] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.929600  6406 raft_consensus.cc:515] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.931695  6406 leader_election.cc:290] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 2 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:34.932598  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:34.932982  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba9991a7eb646b28cbce1157472e0bc" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:34.933341  6480 raft_consensus.cc:3055] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.933929  6555 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.933900  6480 raft_consensus.cc:740] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:34.935137  6480 consensus_queue.cc:260] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.936580  6480 raft_consensus.cc:3060] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.942782  6555 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 2.
I20260709 13:15:34.944316  6371 leader_election.cc:304] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:34.944864  6480 raft_consensus.cc:2468] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 2.
I20260709 13:15:34.945298  6601 raft_consensus.cc:2804] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.945919  6601 raft_consensus.cc:697] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 2 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:34.946784  6601 consensus_queue.cc:237] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:34.953583  6305 catalog_manager.cc:5697] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 1 to 2, leader changed from ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130) to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.133689  6480 raft_consensus.cc:1275] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.135505  6654 consensus_queue.cc:1048] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.281231  6407 raft_consensus.cc:1275] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.283282  6685 consensus_queue.cc:1048] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:35.315984  6554 raft_consensus.cc:1275] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.322329  6680 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:35.333847  6406 raft_consensus.cc:1275] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.336297  6406 raft_consensus.cc:1275] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.338830  6605 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.341212  6605 consensus_queue.cc:1048] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.359611  6554 raft_consensus.cc:1275] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.362702  6680 consensus_queue.cc:1048] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.389940  6407 raft_consensus.cc:1275] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.391381  6680 consensus_queue.cc:1048] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.401051  6554 raft_consensus.cc:1275] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.402494  6680 consensus_queue.cc:1048] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.438477  6407 raft_consensus.cc:1275] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.439783  6680 consensus_queue.cc:1048] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.449952  6554 raft_consensus.cc:1275] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.451810  6680 consensus_queue.cc:1048] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:35.518672  6480 raft_consensus.cc:1275] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Refusing update from remote peer 1846555dc6194afda53312d1bdfb3375: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.520089  6601 consensus_queue.cc:1048] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.529138  6554 raft_consensus.cc:1275] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer 1846555dc6194afda53312d1bdfb3375: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.531214  6601 consensus_queue.cc:1048] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:36.182029  6428 debug-util.cc:398] Leaking SignalData structure 0x7b0800225380 after lost signal to thread 28925
W20260709 13:15:36.183175  6428 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbac0 after lost signal to thread 6339
W20260709 13:15:36.184286  6428 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9800 after lost signal to thread 6431
W20260709 13:15:36.185256  6428 debug-util.cc:398] Leaking SignalData structure 0x7b0800052660 after lost signal to thread 6506
W20260709 13:15:36.186239  6428 debug-util.cc:398] Leaking SignalData structure 0x7b08001b29e0 after lost signal to thread 6580
I20260709 13:15:37.718987  6305 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39832:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:37.722064  6305 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:37.789569  6396 tablet_service.cc:1511] Processing CreateTablet for tablet b37e2f9648eb4e28bce16512f520ee1a (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:37.791252  6396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e2f9648eb4e28bce16512f520ee1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.790899  6464 tablet_service.cc:1511] Processing CreateTablet for tablet b37e2f9648eb4e28bce16512f520ee1a (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:37.792476  6464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e2f9648eb4e28bce16512f520ee1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.796032  6546 tablet_service.cc:1511] Processing CreateTablet for tablet b37e2f9648eb4e28bce16512f520ee1a (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:37.797712  6546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e2f9648eb4e28bce16512f520ee1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.799300  6468 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed46f201ab40eb99f0eaae9f56b121 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:37.800808  6468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed46f201ab40eb99f0eaae9f56b121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.802677  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed46f201ab40eb99f0eaae9f56b121 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:37.804185  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed46f201ab40eb99f0eaae9f56b121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.806649  6544 tablet_service.cc:1511] Processing CreateTablet for tablet 85ed46f201ab40eb99f0eaae9f56b121 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:37.808236  6544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ed46f201ab40eb99f0eaae9f56b121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.809417  6397 tablet_service.cc:1511] Processing CreateTablet for tablet 21314894fdfc44de9d3e10fe163b7811 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:37.810967  6397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21314894fdfc44de9d3e10fe163b7811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.809471  6470 tablet_service.cc:1511] Processing CreateTablet for tablet 21314894fdfc44de9d3e10fe163b7811 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:37.815092  6470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21314894fdfc44de9d3e10fe163b7811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.819809  6472 tablet_service.cc:1511] Processing CreateTablet for tablet 440a5b907d1f40238a9a69157730840f (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:37.820160  6392 tablet_service.cc:1511] Processing CreateTablet for tablet 440a5b907d1f40238a9a69157730840f (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:37.821537  6472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a5b907d1f40238a9a69157730840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.823247  6539 tablet_service.cc:1511] Processing CreateTablet for tablet 21314894fdfc44de9d3e10fe163b7811 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:37.824834  6539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21314894fdfc44de9d3e10fe163b7811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.830470  6542 tablet_service.cc:1511] Processing CreateTablet for tablet 440a5b907d1f40238a9a69157730840f (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:37.832062  6542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a5b907d1f40238a9a69157730840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.832854  6395 tablet_service.cc:1511] Processing CreateTablet for tablet 95382540983c4c5b84be0da8d3e2dd54 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:37.834630  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95382540983c4c5b84be0da8d3e2dd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.839037  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440a5b907d1f40238a9a69157730840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.844513  6540 tablet_service.cc:1511] Processing CreateTablet for tablet 95382540983c4c5b84be0da8d3e2dd54 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:37.846133  6540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95382540983c4c5b84be0da8d3e2dd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.846741  6394 tablet_service.cc:1511] Processing CreateTablet for tablet 0656992332834ed5a881bced14f4d30b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:37.848331  6394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0656992332834ed5a881bced14f4d30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.838591  6467 tablet_service.cc:1511] Processing CreateTablet for tablet 95382540983c4c5b84be0da8d3e2dd54 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:37.850049  6467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95382540983c4c5b84be0da8d3e2dd54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.850383  6466 tablet_service.cc:1511] Processing CreateTablet for tablet 0656992332834ed5a881bced14f4d30b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:37.851784  6466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0656992332834ed5a881bced14f4d30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.854929  6393 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0ca7ef57384596b5f12d58b51d12f1 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:37.855309  6469 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0ca7ef57384596b5f12d58b51d12f1 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:37.856837  6469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0ca7ef57384596b5f12d58b51d12f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.858759  6541 tablet_service.cc:1511] Processing CreateTablet for tablet 0656992332834ed5a881bced14f4d30b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:37.861562  6541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0656992332834ed5a881bced14f4d30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.867579  6543 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0ca7ef57384596b5f12d58b51d12f1 (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:37.868650  6390 tablet_service.cc:1511] Processing CreateTablet for tablet 93f5c80a52f945d190c38174c87a9a4b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:37.869208  6543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0ca7ef57384596b5f12d58b51d12f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.871702  6465 tablet_service.cc:1511] Processing CreateTablet for tablet 93f5c80a52f945d190c38174c87a9a4b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:37.872712  6393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0ca7ef57384596b5f12d58b51d12f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.873333  6465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f5c80a52f945d190c38174c87a9a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.875700  6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f5c80a52f945d190c38174c87a9a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.879683  6389 tablet_service.cc:1511] Processing CreateTablet for tablet 16a77f9c29ec461d87731250272d3d5b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:37.881280  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a77f9c29ec461d87731250272d3d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.886525  6471 tablet_service.cc:1511] Processing CreateTablet for tablet 16a77f9c29ec461d87731250272d3d5b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:37.888126  6471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a77f9c29ec461d87731250272d3d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.889521  6545 tablet_service.cc:1511] Processing CreateTablet for tablet 93f5c80a52f945d190c38174c87a9a4b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:37.891209  6545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f5c80a52f945d190c38174c87a9a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.902145  6538 tablet_service.cc:1511] Processing CreateTablet for tablet 16a77f9c29ec461d87731250272d3d5b (DEFAULT_TABLE table=soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:37.905162  6538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a77f9c29ec461d87731250272d3d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.969767  6704 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:37.994081  6705 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.005686  6703 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.013752  6703 tablet_bootstrap.cc:654] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.025290  6704 tablet_bootstrap.cc:654] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.049048  6703 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.049863  6703 ts_tablet_manager.cc:1403] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 13:15:38.051641  6705 tablet_bootstrap.cc:654] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.053305  6703 raft_consensus.cc:359] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.054255  6703 raft_consensus.cc:385] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.054576  6703 raft_consensus.cc:740] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.055466  6704 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.055388  6703 consensus_queue.cc:260] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.056074  6704 ts_tablet_manager.cc:1403] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.013s
I20260709 13:15:38.058393  6703 ts_tablet_manager.cc:1434] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:15:38.059537  6703 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.066946  6703 tablet_bootstrap.cc:654] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.070225  6704 raft_consensus.cc:359] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.074972  6704 raft_consensus.cc:385] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.076038  6704 raft_consensus.cc:740] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.077699  6704 consensus_queue.cc:260] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.091558  6705 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.097159  6705 ts_tablet_manager.cc:1403] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.008s
I20260709 13:15:38.096239  6704 ts_tablet_manager.cc:1434] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:15:38.102612  6704 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.106089  6705 raft_consensus.cc:359] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.107429  6705 raft_consensus.cc:385] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.107910  6705 raft_consensus.cc:740] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.109063  6705 consensus_queue.cc:260] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.113070  6705 ts_tablet_manager.cc:1434] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:38.113688  6703 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.118086  6704 tablet_bootstrap.cc:654] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.118129  6703 ts_tablet_manager.cc:1403] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.035s
I20260709 13:15:38.121901  6703 raft_consensus.cc:359] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.123044  6703 raft_consensus.cc:385] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.114338  6705 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.123553  6703 raft_consensus.cc:740] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.124768  6703 consensus_queue.cc:260] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.128799  6703 ts_tablet_manager.cc:1434] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:15:38.130456  6703 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.140425  6704 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.141076  6704 ts_tablet_manager.cc:1403] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.019s
I20260709 13:15:38.143076  6705 tablet_bootstrap.cc:654] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.143939  6703 tablet_bootstrap.cc:654] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.144377  6704 raft_consensus.cc:359] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.145210  6704 raft_consensus.cc:385] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.145535  6704 raft_consensus.cc:740] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.146350  6704 consensus_queue.cc:260] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.149122  6704 ts_tablet_manager.cc:1434] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:15:38.163122  6704 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.170634  6705 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.170900  6704 tablet_bootstrap.cc:654] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.171284  6705 ts_tablet_manager.cc:1403] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.007s
I20260709 13:15:38.171551  6703 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.172138  6703 ts_tablet_manager.cc:1403] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.026s
I20260709 13:15:38.175391  6705 raft_consensus.cc:359] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.177597  6705 raft_consensus.cc:385] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.177985  6705 raft_consensus.cc:740] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.178588  6703 raft_consensus.cc:359] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.178934  6705 consensus_queue.cc:260] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.179446  6703 raft_consensus.cc:385] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.179839  6703 raft_consensus.cc:740] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.180639  6703 consensus_queue.cc:260] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.183354  6703 ts_tablet_manager.cc:1434] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:15:38.184494  6703 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.188748  6705 ts_tablet_manager.cc:1434] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 13:15:38.191596  6703 tablet_bootstrap.cc:654] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.192909  6705 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.203832  6703 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.204686  6703 ts_tablet_manager.cc:1403] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:15:38.206905  6705 tablet_bootstrap.cc:654] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.207782  6703 raft_consensus.cc:359] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.208627  6703 raft_consensus.cc:385] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.208931  6703 raft_consensus.cc:740] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.212755  6703 consensus_queue.cc:260] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.216252  6703 ts_tablet_manager.cc:1434] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:15:38.218802  6703 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.220144  6705 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.220746  6705 ts_tablet_manager.cc:1403] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 13:15:38.225314  6703 tablet_bootstrap.cc:654] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.226159  6705 raft_consensus.cc:359] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.226999  6705 raft_consensus.cc:385] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.227100  6704 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.227347  6705 raft_consensus.cc:740] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.227873  6704 ts_tablet_manager.cc:1403] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.009s
I20260709 13:15:38.228436  6705 consensus_queue.cc:260] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.231216  6704 raft_consensus.cc:359] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.231963  6704 raft_consensus.cc:385] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.232282  6704 raft_consensus.cc:740] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.232329  6705 ts_tablet_manager.cc:1434] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:15:38.233217  6704 consensus_queue.cc:260] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.233982  6705 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.243817  6704 ts_tablet_manager.cc:1434] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:15:38.245100  6704 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.245381  6705 tablet_bootstrap.cc:654] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.259274  6704 tablet_bootstrap.cc:654] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.260456  6705 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.261232  6705 ts_tablet_manager.cc:1403] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 13:15:38.260437  6703 tablet_bootstrap.cc:492] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.262084  6703 ts_tablet_manager.cc:1403] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.011s
I20260709 13:15:38.265340  6705 raft_consensus.cc:359] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.266418  6705 raft_consensus.cc:385] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.266779  6705 raft_consensus.cc:740] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.267467  6703 raft_consensus.cc:359] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.267881  6705 consensus_queue.cc:260] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.268882  6703 raft_consensus.cc:385] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.269380  6703 raft_consensus.cc:740] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.270326  6703 consensus_queue.cc:260] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.271386  6705 ts_tablet_manager.cc:1434] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:38.272926  6705 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.276073  6703 ts_tablet_manager.cc:1434] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:15:38.277289  6703 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.280875  6705 tablet_bootstrap.cc:654] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.289811  6703 tablet_bootstrap.cc:654] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.300899  6704 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.301532  6704 ts_tablet_manager.cc:1403] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.008s
I20260709 13:15:38.302261  6705 tablet_bootstrap.cc:492] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.302958  6705 ts_tablet_manager.cc:1403] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.016s
I20260709 13:15:38.303277  6703 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.303951  6703 ts_tablet_manager.cc:1403] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.011s
I20260709 13:15:38.305119  6704 raft_consensus.cc:359] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.306046  6704 raft_consensus.cc:385] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.306403  6704 raft_consensus.cc:740] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.306561  6705 raft_consensus.cc:359] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.307516  6705 raft_consensus.cc:385] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.307298  6704 consensus_queue.cc:260] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.307916  6705 raft_consensus.cc:740] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.307909  6703 raft_consensus.cc:359] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.309134  6703 raft_consensus.cc:385] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.309129  6705 consensus_queue.cc:260] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.309841  6703 raft_consensus.cc:740] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.310551  6704 ts_tablet_manager.cc:1434] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:38.311050  6703 consensus_queue.cc:260] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.311970  6705 ts_tablet_manager.cc:1434] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:15:38.313166  6705 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.318252  6703 ts_tablet_manager.cc:1434] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:38.319613  6703 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.320688  6705 tablet_bootstrap.cc:654] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.332935  6703 tablet_bootstrap.cc:654] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.335386  6708 raft_consensus.cc:493] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.311800  6704 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.336310  6708 raft_consensus.cc:515] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.344614  6708 leader_election.cc:290] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.345933  6708 raft_consensus.cc:493] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.346458  6708 raft_consensus.cc:515] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.348846  6705 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.349515  6705 ts_tablet_manager.cc:1403] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.011s
I20260709 13:15:38.349828  6708 leader_election.cc:290] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.350731  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e2f9648eb4e28bce16512f520ee1a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.351058  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.351531  6554 raft_consensus.cc:2468] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.351764  6482 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.353065  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e2f9648eb4e28bce16512f520ee1a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.353421  6372 leader_election.cc:304] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.353268  6705 raft_consensus.cc:359] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.353891  6480 raft_consensus.cc:2468] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.354344  6705 raft_consensus.cc:385] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.354753  6705 raft_consensus.cc:740] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.355368  6372 leader_election.cc:304] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.355727  6705 consensus_queue.cc:260] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.358590  6705 ts_tablet_manager.cc:1434] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:38.359753  6705 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.359822  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.361210  6692 raft_consensus.cc:2804] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.361563  6703 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.361727  6692 raft_consensus.cc:493] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.362264  6692 raft_consensus.cc:3060] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.360641  6554 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.368146  6705 tablet_bootstrap.cc:654] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.362275  6703 ts_tablet_manager.cc:1403] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.005s
I20260709 13:15:38.354560  6708 raft_consensus.cc:2804] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.370421  6708 raft_consensus.cc:493] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.370827  6708 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.373368  6703 raft_consensus.cc:359] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.374526  6703 raft_consensus.cc:385] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.374876  6703 raft_consensus.cc:740] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.376104  6703 consensus_queue.cc:260] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.382874  6692 raft_consensus.cc:515] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.386200  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e2f9648eb4e28bce16512f520ee1a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.386896  6480 raft_consensus.cc:3060] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.387805  6708 raft_consensus.cc:515] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.390123  6703 ts_tablet_manager.cc:1434] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:15:38.390554  6692 leader_election.cc:290] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.392716  6703 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.393975  6708 leader_election.cc:290] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.394964  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.397841  6482 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.399309  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.412873  6703 tablet_bootstrap.cc:654] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.413166  6555 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.414831  6704 tablet_bootstrap.cc:654] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.403549  6680 raft_consensus.cc:493] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.415606  6680 raft_consensus.cc:515] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.417876  6680 leader_election.cc:290] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.420450  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:38.420487  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.421360  6407 raft_consensus.cc:2468] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 0.
I20260709 13:15:38.403988  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e2f9648eb4e28bce16512f520ee1a" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.423054  6554 raft_consensus.cc:3060] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.408275  6482 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
W20260709 13:15:38.422927  6446 leader_election.cc:343] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.425153  6446 leader_election.cc:304] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:38.425486  6372 leader_election.cc:304] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.426996  6708 raft_consensus.cc:2804] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.427606  6708 raft_consensus.cc:697] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:38.429050  6708 consensus_queue.cc:237] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.433624  6680 raft_consensus.cc:2804] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.434178  6680 raft_consensus.cc:493] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.434655  6680 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.441473  6690 raft_consensus.cc:493] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.442354  6690 raft_consensus.cc:515] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.444841  6725 raft_consensus.cc:493] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.445422  6725 raft_consensus.cc:515] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.446925  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:38.447674  6725 leader_election.cc:290] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.449146  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.450066  6556 raft_consensus.cc:2468] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.451308  6407 raft_consensus.cc:2468] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
I20260709 13:15:38.454775  6520 leader_election.cc:304] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:38.458462  6725 raft_consensus.cc:493] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.458742  6371 leader_election.cc:304] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:38.459059  6725 raft_consensus.cc:515] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.460664  6554 raft_consensus.cc:2468] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.461354  6725 leader_election.cc:290] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.462852  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.464602  6481 raft_consensus.cc:2468] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.461899  6555 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.466048  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.466013  6372 leader_election.cc:304] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.463742  6705 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.467650  6705 ts_tablet_manager.cc:1403] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.108s	user 0.002s	sys 0.012s
I20260709 13:15:38.467691  6725 raft_consensus.cc:2804] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.468317  6725 raft_consensus.cc:493] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.468722  6725 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.463524  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.471185  6690 leader_election.cc:290] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:38.471958  6690 raft_consensus.cc:2804] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:38.472095  6372 leader_election.cc:343] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.472386  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.472445  6690 raft_consensus.cc:493] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.473423  6690 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:38.473708  6521 leader_election.cc:343] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.469103  6371 leader_election.cc:304] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:38.461354  6692 raft_consensus.cc:2804] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.475296  6692 raft_consensus.cc:493] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.475670  6692 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.481878  6680 raft_consensus.cc:515] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.485791  6680 leader_election.cc:290] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.485981  6725 raft_consensus.cc:515] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.488296  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:38.489285  6407 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.471019  6705 raft_consensus.cc:359] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.490890  6705 raft_consensus.cc:385] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.491312  6705 raft_consensus.cc:740] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.492086  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.492578  6705 consensus_queue.cc:260] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
W20260709 13:15:38.493577  6446 leader_election.cc:343] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.495187  6725 leader_election.cc:290] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.502718  6731 raft_consensus.cc:2804] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.503537  6731 raft_consensus.cc:697] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
W20260709 13:15:38.504303  6371 leader_election.cc:343] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.506703  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.495468  6705 ts_tablet_manager.cc:1434] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:15:38.508955  6705 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.512714  6407 raft_consensus.cc:2468] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 1.
I20260709 13:15:38.513211  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.513984  6482 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.504642  6731 consensus_queue.cc:237] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.515961  6705 tablet_bootstrap.cc:654] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.489121  6692 raft_consensus.cc:515] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.519133  6692 leader_election.cc:290] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.520366  6446 leader_election.cc:304] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:38.521507  6716 raft_consensus.cc:2804] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.522110  6716 raft_consensus.cc:697] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:38.522957  6716 consensus_queue.cc:237] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.526983  6482 raft_consensus.cc:2468] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.529472  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.531817  6705 tablet_bootstrap.cc:492] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.533866  6705 ts_tablet_manager.cc:1403] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
W20260709 13:15:38.534348  6372 leader_election.cc:343] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.536252  6372 leader_election.cc:304] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.466120  6480 raft_consensus.cc:2468] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.537415  6731 raft_consensus.cc:2804] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.537269  6705 raft_consensus.cc:359] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.538175  6731 raft_consensus.cc:697] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:38.538230  6705 raft_consensus.cc:385] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.538682  6705 raft_consensus.cc:740] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.539041  6731 consensus_queue.cc:237] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.539448  6705 consensus_queue.cc:260] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.542562  6705 ts_tablet_manager.cc:1434] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:38.543670  6705 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: Bootstrap starting.
I20260709 13:15:38.551280  6705 tablet_bootstrap.cc:654] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.559064  6703 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.559763  6703 ts_tablet_manager.cc:1403] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.167s	user 0.048s	sys 0.045s
I20260709 13:15:38.570148  6703 raft_consensus.cc:359] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.571026  6703 raft_consensus.cc:385] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.571360  6703 raft_consensus.cc:740] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.572161  6703 consensus_queue.cc:260] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.574792  6703 ts_tablet_manager.cc:1434] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:15:38.575997  6703 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: Bootstrap starting.
I20260709 13:15:38.576351  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.577301  6556 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.583858  6703 tablet_bootstrap.cc:654] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:38.587539  6371 leader_election.cc:343] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.591404  6704 tablet_bootstrap.cc:492] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.592288  6704 ts_tablet_manager.cc:1403] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.281s	user 0.016s	sys 0.007s
W20260709 13:15:38.593766  6353 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:38.594295  6304 catalog_manager.cc:5697] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 1 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.594758  6305 catalog_manager.cc:5697] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.593962  6690 raft_consensus.cc:515] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.597152  6705 tablet_bootstrap.cc:492] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: No bootstrap required, opened a new log
I20260709 13:15:38.602243  6705 ts_tablet_manager.cc:1403] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.008s
I20260709 13:15:38.604494  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:38.604813  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.605239  6407 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:38.606837  6521 leader_election.cc:343] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.605263  6705 raft_consensus.cc:359] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.607766  6705 raft_consensus.cc:385] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.608069  6705 raft_consensus.cc:740] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.608973  6705 consensus_queue.cc:260] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.609382  6690 leader_election.cc:290] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:38.612287  6705 ts_tablet_manager.cc:1434] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:38.608628  6704 raft_consensus.cc:359] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.613780  6704 raft_consensus.cc:385] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.614140  6704 raft_consensus.cc:740] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.615077  6556 raft_consensus.cc:2468] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.617843  6371 leader_election.cc:304] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.619194  6732 raft_consensus.cc:493] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.619695  6732 raft_consensus.cc:515] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.621333  6731 raft_consensus.cc:2804] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.614945  6704 consensus_queue.cc:260] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.622814  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a5b907d1f40238a9a69157730840f" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.623836  6480 raft_consensus.cc:2468] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.624291  6407 raft_consensus.cc:2468] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:38.625367  6372 leader_election.cc:304] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.625936  6731 raft_consensus.cc:697] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:38.626304  6708 raft_consensus.cc:2804] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.626672  6703 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: No bootstrap required, opened a new log
I20260709 13:15:38.626709  6708 raft_consensus.cc:493] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.627619  6703 ts_tablet_manager.cc:1403] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.004s
I20260709 13:15:38.626947  6731 consensus_queue.cc:237] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.628611  6732 leader_election.cc:290] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.627542  6708 raft_consensus.cc:3060] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.631695  6703 raft_consensus.cc:359] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.633487  6703 raft_consensus.cc:385] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.633010  6704 ts_tablet_manager.cc:1434] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:15:38.634954  6704 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.635829  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a5b907d1f40238a9a69157730840f" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.636699  6703 raft_consensus.cc:740] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.637063  6556 raft_consensus.cc:2468] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.644594  6703 consensus_queue.cc:260] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.647270  6703 ts_tablet_manager.cc:1434] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:38.625430  6520 leader_election.cc:304] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.649760  6690 raft_consensus.cc:2804] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.650365  6690 raft_consensus.cc:697] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:38.651221  6690 consensus_queue.cc:237] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.643311  6704 tablet_bootstrap.cc:654] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.657642  6708 raft_consensus.cc:515] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.664788  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a5b907d1f40238a9a69157730840f" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.667275  6556 raft_consensus.cc:3060] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.667846  6708 leader_election.cc:290] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.664788  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440a5b907d1f40238a9a69157730840f" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:38.668952  6480 raft_consensus.cc:3060] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.679076  6480 raft_consensus.cc:2468] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.680549  6372 leader_election.cc:304] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:38.681756  6732 raft_consensus.cc:493] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.682474  6732 raft_consensus.cc:515] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.685650  6732 leader_election.cc:290] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.686249  6732 raft_consensus.cc:2804] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.686312  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:38.686832  6732 raft_consensus.cc:697] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:38.687079  6554 raft_consensus.cc:2468] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 0.
I20260709 13:15:38.687810  6732 consensus_queue.cc:237] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.688810  6371 leader_election.cc:304] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:38.689841  6725 raft_consensus.cc:2804] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.690297  6725 raft_consensus.cc:493] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.690814  6725 raft_consensus.cc:3060] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.693913  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
W20260709 13:15:38.696168  6372 leader_election.cc:343] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.697430  6690 raft_consensus.cc:493] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.698493  6690 raft_consensus.cc:515] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.704573  6690 leader_election.cc:290] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:38.705987  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.706820  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:38.707554  6407 raft_consensus.cc:2468] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 0.
W20260709 13:15:38.707840  6521 leader_election.cc:343] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.703816  6725 raft_consensus.cc:515] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.708876  6520 leader_election.cc:304] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.710085  6690 raft_consensus.cc:2804] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.709873  6556 raft_consensus.cc:2468] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.710577  6690 raft_consensus.cc:493] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.711005  6690 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.711347  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
W20260709 13:15:38.713040  6372 leader_election.cc:343] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.714483  6725 leader_election.cc:290] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:38.716213  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:38.717209  6554 raft_consensus.cc:3060] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.680423  6303 catalog_manager.cc:5697] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 1 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.733331  6690 raft_consensus.cc:515] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.736943  6730 raft_consensus.cc:493] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.737907  6730 raft_consensus.cc:515] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.741426  6690 leader_election.cc:290] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:38.737800  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:38.742507  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:38.743129  6407 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.743652  6406 raft_consensus.cc:2393] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bd40b8e45db41a0b96771832c564a0f in current term 1: Already voted for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in this term.
I20260709 13:15:38.742630  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
W20260709 13:15:38.746033  6521 leader_election.cc:343] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.746868  6730 leader_election.cc:290] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:38.748102  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:38.749982  6521 leader_election.cc:304] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f; no voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.751322  6730 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.764580  6730 raft_consensus.cc:2749] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.768697  6554 raft_consensus.cc:2468] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 1.
I20260709 13:15:38.770372  6371 leader_election.cc:304] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.770916  6407 raft_consensus.cc:2468] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 1.
I20260709 13:15:38.771759  6732 raft_consensus.cc:2804] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.772477  6520 leader_election.cc:304] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:38.772877  6732 raft_consensus.cc:697] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:38.774196  6730 raft_consensus.cc:2804] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.774961  6730 raft_consensus.cc:697] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:38.781610  6730 consensus_queue.cc:237] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.779850  6704 tablet_bootstrap.cc:492] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.787482  6704 ts_tablet_manager.cc:1403] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.153s	user 0.036s	sys 0.033s
I20260709 13:15:38.773916  6732 consensus_queue.cc:237] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.794234  6704 raft_consensus.cc:359] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.796002  6704 raft_consensus.cc:385] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.796936  6704 raft_consensus.cc:740] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.798766  6704 consensus_queue.cc:260] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.803758  6704 ts_tablet_manager.cc:1434] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:38.810036  6704 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.825664  6704 tablet_bootstrap.cc:654] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.837431  6732 consensus_queue.cc:1048] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.838352  6305 catalog_manager.cc:5697] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 1 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.855541  6303 catalog_manager.cc:5697] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.857424  6303 catalog_manager.cc:5697] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.859338  6303 catalog_manager.cc:5697] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.861227  6303 catalog_manager.cc:5697] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.863116  6303 catalog_manager.cc:5697] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 1 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.869895  6704 tablet_bootstrap.cc:492] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.870934  6704 ts_tablet_manager.cc:1403] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.009s
I20260709 13:15:38.885030  6704 raft_consensus.cc:359] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.886044  6704 raft_consensus.cc:385] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.886451  6704 raft_consensus.cc:740] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.888679  6704 consensus_queue.cc:260] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.891812  6704 ts_tablet_manager.cc:1434] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:38.893193  6704 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.895421  6732 consensus_queue.cc:1048] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.901824  6704 tablet_bootstrap.cc:654] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.914811  6704 tablet_bootstrap.cc:492] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.915434  6704 ts_tablet_manager.cc:1403] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.002s
I20260709 13:15:38.918520  6704 raft_consensus.cc:359] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.919260  6704 raft_consensus.cc:385] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.919621  6704 raft_consensus.cc:740] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.920470  6704 consensus_queue.cc:260] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.922757  6704 ts_tablet_manager.cc:1434] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:38.923954  6704 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: Bootstrap starting.
I20260709 13:15:38.929236  6704 tablet_bootstrap.cc:654] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.935081  6704 tablet_bootstrap.cc:492] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: No bootstrap required, opened a new log
I20260709 13:15:38.935606  6704 ts_tablet_manager.cc:1403] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:15:38.938259  6704 raft_consensus.cc:359] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.939291  6704 raft_consensus.cc:385] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.939589  6704 raft_consensus.cc:740] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.940573  6704 consensus_queue.cc:260] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:38.942869  6704 ts_tablet_manager.cc:1434] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:38.961077  6732 consensus_queue.cc:1048] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.976903  6731 consensus_queue.cc:1048] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.989847  6716 consensus_queue.cc:1048] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.003212  6730 raft_consensus.cc:493] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.003782  6730 raft_consensus.cc:515] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.011515  6730 leader_election.cc:290] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:39.011581  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:39.017256  6554 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.020428  6680 consensus_queue.cc:1048] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.024116  6480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
mode: GRACEFUL
new_leader_uuid: "1846555dc6194afda53312d1bdfb3375"
 from {username='slave'} at 127.0.0.1:38234
I20260709 13:15:39.029793  6480 raft_consensus.cc:606] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Received request to transfer leadership to TS 1846555dc6194afda53312d1bdfb3375
I20260709 13:15:39.028118  6708 consensus_queue.cc:1048] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.031318  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" is_pre_election: true
I20260709 13:15:39.032235  6482 raft_consensus.cc:2393] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5bd40b8e45db41a0b96771832c564a0f in current term 1: Already voted for candidate 1846555dc6194afda53312d1bdfb3375 in this term.
I20260709 13:15:39.032866  6731 consensus_queue.cc:1048] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.033777  6521 leader_election.cc:304] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f; no voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:39.042042  6730 raft_consensus.cc:2749] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.052304  6716 raft_consensus.cc:493] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.053690  6716 raft_consensus.cc:515] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.054960  6407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:15:39.056479  6407 raft_consensus.cc:606] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:39.061173  6716 leader_election.cc:290] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.061527  6763 raft_consensus.cc:993] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: : Instructing follower 1846555dc6194afda53312d1bdfb3375 to start an election
I20260709 13:15:39.065212  6556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:39.066268  6556 raft_consensus.cc:2393] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3e91a2c1fe40bbba1679f08f379eb5 in current term 1: Already voted for candidate 1846555dc6194afda53312d1bdfb3375 in this term.
I20260709 13:15:39.070520  6680 raft_consensus.cc:493] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.071578  6680 raft_consensus.cc:515] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.073580  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21314894fdfc44de9d3e10fe163b7811" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:39.076424  6680 leader_election.cc:290] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.078254  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:39.079345  6406 raft_consensus.cc:2393] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3e91a2c1fe40bbba1679f08f379eb5 in current term 1: Already voted for candidate 5bd40b8e45db41a0b96771832c564a0f in this term.
I20260709 13:15:39.078094  6556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0656992332834ed5a881bced14f4d30b"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:43514
I20260709 13:15:39.073788  6763 raft_consensus.cc:1081] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Signalling peer 1846555dc6194afda53312d1bdfb3375 to start an election
I20260709 13:15:39.083806  6556 raft_consensus.cc:606] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:39.084821  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:39.088289  6446 leader_election.cc:304] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:39.089898  6763 raft_consensus.cc:3060] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.090991  6446 leader_election.cc:304] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:39.101938  6554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:43514
I20260709 13:15:39.102632  6554 raft_consensus.cc:606] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:39.105237  6763 raft_consensus.cc:2749] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.107875  6708 consensus_queue.cc:1048] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.109081  6716 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.109830  6406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
 from {username='slave'} at 127.0.0.1:35838
I20260709 13:15:39.110530  6406 raft_consensus.cc:493] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.110929  6406 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.115674  6407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:15:39.116451  6407 raft_consensus.cc:606] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS ff3e91a2c1fe40bbba1679f08f379eb5
I20260709 13:15:39.122431  6716 raft_consensus.cc:2749] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.121942  6763 raft_consensus.cc:493] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.125945  6763 raft_consensus.cc:515] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.128316  6763 leader_election.cc:290] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.134837  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1846555dc6194afda53312d1bdfb3375" is_pre_election: true
I20260709 13:15:39.134853  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bd40b8e45db41a0b96771832c564a0f" is_pre_election: true
I20260709 13:15:39.138248  6555 raft_consensus.cc:2393] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff3e91a2c1fe40bbba1679f08f379eb5 in current term 1: Already voted for candidate 1846555dc6194afda53312d1bdfb3375 in this term.
I20260709 13:15:39.137831  6406 raft_consensus.cc:515] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.142412  6407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:15:39.142721  6406 leader_election.cc:290] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 2 election: Requested vote from peers ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.140153  6446 leader_election.cc:304] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:39.146499  6763 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.143205  6407 raft_consensus.cc:606] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:39.146895  6692 consensus_queue.cc:1048] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.144881  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:39.148397  6554 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.154696  6763 raft_consensus.cc:2749] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.156147  6554 raft_consensus.cc:2468] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 2.
I20260709 13:15:39.156080  6482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ed46f201ab40eb99f0eaae9f56b121" candidate_uuid: "1846555dc6194afda53312d1bdfb3375" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:39.157012  6482 raft_consensus.cc:3055] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.157344  6482 raft_consensus.cc:740] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:39.158108  6482 consensus_queue.cc:260] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.159003  6482 raft_consensus.cc:3060] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.160069  6371 leader_election.cc:304] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:39.161587  6692 raft_consensus.cc:2804] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.162832  6730 consensus_queue.cc:1048] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.163200  6692 raft_consensus.cc:697] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 2 LEADER]: Becoming Leader. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:39.164364  6692 consensus_queue.cc:237] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.166469  6482 raft_consensus.cc:2468] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1846555dc6194afda53312d1bdfb3375 in term 2.
I20260709 13:15:39.167344  6731 consensus_queue.cc:1048] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:39.195793  6731 consensus_queue.cc:1048] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.196211  6708 consensus_queue.cc:1048] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.201639  6482 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.210368  6690 consensus_queue.cc:1048] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.226629  6302 catalog_manager.cc:5697] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 reported cstate change: term changed from 1 to 2, leader changed from ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130) to 1846555dc6194afda53312d1bdfb3375 (127.28.62.129). New cstate: current_term: 2 leader_uuid: "1846555dc6194afda53312d1bdfb3375" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.229811  6690 raft_consensus.cc:993] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.230707  6690 raft_consensus.cc:1081] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.233207  6479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38222
I20260709 13:15:39.233954  6479 raft_consensus.cc:493] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.234541  6479 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.252728  6479 raft_consensus.cc:515] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.253988  6690 consensus_queue.cc:1048] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.256197  6479 leader_election.cc:290] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.257587  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:39.258350  6406 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.267089  6731 consensus_queue.cc:1048] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.275067  6708 raft_consensus.cc:993] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.275583  6708 raft_consensus.cc:1081] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.277209  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0ca7ef57384596b5f12d58b51d12f1" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:39.278131  6554 raft_consensus.cc:3055] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.281773  6482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38210
I20260709 13:15:39.286319  6482 raft_consensus.cc:493] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.286732  6482 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.293772  6554 raft_consensus.cc:740] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:39.294920  6554 consensus_queue.cc:260] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.296321  6554 raft_consensus.cc:3060] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.305749  6554 raft_consensus.cc:2468] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.316512  6690 consensus_queue.cc:1048] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.317607  6406 raft_consensus.cc:2468] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.319355  6446 leader_election.cc:304] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:39.320374  6763 raft_consensus.cc:2804] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.320860  6763 raft_consensus.cc:697] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:39.321756  6763 consensus_queue.cc:237] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.330168  6482 raft_consensus.cc:515] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.332535  6482 leader_election.cc:290] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.333963  6407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:39.334848  6407 raft_consensus.cc:3055] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.335261  6407 raft_consensus.cc:740] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:39.334146  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f5c80a52f945d190c38174c87a9a4b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:39.336221  6554 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.341732  6407 consensus_queue.cc:260] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.344686  6407 raft_consensus.cc:3060] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.344728  6730 raft_consensus.cc:993] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.349316  6690 raft_consensus.cc:1081] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.351462  6480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0656992332834ed5a881bced14f4d30b"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38222
I20260709 13:15:39.352288  6480 raft_consensus.cc:493] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.352828  6480 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.357102  6692 raft_consensus.cc:993] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: : Instructing follower ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.357766  6692 raft_consensus.cc:1081] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer ff3e91a2c1fe40bbba1679f08f379eb5 to start an election
I20260709 13:15:39.359869  6479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
 from {username='slave'} at 127.0.0.1:38210
I20260709 13:15:39.359123  6302 catalog_manager.cc:5697] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.360656  6479 raft_consensus.cc:493] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.361335  6479 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.362613  6480 raft_consensus.cc:515] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.365285  6480 leader_election.cc:290] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.366623  6555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:39.348438  6554 raft_consensus.cc:2468] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.367359  6555 raft_consensus.cc:3055] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.367767  6555 raft_consensus.cc:740] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:39.368017  6405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0656992332834ed5a881bced14f4d30b" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:39.368685  6405 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.368746  6555 consensus_queue.cc:260] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.371332  6555 raft_consensus.cc:3060] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.374115  6446 leader_election.cc:304] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:39.375424  6763 raft_consensus.cc:2804] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.375932  6763 raft_consensus.cc:697] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:39.376307  6407 raft_consensus.cc:2468] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.376792  6763 consensus_queue.cc:237] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.391744  6479 raft_consensus.cc:515] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.395143  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:39.395983  6406 raft_consensus.cc:3055] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.396329  6406 raft_consensus.cc:740] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:39.397058  6406 consensus_queue.cc:260] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.398145  6406 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.399827  6479 leader_election.cc:290] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131:33963)
I20260709 13:15:39.400956  6405 raft_consensus.cc:2468] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.401202  6554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95382540983c4c5b84be0da8d3e2dd54" candidate_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
I20260709 13:15:39.401823  6554 raft_consensus.cc:3060] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.402477  6555 raft_consensus.cc:2468] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.404122  6446 leader_election.cc:304] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:39.404932  6763 raft_consensus.cc:2804] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.405422  6763 raft_consensus.cc:697] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:39.406255  6763 consensus_queue.cc:237] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.408783  6303 catalog_manager.cc:5697] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.412338  6554 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.413587  6446 leader_election.cc:304] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:39.414400  6716 raft_consensus.cc:2804] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.414911  6716 raft_consensus.cc:697] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Leader. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:39.415846  6716 consensus_queue.cc:237] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.416491  6406 raft_consensus.cc:2468] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff3e91a2c1fe40bbba1679f08f379eb5 in term 2.
I20260709 13:15:39.432767  6302 catalog_manager.cc:5697] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.434537  6302 catalog_manager.cc:5697] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130). New cstate: current_term: 2 leader_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.622210  6480 raft_consensus.cc:1275] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Refusing update from remote peer 1846555dc6194afda53312d1bdfb3375: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.623795  6692 consensus_queue.cc:1048] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.632167  6554 raft_consensus.cc:1275] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer 1846555dc6194afda53312d1bdfb3375: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.634773  6692 consensus_queue.cc:1048] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:39.693962  6725 raft_consensus.cc:993] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: : Instructing follower 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:39.694573  6708 raft_consensus.cc:1081] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:39.697054  6555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:43500
I20260709 13:15:39.697811  6555 raft_consensus.cc:493] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:39.698241  6555 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.707031  6555 raft_consensus.cc:515] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.710245  6406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:39.710275  6555 leader_election.cc:290] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:39.710455  6480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a77f9c29ec461d87731250272d3d5b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:39.711089  6406 raft_consensus.cc:3055] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.711302  6480 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.711530  6406 raft_consensus.cc:740] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:39.712481  6406 consensus_queue.cc:260] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.713889  6406 raft_consensus.cc:3060] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.717278  6480 raft_consensus.cc:2468] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:39.718758  6521 leader_election.cc:304] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bd40b8e45db41a0b96771832c564a0f, ff3e91a2c1fe40bbba1679f08f379eb5; no voters: 
I20260709 13:15:39.719997  6777 raft_consensus.cc:2804] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.720664  6777 raft_consensus.cc:697] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:39.721649  6777 consensus_queue.cc:237] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:39.726107  6406 raft_consensus.cc:2468] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:39.730970  6303 catalog_manager.cc:5697] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 2 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.754558  6555 raft_consensus.cc:1275] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.756179  6763 consensus_queue.cc:1048] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.766333  6406 raft_consensus.cc:1275] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.767889  6716 consensus_queue.cc:1048] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.794771  6555 raft_consensus.cc:1275] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.796085  6716 consensus_queue.cc:1048] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.804350  6406 raft_consensus.cc:1275] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.807184  6554 raft_consensus.cc:1275] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.808525  6716 consensus_queue.cc:1048] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.810950  6406 raft_consensus.cc:1275] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.811847  6716 consensus_queue.cc:1048] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.815974  6716 consensus_queue.cc:1048] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.847741  6554 raft_consensus.cc:1275] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.847915  6405 raft_consensus.cc:1275] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer ff3e91a2c1fe40bbba1679f08f379eb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.857349  6766 consensus_queue.cc:1048] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.860756  6763 consensus_queue.cc:1048] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.307394  6480 raft_consensus.cc:1275] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.308693  6777 consensus_queue.cc:1048] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.322300  6405 raft_consensus.cc:1275] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.324097  6782 consensus_queue.cc:1048] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:42.150835  6304 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39832:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:42.173216  6304 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39832:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:42.285676 28922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:42.355052  6372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:43193, user_credentials={real_user=slave}} blocked reactor thread for 102517us
W20260709 13:15:42.356763  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:33963, user_credentials={real_user=slave}} blocked reactor thread for 60643.8us
W20260709 13:15:42.466881  6371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:33963, user_credentials={real_user=slave}} blocked reactor thread for 56701us
W20260709 13:15:42.510421  6806 log.cc:927] Time spent T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:15:42.533295  6824 log.cc:927] Time spent T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:15:42.586396  6372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.130:43193, user_credentials={real_user=slave}} blocked reactor thread for 133933us
W20260709 13:15:42.618616  6446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.129:33549, user_credentials={real_user=slave}} blocked reactor thread for 91254.2us
I20260709 13:15:42.661024  6849 tablet.cc:1724] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.630681  6836 tablet.cc:1724] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.618000  6845 tablet.cc:1724] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.663812  6850 tablet.cc:1724] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.699529  6854 tablet.cc:1724] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.660017  6848 tablet.cc:1724] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.707422  6480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b89a783ea446da690b161ea9b3999"
dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
mode: GRACEFUL
new_leader_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:37504
I20260709 13:15:42.708115  6480 raft_consensus.cc:606] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Received request to transfer leadership to TS 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:42.660957  6851 tablet.cc:1724] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.743122  6854 tablet.cc:1724] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.746495  6856 tablet.cc:1724] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.746245  6855 tablet.cc:1724] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:42.759836  6446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:33963, user_credentials={real_user=slave}} blocked reactor thread for 120150us
I20260709 13:15:42.763856  6844 raft_consensus.cc:993] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: : Instructing follower 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:42.764545  6840 raft_consensus.cc:1081] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Signalling peer 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:42.736753  6853 tablet.cc:1724] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.772298  6848 tablet.cc:1724] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.800005  6860 tablet.cc:1724] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.790127  6404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b"
dest_uuid: "1846555dc6194afda53312d1bdfb3375"
mode: GRACEFUL
new_leader_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:41840
I20260709 13:15:42.802402  6404 raft_consensus.cc:606] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Received request to transfer leadership to TS 5bd40b8e45db41a0b96771832c564a0f
I20260709 13:15:42.803969  6554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217b89a783ea446da690b161ea9b3999"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:43506
I20260709 13:15:42.804657  6554 raft_consensus.cc:493] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:42.805050  6554 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.805462  6836 tablet.cc:1724] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.808946 28922 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:42.811834 28922 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:42.810321  6856 tablet.cc:1724] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.812444  6851 tablet.cc:1724] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.815058  6849 tablet.cc:1724] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.781169  6854 tablet.cc:1724] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.762946  6857 tablet.cc:1724] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.822732  6848 tablet.cc:1724] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.841758  6554 raft_consensus.cc:515] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.843535  6692 raft_consensus.cc:993] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: : Instructing follower 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:42.842833  6856 tablet.cc:1724] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.844023  6692 raft_consensus.cc:1081] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Signalling peer 5bd40b8e45db41a0b96771832c564a0f to start an election
I20260709 13:15:42.844985  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:42.845216  6554 leader_election.cc:290] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 3 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:42.845664  6404 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.846316  6548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b"
dest_uuid: "5bd40b8e45db41a0b96771832c564a0f"
 from {username='slave'} at 127.0.0.1:43500
I20260709 13:15:42.847168  6548 raft_consensus.cc:493] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:42.847710  6548 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.849810  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b89a783ea446da690b161ea9b3999" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:42.850411  6481 raft_consensus.cc:3055] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:42.850721  6481 raft_consensus.cc:740] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff3e91a2c1fe40bbba1679f08f379eb5, State: Running, Role: LEADER
I20260709 13:15:42.855999  6481 consensus_queue.cc:260] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.857225  6481 raft_consensus.cc:3060] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:42.870128  6446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.62.131:33963, user_credentials={real_user=slave}} blocked reactor thread for 44468.5us
I20260709 13:15:42.875406  6850 tablet.cc:1724] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.862790  6854 tablet.cc:1724] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.870903  6845 tablet.cc:1724] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.886427  6404 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 3.
I20260709 13:15:42.888990  6520 leader_election.cc:304] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:42.890028  6828 raft_consensus.cc:2804] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.890529  6828 raft_consensus.cc:697] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 3 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:42.891321  6828 consensus_queue.cc:237] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.892594  6855 tablet.cc:1724] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.895087  6853 tablet.cc:1724] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.905356  6851 tablet.cc:1724] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:42.909662  6481 raft_consensus.cc:2468] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 3.
I20260709 13:15:42.929016  6302 catalog_manager.cc:5697] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 2 to 3, leader changed from ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130) to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 3 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.900990  6548 raft_consensus.cc:515] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.938856  6404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1846555dc6194afda53312d1bdfb3375"
I20260709 13:15:42.939564  6404 raft_consensus.cc:3055] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:42.939924  6404 raft_consensus.cc:740] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1846555dc6194afda53312d1bdfb3375, State: Running, Role: LEADER
I20260709 13:15:42.940876  6404 consensus_queue.cc:260] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.942409  6404 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.945112  6548 leader_election.cc:290] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Requested vote from peers 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549), ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193)
I20260709 13:15:42.946323  6481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2b3963bf784fab998b9225c3dd7f1b" candidate_uuid: "5bd40b8e45db41a0b96771832c564a0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5"
I20260709 13:15:42.946934  6481 raft_consensus.cc:3060] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.952606  6404 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:42.954088  6520 leader_election.cc:304] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1846555dc6194afda53312d1bdfb3375, 5bd40b8e45db41a0b96771832c564a0f; no voters: 
I20260709 13:15:42.955025  6828 raft_consensus.cc:2804] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:42.955571  6828 raft_consensus.cc:697] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Becoming Leader. State: Replica: 5bd40b8e45db41a0b96771832c564a0f, State: Running, Role: LEADER
I20260709 13:15:42.956054  6481 raft_consensus.cc:2468] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bd40b8e45db41a0b96771832c564a0f in term 2.
I20260709 13:15:42.956461  6828 consensus_queue.cc:237] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } }
I20260709 13:15:42.962950  6303 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: soft_deleted_table [id=3b73b9ace5384b86b0d8383085b30f8c] alter complete (version 1)
I20260709 13:15:42.970628  6304 catalog_manager.cc:5697] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f reported cstate change: term changed from 1 to 2, leader changed from 1846555dc6194afda53312d1bdfb3375 (127.28.62.129) to 5bd40b8e45db41a0b96771832c564a0f (127.28.62.131). New cstate: current_term: 2 leader_uuid: "5bd40b8e45db41a0b96771832c564a0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bd40b8e45db41a0b96771832c564a0f" member_type: VOTER last_known_addr { host: "127.28.62.131" port: 33963 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.482472  6481 raft_consensus.cc:1275] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.484395  6828 consensus_queue.cc:1048] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:43.500399  6478 raft_consensus.cc:1275] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 3 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:43.502399  6406 raft_consensus.cc:1275] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.502575  6828 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff3e91a2c1fe40bbba1679f08f379eb5" member_type: VOTER last_known_addr { host: "127.28.62.130" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.505424  6828 consensus_queue.cc:1048] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:43.520113  6404 raft_consensus.cc:1275] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 3 FOLLOWER]: Refusing update from remote peer 5bd40b8e45db41a0b96771832c564a0f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:43.530305  6872 consensus_queue.cc:1048] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1846555dc6194afda53312d1bdfb3375" member_type: VOTER last_known_addr { host: "127.28.62.129" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:43.875284 28922 tablet_server.cc:179] TabletServer@127.28.62.129:0 shutting down...
I20260709 13:15:43.920017 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:43.921065 28922 tablet_replica.cc:333] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.922367 28922 raft_consensus.cc:2243] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:43.923381 28922 raft_consensus.cc:2272] T 440a5b907d1f40238a9a69157730840f P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.926877 28922 tablet_replica.cc:333] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.927572 28922 raft_consensus.cc:2243] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:43.928608 28922 raft_consensus.cc:2272] T 85ed46f201ab40eb99f0eaae9f56b121 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.931654 28922 tablet_replica.cc:333] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.932375 28922 raft_consensus.cc:2243] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:43.933328 28922 raft_consensus.cc:2272] T 21314894fdfc44de9d3e10fe163b7811 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.936210 28922 tablet_replica.cc:333] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.936929 28922 raft_consensus.cc:2243] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.937779 28922 raft_consensus.cc:2272] T 95382540983c4c5b84be0da8d3e2dd54 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.940543 28922 tablet_replica.cc:333] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.941241 28922 raft_consensus.cc:2243] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.941840 28922 raft_consensus.cc:2272] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.944518 28922 tablet_replica.cc:333] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.945484 28922 raft_consensus.cc:2243] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.946067 28922 raft_consensus.cc:2272] T b87681389e8c4656ba8d06a85ecab72c P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.949267 28922 tablet_replica.cc:333] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.950098 28922 raft_consensus.cc:2243] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:43.950090  6446 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:15:43.951809 28922 raft_consensus.cc:2272] T 466de93f2c444805802af09382fc9f86 P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:43.954368  6446 consensus_peers.cc:597] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:43.955133 28922 tablet_replica.cc:333] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.955893 28922 raft_consensus.cc:2243] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.956424 28922 raft_consensus.cc:2272] T 217b89a783ea446da690b161ea9b3999 P 1846555dc6194afda53312d1bdfb3375 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.959759 28922 tablet_replica.cc:333] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.960390 28922 raft_consensus.cc:2243] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.960955 28922 raft_consensus.cc:2272] T 450d7b2e49734f5cb93930e2e4906e6a P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.966126 28922 tablet_replica.cc:333] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.967268 28922 raft_consensus.cc:2243] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:43.967836  6520 consensus_peers.cc:597] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:43.968523 28922 raft_consensus.cc:2272] T b37e2f9648eb4e28bce16512f520ee1a P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.971176 28922 tablet_replica.cc:333] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.971779 28922 raft_consensus.cc:2243] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:43.972820 28922 raft_consensus.cc:2272] T bba9991a7eb646b28cbce1157472e0bc P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.975329 28922 tablet_replica.cc:333] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.975950 28922 raft_consensus.cc:2243] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.976509 28922 raft_consensus.cc:2272] T 93f5c80a52f945d190c38174c87a9a4b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.979534 28922 tablet_replica.cc:333] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.980176 28922 raft_consensus.cc:2243] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.980736 28922 raft_consensus.cc:2272] T 16a77f9c29ec461d87731250272d3d5b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.983299 28922 tablet_replica.cc:333] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.983886 28922 raft_consensus.cc:2243] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.984448 28922 raft_consensus.cc:2272] T 7a0ca7ef57384596b5f12d58b51d12f1 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.986996 28922 tablet_replica.cc:333] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.987579 28922 raft_consensus.cc:2243] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.988031 28922 raft_consensus.cc:2272] T cb2b3963bf784fab998b9225c3dd7f1b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.990988 28922 tablet_replica.cc:333] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.991683 28922 raft_consensus.cc:2243] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:43.992635 28922 raft_consensus.cc:2272] T 5e705997065b4701a6757a88838b96de P 1846555dc6194afda53312d1bdfb3375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.995340 28922 tablet_replica.cc:333] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:43.995888 28922 raft_consensus.cc:2243] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:43.996685 28922 raft_consensus.cc:2272] T 0656992332834ed5a881bced14f4d30b P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:43.999791 28922 tablet_replica.cc:333] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375: stopping tablet replica
I20260709 13:15:44.000559 28922 raft_consensus.cc:2243] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:44.000643  6446 consensus_peers.cc:597] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.001160 28922 raft_consensus.cc:2272] T 36d144aacaed4ff590234c0e227341e8 P 1846555dc6194afda53312d1bdfb3375 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:44.023602  6446 consensus_peers.cc:597] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:44.038102  6520 consensus_peers.cc:597] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:44.071399  6520 consensus_peers.cc:597] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:33549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.074432 28922 tablet_server.cc:196] TabletServer@127.28.62.129:0 shutdown complete.
W20260709 13:15:44.085321  6446 consensus_peers.cc:597] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:33549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.123222 28922 tablet_server.cc:179] TabletServer@127.28.62.130:0 shutting down...
I20260709 13:15:44.157969 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:44.158974 28922 tablet_replica.cc:333] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.159981 28922 raft_consensus.cc:2243] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.160650 28922 raft_consensus.cc:2272] T 21314894fdfc44de9d3e10fe163b7811 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:44.162987  6446 consensus_peers.cc:597] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:33549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.163921 28922 tablet_replica.cc:333] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.164565 28922 raft_consensus.cc:2243] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.165086 28922 raft_consensus.cc:2272] T b37e2f9648eb4e28bce16512f520ee1a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.167315 28922 tablet_replica.cc:333] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.167929 28922 raft_consensus.cc:2243] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.168730 28922 raft_consensus.cc:2272] T 93f5c80a52f945d190c38174c87a9a4b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.170971 28922 tablet_replica.cc:333] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.171499 28922 raft_consensus.cc:2243] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.171957 28922 raft_consensus.cc:2272] T 16a77f9c29ec461d87731250272d3d5b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.174445 28922 tablet_replica.cc:333] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.174947 28922 raft_consensus.cc:2243] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.175400 28922 raft_consensus.cc:2272] T 20fc7db35e864e71a3ca5ac9d5ff4580 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.177678 28922 tablet_replica.cc:333] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.178167 28922 raft_consensus.cc:2243] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.178933 28922 raft_consensus.cc:2272] T 95382540983c4c5b84be0da8d3e2dd54 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.181072 28922 tablet_replica.cc:333] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.181649 28922 raft_consensus.cc:2243] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.182442 28922 raft_consensus.cc:2272] T 0656992332834ed5a881bced14f4d30b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.184875 28922 tablet_replica.cc:333] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.185469 28922 raft_consensus.cc:2243] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.186384 28922 raft_consensus.cc:2272] T 36d144aacaed4ff590234c0e227341e8 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.188580 28922 tablet_replica.cc:333] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.189111 28922 raft_consensus.cc:2243] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.189592 28922 raft_consensus.cc:2272] T 217b89a783ea446da690b161ea9b3999 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.192977 28922 tablet_replica.cc:333] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.193691 28922 raft_consensus.cc:2243] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.194199 28922 raft_consensus.cc:2272] T 466de93f2c444805802af09382fc9f86 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.196408 28922 tablet_replica.cc:333] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.196990 28922 raft_consensus.cc:2243] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.197567 28922 raft_consensus.cc:2272] T 440a5b907d1f40238a9a69157730840f P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.199910 28922 tablet_replica.cc:333] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.200407 28922 raft_consensus.cc:2243] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.200886 28922 raft_consensus.cc:2272] T 85ed46f201ab40eb99f0eaae9f56b121 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.203099 28922 tablet_replica.cc:333] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.203572 28922 raft_consensus.cc:2243] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.204406 28922 raft_consensus.cc:2272] T 450d7b2e49734f5cb93930e2e4906e6a P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.206506 28922 tablet_replica.cc:333] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.206974 28922 raft_consensus.cc:2243] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.207372 28922 raft_consensus.cc:2272] T 5e705997065b4701a6757a88838b96de P ff3e91a2c1fe40bbba1679f08f379eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.209667 28922 tablet_replica.cc:333] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.210281 28922 raft_consensus.cc:2243] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.211266 28922 raft_consensus.cc:2272] T 7a0ca7ef57384596b5f12d58b51d12f1 P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.214570 28922 tablet_replica.cc:333] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.215267 28922 raft_consensus.cc:2243] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.215874 28922 raft_consensus.cc:2272] T cb2b3963bf784fab998b9225c3dd7f1b P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.218719 28922 tablet_replica.cc:333] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.219492 28922 raft_consensus.cc:2243] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.220372 28922 raft_consensus.cc:2272] T b87681389e8c4656ba8d06a85ecab72c P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.222541 28922 tablet_replica.cc:333] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5: stopping tablet replica
I20260709 13:15:44.223066 28922 raft_consensus.cc:2243] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.223613 28922 raft_consensus.cc:2272] T bba9991a7eb646b28cbce1157472e0bc P ff3e91a2c1fe40bbba1679f08f379eb5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:44.230882  6520 consensus_peers.cc:597] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f -> Peer 1846555dc6194afda53312d1bdfb3375 (127.28.62.129:33549): Couldn't send request to peer 1846555dc6194afda53312d1bdfb3375. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.129:33549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.270025 28922 tablet_server.cc:196] TabletServer@127.28.62.130:0 shutdown complete.
I20260709 13:15:44.309973 28922 tablet_server.cc:179] TabletServer@127.28.62.131:0 shutting down...
I20260709 13:15:44.339902 28922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:44.340755 28922 tablet_replica.cc:333] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.342024 28922 raft_consensus.cc:2243] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.342921 28922 raft_consensus.cc:2272] T 85ed46f201ab40eb99f0eaae9f56b121 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.345629 28922 tablet_replica.cc:333] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.346262 28922 raft_consensus.cc:2243] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.346788 28922 raft_consensus.cc:2272] T 440a5b907d1f40238a9a69157730840f P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.349579 28922 tablet_replica.cc:333] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.350193 28922 raft_consensus.cc:2243] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.350677 28922 raft_consensus.cc:2272] T b37e2f9648eb4e28bce16512f520ee1a P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.352938 28922 tablet_replica.cc:333] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.353682 28922 raft_consensus.cc:2243] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.354527 28922 raft_consensus.cc:2272] T 16a77f9c29ec461d87731250272d3d5b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.356696 28922 tablet_replica.cc:333] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.357249 28922 raft_consensus.cc:2243] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.357798 28922 raft_consensus.cc:2272] T 93f5c80a52f945d190c38174c87a9a4b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.359925 28922 tablet_replica.cc:333] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.360446 28922 raft_consensus.cc:2243] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.360911 28922 raft_consensus.cc:2272] T 21314894fdfc44de9d3e10fe163b7811 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.363108 28922 tablet_replica.cc:333] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.363660 28922 raft_consensus.cc:2243] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.364410 28922 raft_consensus.cc:2272] T cb2b3963bf784fab998b9225c3dd7f1b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.367587 28922 tablet_replica.cc:333] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.368239 28922 raft_consensus.cc:2243] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.368881 28922 raft_consensus.cc:2272] T 7a0ca7ef57384596b5f12d58b51d12f1 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:44.371393  6521 consensus_peers.cc:597] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f -> Peer ff3e91a2c1fe40bbba1679f08f379eb5 (127.28.62.130:43193): Couldn't send request to peer ff3e91a2c1fe40bbba1679f08f379eb5. Status: Network error: Client connection negotiation failed: client connection to 127.28.62.130:43193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.371614 28922 tablet_replica.cc:333] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.372298 28922 raft_consensus.cc:2243] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.373253 28922 raft_consensus.cc:2272] T 20fc7db35e864e71a3ca5ac9d5ff4580 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.375466 28922 tablet_replica.cc:333] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.376040 28922 raft_consensus.cc:2243] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.376452 28922 raft_consensus.cc:2272] T 466de93f2c444805802af09382fc9f86 P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.378759 28922 tablet_replica.cc:333] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.379326 28922 raft_consensus.cc:2243] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.380100 28922 raft_consensus.cc:2272] T 217b89a783ea446da690b161ea9b3999 P 5bd40b8e45db41a0b96771832c564a0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.382565 28922 tablet_replica.cc:333] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.383102 28922 raft_consensus.cc:2243] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.383581 28922 raft_consensus.cc:2272] T b87681389e8c4656ba8d06a85ecab72c P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.385979 28922 tablet_replica.cc:333] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.386543 28922 raft_consensus.cc:2243] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.387071 28922 raft_consensus.cc:2272] T 95382540983c4c5b84be0da8d3e2dd54 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.389082 28922 tablet_replica.cc:333] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.389806 28922 raft_consensus.cc:2243] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.390341 28922 raft_consensus.cc:2272] T 0656992332834ed5a881bced14f4d30b P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.392607 28922 tablet_replica.cc:333] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.393124 28922 raft_consensus.cc:2243] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.393635 28922 raft_consensus.cc:2272] T 36d144aacaed4ff590234c0e227341e8 P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.395606 28922 tablet_replica.cc:333] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.396095 28922 raft_consensus.cc:2243] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.396571 28922 raft_consensus.cc:2272] T bba9991a7eb646b28cbce1157472e0bc P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.398603 28922 tablet_replica.cc:333] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.399210 28922 raft_consensus.cc:2243] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.399647 28922 raft_consensus.cc:2272] T 5e705997065b4701a6757a88838b96de P 5bd40b8e45db41a0b96771832c564a0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.401678 28922 tablet_replica.cc:333] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f: stopping tablet replica
I20260709 13:15:44.402133 28922 raft_consensus.cc:2243] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:44.402614 28922 raft_consensus.cc:2272] T 450d7b2e49734f5cb93930e2e4906e6a P 5bd40b8e45db41a0b96771832c564a0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.443547 28922 tablet_server.cc:196] TabletServer@127.28.62.131:0 shutdown complete.
I20260709 13:15:44.478900 28922 master.cc:562] Master@127.28.62.190:43473 shutting down...
I20260709 13:15:44.502885 28922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:44.503566 28922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:44.503907 28922 tablet_replica.cc:333] T 00000000000000000000000000000000 P a28874fbf83843989dbc78ef43a3d2bf: stopping tablet replica
I20260709 13:15:44.525058 28922 master.cc:584] Master@127.28.62.190:43473 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12224 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24995 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (309702 ms total)
[  PASSED  ] 8 tests.
I20260709 13:15:44.589994 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 415 messages since previous log ~15 seconds ago
I20260709 13:15:44.590304 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 415 messages since previous log ~15 seconds ago
I20260709 13:15:44.590495 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 411 messages since previous log ~15 seconds ago
I20260709 13:15:44.590720 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:15:44.590899 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:15:44.591151 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~190 seconds ago
I20260709 13:15:44.591432 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:15:44.591756 28922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
